Jul 12 21:50:27.392250 ip-10-0-141-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 12 21:50:27.392266 ip-10-0-141-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 12 21:50:27.392277 ip-10-0-141-23 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 12 21:50:27.392601 ip-10-0-141-23 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 12 21:50:38.731510 ip-10-0-141-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 12 21:50:38.731532 ip-10-0-141-23 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 92c940ee77674bde99ab3c394a5e7ee3 --
Jul 12 21:52:16.241343 ip-10-0-141-23 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 21:52:16.682823 ip-10-0-141-23 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 21:52:16.682823 ip-10-0-141-23 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 21:52:16.682823 ip-10-0-141-23 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 21:52:16.682823 ip-10-0-141-23 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 21:52:16.682823 ip-10-0-141-23 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 21:52:16.683899 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.683755    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 21:52:16.694628 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694598    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:16.694628 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694619    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:16.694628 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694623    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:16.694628 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694627    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:16.694628 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694632    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:16.694628 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694637    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694643    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694648    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694653    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694657    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694660    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694663    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694669    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694672    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694675    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694678    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694681    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694684    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694687    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694690    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694692    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694695    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694698    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694701    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:16.694984 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694707    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694709    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694712    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694715    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694718    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694731    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694734    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694737    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694740    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694743    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694745    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694749    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694751    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694757    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694760    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694764    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694767    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694770    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694773    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694776    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:16.697173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694781    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694783    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694786    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694790    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694792    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694798    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694800    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694803    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694806    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694809    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694812    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694815    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694818    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694821    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694823    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694826    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694829    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694836    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694846    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:16.697675 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694849    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694852    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694855    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694858    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694860    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694866    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694868    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694871    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694875    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694878    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694883    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694887    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694890    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694892    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694895    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694898    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694901    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694903    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694912    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:16.698144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694914    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694917    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694920    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694925    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694928    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694931    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694934    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694937    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694940    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694942    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694945    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694948    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694951    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694956    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694959    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694963    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.694968    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696298    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696308    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696317    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:16.698596 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696320    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696324    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696327    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696330    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696337    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696340    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696343    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696346    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696349    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696351    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696354    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696357    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696360    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696363    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696366    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696368    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696371    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696376    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696379    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696382    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:16.699085 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696385    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696387    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696390    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696393    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696396    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696399    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696408    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696411    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696414    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696420    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696422    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696425    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696428    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696432    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696435    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696438    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696441    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696443    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696446    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:16.699618 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696449    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696453    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696458    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696461    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696463    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696466    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696469    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696475    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696478    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696481    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696484    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696486    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696489    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696491    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696494    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696499    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696502    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696504    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696507    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696510    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:16.700099 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696520    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696523    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696525    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696528    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696530    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696533    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696536    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696539    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696546    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696550    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696552    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696556    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696559    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696562    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696565    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696568    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696571    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696574    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696577    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:16.700679 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696582    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696585    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696589    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696592    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696595    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696597    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696600    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696602    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696605    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696607    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696611    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696615    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696621    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696624    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696640    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696643    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696646    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.696648    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697238    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697245    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:16.701154 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697248    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697251    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697253    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697256    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697258    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697261    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697263    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697266    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697268    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697271    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697273    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697276    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697278    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697281    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697283    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697286    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697288    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697291    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697294    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697296    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:16.701634 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697298    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697301    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697304    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697307    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697314    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697316    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697319    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697321    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697323    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697326    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697329    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697334    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697336    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697339    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697341    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697344    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697346    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697350    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697354    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:16.702124 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697357    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697360    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697362    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697365    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697367    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697369    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697372    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697374    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697376    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697379    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697382    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697385    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697387    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697390    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697392    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697395    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697398    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697400    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697402    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697405    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:16.702577 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697407    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697410    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697413    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697416    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697422    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697425    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697427    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697430    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697432    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697435    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697437    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697440    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697442    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697446    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697448    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697450    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697453    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697455    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697458    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697460    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:16.703068 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697463    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697471    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697474    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697476    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697479    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697481    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697483    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697487    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697490    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697492    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697494    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697497    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697499    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697502    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697504    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697506    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697510    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.697513    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697591    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697598    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697607    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 21:52:16.703557 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697611    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697615    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697618    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697622    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697626    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697629    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697632    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697636    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697639    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697642    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697645    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697647    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697650    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697665    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697669    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697675    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697677    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697680    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697685    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697689    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697692    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697695    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697698    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 21:52:16.704106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697701    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697704    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697706    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697709    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697713    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697716    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697720    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697722    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697725    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697728    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697730    2579 flags.go:64] FLAG: --enable-server="true"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697733    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697740    2579 flags.go:64] FLAG: --event-burst="100"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697743    2579 flags.go:64] FLAG: --event-qps="50"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697746    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697749    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697751    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697755    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697758    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697761    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697763    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697766    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697769    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697777    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697780    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 21:52:16.704654 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697783    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697786    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697790    2579 flags.go:64] FLAG: --feature-gates=""
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697794    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697797    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697800    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697802    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697805    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697808    2579 flags.go:64] FLAG: --help="false"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697811    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-23.ec2.internal"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697814    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697817    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697820    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697823    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697827    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697829    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697832    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697835    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697838    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697841    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697844    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697846    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697849    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697852    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 21:52:16.705327 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697854    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697857    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697860    2579 flags.go:64] FLAG: --lock-file=""
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697862    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697865    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697868    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697873    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697883    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697886    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697889    2579 flags.go:64] FLAG: --logging-format="text"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697893    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697896    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697899    2579 flags.go:64] FLAG: --manifest-url=""
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697901    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697905    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697908    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697912    2579 flags.go:64] FLAG: --max-pods="110"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697915    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697918    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697922    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697925    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697928    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697931    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697933    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697941    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 21:52:16.705912 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697944    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697947    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697950    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697953    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697958    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697961    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697964    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697966    2579 flags.go:64] FLAG: --port="10250"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697969    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697972    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-001f9ce8acda61a76"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697975    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697978    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697980    2579 flags.go:64] FLAG: --register-node="true"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697983    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697987    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697995    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.697998    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698002    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698006    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698009    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698012    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698015    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698034    2579 flags.go:64] FLAG: --runonce="false"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698039    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698043    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 21:52:16.706532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698046    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698048    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698053    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698056    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698059    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698061    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698064    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698067    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698069    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698072    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698075    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698077    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698080    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698085    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698088    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698090    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698097    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698099    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698102    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698105    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698108    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698111    2579 flags.go:64] FLAG: --v="2"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698115    2579 flags.go:64] FLAG: --version="false"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698125    2579 flags.go:64] FLAG: --vmodule=""
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698130    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 21:52:16.707153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.698134    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698243    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698247    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698250    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698252    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698255    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698258    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698261    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698263    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698267    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698269    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698271    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698274    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698276    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698279    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698281    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698283    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698286    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698288    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698291    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:16.707788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698293    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698295    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698298    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698300    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698303    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698305    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698308    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698310    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698313    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698315    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698317    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698328    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698331    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698334    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698336    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698338    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698340    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698343    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698346    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698348    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:16.708282 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698351    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698353    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698356    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698358    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698361    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698363    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698366    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698370    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698373    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698376    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698378    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698381    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698384    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698386    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698389    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698391    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698393    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698396    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698398    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:16.708754 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698401    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698403    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698405    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698407    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698410    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698418    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698421    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698423    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698427    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698430    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698433    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698435    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698438    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698440    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698443    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698446    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698449    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698452    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:16.709251 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698454    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698458    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698462    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698464    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698467    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698469    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698471    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698474    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698476    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698478    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698481    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698483    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698485    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698488    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698490    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698492    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698495    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698497    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698500    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698502    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:16.709684 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698510    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698513    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.698515    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.699266    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.706668    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.706683    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.707585    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.707592    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707649    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707655    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707659    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707663    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707667    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707671    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707675    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:16.710184 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707678    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707681    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707684    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707687    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707690    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707692    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707695    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707698    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707700    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707703    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707705    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707708    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707710    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707712    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707715    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707718    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707721    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707725    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707728    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707731    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:16.710551 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707733    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707736    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707739    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707741    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707744    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707746    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707749    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707751    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707754    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707756    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707760    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707763    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707766    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707769    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707772    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707774    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707777    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707780    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707782    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:16.711045 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707785    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707787    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707790    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707793    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707795    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707798    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707800    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707803    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707806    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707809    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707811    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707814    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707817    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707820    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707823    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707826    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707828    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707831    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707833    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:16.711518 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707836    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707838    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707841    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707843    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707846    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707848    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707850    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707853    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707855    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707858    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707861    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707863    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707865    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707868    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707870    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707873    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707875    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707878    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707880    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707883    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:16.711973 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707886    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707888    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707891    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707893    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707896    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707899    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707902    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707906    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707909    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707911    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707914    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707916    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707919    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.707921    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.707926    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 21:52:16.712457 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708084    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708089    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708092    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708096    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708099    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708102    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708105    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708107    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708110    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708115    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708118    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708121    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708123    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708126    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708128    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708131    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708133    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708136    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708138    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:16.712821 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708141    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708143    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708146    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708148    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708151    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708154    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708157    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708159    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708162    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708164    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708167    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708170    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708173    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708175    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708177    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708180    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708182    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708185    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708187    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708190    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:16.713312 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708192    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708194    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708197    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708199    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708201    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708204    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708206    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708208    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708211    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708213    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708216    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708218    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708221    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708224    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708226    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708228    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708231    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708234    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708237    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708239    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:16.713786 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708241    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708244    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708246    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708249    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708251    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708253    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708255    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708258    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708260    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708263    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708265    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708267    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708269    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708272    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708274    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708277    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708279    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708281    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708284    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708287    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:16.714284 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708289    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708292    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708295    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708297    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708300    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708302    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708304    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708307    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708309    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708311    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708316    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708319    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708322    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708325    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708328    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708330    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708333    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708335    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708338    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:16.714753 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:16.708341    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:16.715224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.708345    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 21:52:16.715224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.708451    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 21:52:16.715224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.710760    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 21:52:16.715224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.712502    2579 server.go:1019] "Starting client certificate rotation"
Jul 12 21:52:16.715224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.712598    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 21:52:16.715224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.713285    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 21:52:16.715489 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.715474    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 21:52:16.717344 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.717317    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 21:52:16.729274 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.729243    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 12 21:52:16.732485 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.732465    2579 log.go:25] "Validated CRI v1 image API"
Jul 12 21:52:16.734275 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.734260    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 21:52:16.739578 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.739557    2579 fs.go:135] Filesystem UUIDs: map[00eb7204-da97-40f7-abc7-bf0aa26337c7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a87bd890-998e-4ffd-b5bf-fa8a38b571e7:/dev/nvme0n1p4]
Jul 12 21:52:16.739658 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.739576    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 21:52:16.745129 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.744986    2579 manager.go:216] Machine: {Timestamp:2026-07-12 21:52:16.743479212 +0000 UTC m=+0.372310282 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3141704 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25a6d5f6ffe94d63429d9c718165fe SystemUUID:ec25a6d5-f6ff-e94d-6342-9d9c718165fe BootID:92c940ee-7767-4bde-99ab-3c394a5e7ee3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:83:1f:87:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:83:1f:87:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:99:5f:bf:8b:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 21:52:16.745129 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.745124    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 21:52:16.745247 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.745216    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 21:52:16.745460 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.745443    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 21:52:16.748553 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.748522    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 21:52:16.748699 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.748557    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 21:52:16.749418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.749406    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 21:52:16.749454 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.749419    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 21:52:16.749454 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.749428    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 21:52:16.749454 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.749444    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 21:52:16.751243 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.751229    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 21:52:16.755886 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.755873    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 21:52:16.756009 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.755999    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 21:52:16.756056 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756042    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 21:52:16.756056 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756054    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 21:52:16.756106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756068    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 21:52:16.756106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756077    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 12 21:52:16.756106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756087    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 21:52:16.756494 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756481    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 21:52:16.756545 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.756500    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 21:52:16.759989 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.759968    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 21:52:16.762406 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762393    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 21:52:16.762463 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762424    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 21:52:16.762606 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762595    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 21:52:16.762661 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762611    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 21:52:16.762661 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762618    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 21:52:16.762661 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762623    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 21:52:16.762661 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762632    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 21:52:16.762661 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.762639    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 21:52:16.763296 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.763286    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 21:52:16.763296 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.763296    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 21:52:16.763360 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.763302    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 21:52:16.763360 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.763308    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 21:52:16.763360 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.763322    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 21:52:16.763360 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.763330    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 21:52:16.764231 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.764210    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 21:52:16.764231 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.764234    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 21:52:16.766321 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.766281    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 21:52:16.766418 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.766356    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 21:52:16.766418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.766361    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 21:52:16.767622 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.767607    2579 server.go:1268] "Started kubelet"
Jul 12 21:52:16.767710 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.767682    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 21:52:16.767842 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.767781    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 21:52:16.767896 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.767870    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 21:52:16.772861 ip-10-0-141-23 systemd[1]: Started Kubernetes Kubelet.
Jul 12 21:52:16.776241 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.773957    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 21:52:16.776241 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.775146    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 21:52:16.776451 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.776363    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 21:52:16.782415 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.782391    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 21:52:16.782415 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.782404    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 21:52:16.782637 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.782500    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:16.783225 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783195    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 21:52:16.783337 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783279    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 21:52:16.783418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783342    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 21:52:16.783418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783282    2579 factory.go:55] Registering systemd factory
Jul 12 21:52:16.783418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783404    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 12 21:52:16.783546 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783491    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 21:52:16.783546 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783499    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 21:52:16.783840 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783827    2579 factory.go:153] Registering CRI-O factory
Jul 12 21:52:16.783901 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783846    2579 factory.go:223] Registration of the crio container factory successfully
Jul 12 21:52:16.783901 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783898    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 21:52:16.783988 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783923    2579 factory.go:103] Registering Raw factory
Jul 12 21:52:16.783988 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.783939    2579 manager.go:1196] Started watching for new ooms in manager
Jul 12 21:52:16.784636 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.784603    2579 manager.go:349] Starting recovery of all containers
Jul 12 21:52:16.788956 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.788931    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 21:52:16.789094 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.788993    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 21:52:16.790425 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.789090    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-23.ec2.internal.18c1a95b3e49e875  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-23.ec2.internal,UID:ip-10-0-141-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-23.ec2.internal,},FirstTimestamp:2026-07-12 21:52:16.767576181 +0000 UTC m=+0.396407246,LastTimestamp:2026-07-12 21:52:16.767576181 +0000 UTC m=+0.396407246,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-23.ec2.internal,}"
Jul 12 21:52:16.793341 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.793325    2579 manager.go:354] Recovery completed
Jul 12 21:52:16.795054 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.795009    2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 12 21:52:16.796077 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.796058    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjhkt"
Jul 12 21:52:16.796368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.796341    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 21:52:16.798168 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.798153    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:16.800235 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800142    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:16.800235 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800181    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:16.800235 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800197    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:16.800811 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800791    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 21:52:16.800811 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800804    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 21:52:16.801135 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800824    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 21:52:16.801135 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.800806    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:16.801754 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.801736    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:16.801828 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.801767    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:16.801828 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.801781    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:16.802477 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.802400    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-23.ec2.internal.18c1a95b403b1886  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-23.ec2.internal,UID:ip-10-0-141-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-23.ec2.internal,},FirstTimestamp:2026-07-12 21:52:16.800159878 +0000 UTC m=+0.428990945,LastTimestamp:2026-07-12 21:52:16.800159878 +0000 UTC m=+0.428990945,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-23.ec2.internal,}"
Jul 12 21:52:16.803056 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.803044    2579 policy_none.go:49] "None policy: Start"
Jul 12 21:52:16.803088 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.803060    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 21:52:16.803088 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.803071    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 21:52:16.804662 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.804649    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vjhkt"
Jul 12 21:52:16.805089 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.805078    2579 policy_none.go:47] "Start"
Jul 12 21:52:16.811282 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.811213    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-23.ec2.internal.18c1a95b403b8aee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-23.ec2.internal,UID:ip-10-0-141-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-23.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-23.ec2.internal,},FirstTimestamp:2026-07-12 21:52:16.800189166 +0000 UTC m=+0.429020236,LastTimestamp:2026-07-12 21:52:16.800189166 +0000 UTC m=+0.429020236,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-23.ec2.internal,}"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.843838    2579 manager.go:337] "Starting Device Plugin manager"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.843868    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.843880    2579 server.go:87] "Starting device plugin registration server"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.844164    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.844175    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.844284    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.844376    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.844385    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.844921    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 21:52:16.865621 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.844964    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:16.931352 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.931317    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 21:52:16.931352 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.931358    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 21:52:16.931568 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.931381    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 21:52:16.931568 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.931424    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 21:52:16.934316 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.934247    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:16.944478 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.944457    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:16.945415 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.945390    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:16.945523 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.945425    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:16.945523 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.945437    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:16.945523 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.945471    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-23.ec2.internal"
Jul 12 21:52:16.956183 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:16.956156    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-23.ec2.internal"
Jul 12 21:52:16.956302 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.956185    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-23.ec2.internal\": node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:16.980932 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:16.980904    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.032149 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.032100    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"]
Jul 12 21:52:17.032299 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.032206    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:17.033272 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.033252    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:17.033394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.033288    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:17.033394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.033301    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:17.035711 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.035692    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:17.035818 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.035803    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.035879 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.035839    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:17.036678 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.036658    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:17.036777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.036689    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:17.036777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.036703    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:17.036777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.036729    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:17.036777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.036752    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:17.036777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.036761    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:17.038961 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.038947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.039011 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.038974    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:17.039762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.039743    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:17.039853 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.039770    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:17.039853 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.039780    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:17.057555 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.057529    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-23.ec2.internal\" not found" node="ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.060973 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.060959    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-23.ec2.internal\" not found" node="ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.081805 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.081778    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.182650 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.182618    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.184882 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.184837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf99d0edbd1a67e22cbdec612d00cb7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"cf99d0edbd1a67e22cbdec612d00cb7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.184882 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.184864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4740d71f911f75a9ff886271e50b3f9a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-23.ec2.internal\" (UID: \"4740d71f911f75a9ff886271e50b3f9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.184963 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.184884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf99d0edbd1a67e22cbdec612d00cb7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"cf99d0edbd1a67e22cbdec612d00cb7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.283292 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.283264    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.285466 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.285453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf99d0edbd1a67e22cbdec612d00cb7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"cf99d0edbd1a67e22cbdec612d00cb7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.285510 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.285478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4740d71f911f75a9ff886271e50b3f9a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-23.ec2.internal\" (UID: \"4740d71f911f75a9ff886271e50b3f9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.285510 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.285497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf99d0edbd1a67e22cbdec612d00cb7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"cf99d0edbd1a67e22cbdec612d00cb7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.285570 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.285551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf99d0edbd1a67e22cbdec612d00cb7c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"cf99d0edbd1a67e22cbdec612d00cb7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.285603 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.285563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf99d0edbd1a67e22cbdec612d00cb7c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal\" (UID: \"cf99d0edbd1a67e22cbdec612d00cb7c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.285603 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.285573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4740d71f911f75a9ff886271e50b3f9a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-23.ec2.internal\" (UID: \"4740d71f911f75a9ff886271e50b3f9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.359680 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.359638    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.364713 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.364481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.384373 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.384345    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.484939 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.484852    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.585401 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.585368    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.686121 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.686086    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.711394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.711366    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 21:52:17.711549 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.711523    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 21:52:17.786398 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:17.786322    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-23.ec2.internal\" not found"
Jul 12 21:52:17.807633 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.807609    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:17.810335 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.810305    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 21:47:17 +0000 UTC" deadline="2028-03-25 22:30:44.440460634 +0000 UTC"
Jul 12 21:52:17.810401 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.810331    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14928h38m26.630132482s"
Jul 12 21:52:17.883511 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.883476    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.898530 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.898497    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 21:52:17.900110 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.900093    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal"
Jul 12 21:52:17.911925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.911901    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 21:52:17.956453 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:17.956415    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf99d0edbd1a67e22cbdec612d00cb7c.slice/crio-7f456478d253cf2c1ec7efec788f9f5a77f3791016c60d78543bded2559005f8 WatchSource:0}: Error finding container 7f456478d253cf2c1ec7efec788f9f5a77f3791016c60d78543bded2559005f8: Status 404 returned error can't find the container with id 7f456478d253cf2c1ec7efec788f9f5a77f3791016c60d78543bded2559005f8
Jul 12 21:52:17.957075 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:17.957054    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4740d71f911f75a9ff886271e50b3f9a.slice/crio-05c7a5dc3c15328bbc22b7d87fbbf4444666aca1d35f483892a63b23e5afad47 WatchSource:0}: Error finding container 05c7a5dc3c15328bbc22b7d87fbbf4444666aca1d35f483892a63b23e5afad47: Status 404 returned error can't find the container with id 05c7a5dc3c15328bbc22b7d87fbbf4444666aca1d35f483892a63b23e5afad47
Jul 12 21:52:17.963745 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:17.963721    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 21:52:18.134540 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.134446    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:18.171698 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.171667    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:18.517569 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.517482    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:18.757936 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.757645    2579 apiserver.go:52] "Watching apiserver"
Jul 12 21:52:18.766624 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.766590    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 21:52:18.768440 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.768373    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gnflx","kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nnzbh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal","openshift-multus/multus-2qhv8","openshift-network-diagnostics/network-check-target-85z9x","openshift-ovn-kubernetes/ovnkube-node-lsjgt","kube-system/global-pull-secret-syncer-58565","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv","openshift-dns/node-resolver-jxj5m","openshift-image-registry/node-ca-2srjq","openshift-multus/multus-additional-cni-plugins-qc7h2","openshift-multus/network-metrics-daemon-z8wtc","openshift-network-operator/iptables-alerter-wk87j"]
Jul 12 21:52:18.771299 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.771269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.773891 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.773872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:18.774069 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.773961    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:18.774897 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.774417    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.774897 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.774507    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.774897 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.774681    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g2l6g\""
Jul 12 21:52:18.776786 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.776764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.779880 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.779653    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.779880 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.779665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mkmcn\""
Jul 12 21:52:18.779880 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.779817    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.780292 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.780270    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.782311 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.782286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.783497 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.783466    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 21:52:18.783598 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.783562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.783803 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.783784    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpl42\""
Jul 12 21:52:18.783995 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.783980    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.784280 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.784263    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 21:52:18.785174 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.785155    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 21:52:18.785249 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.785214    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.785505 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.785488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 21:52:18.785698 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.785684    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lqkb9\""
Jul 12 21:52:18.785764 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.785707    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.787882 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.787860    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:18.787982 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.787923    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:18.789904 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.789882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.792768 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.792745    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 21:52:18.792997 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.792980    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.793565 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.793544    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.793782 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.793758    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k86zj\""
Jul 12 21:52:18.794032 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.794017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.796055 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-socket-dir-parent\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796200 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysctl-conf\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796200 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-run\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796200 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-cni-bin\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796200 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-cni-multus\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796381 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxnq\" (UniqueName: \"kubernetes.io/projected/e50c15a7-7bc7-431d-90f0-fd16208762bc-kube-api-access-dzxnq\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796381 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e72d54d-f9a5-4461-aa9e-ce5215d65399-tmp-dir\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.796381 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4m5\" (UniqueName: \"kubernetes.io/projected/5e72d54d-f9a5-4461-aa9e-ce5215d65399-kube-api-access-nc4m5\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.796381 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-lib-modules\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796381 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-tmp\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796381 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvc2\" (UniqueName: \"kubernetes.io/projected/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-kube-api-access-nrvc2\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-etc-kubernetes\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e72d54d-f9a5-4461-aa9e-ce5215d65399-hosts-file\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-os-release\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9p6\" (UniqueName: \"kubernetes.io/projected/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-kube-api-access-gf9p6\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-var-lib-kubelet\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-tuned\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-hostroot\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-conf-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-k8s-cni-cncf-io\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-system-cni-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.796762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-cnibin\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/590aa742-7560-457a-ae2b-7ab5b375b491-iptables-alerter-script\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-cni-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e50c15a7-7bc7-431d-90f0-fd16208762bc-cni-binary-copy\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-modprobe-d\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-kubelet\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysconfig\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.796870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-kubernetes\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-systemd\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-daemon-config\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-multus-certs\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysctl-d\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-sys\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-host\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.797072    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797313    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 21:52:18.797368 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-netns\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.798301 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/590aa742-7560-457a-ae2b-7ab5b375b491-host-slash\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.798301 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xqj\" (UniqueName: \"kubernetes.io/projected/590aa742-7560-457a-ae2b-7ab5b375b491-kube-api-access-v4xqj\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.798301 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797424    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.798301 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797535    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sr22x\""
Jul 12 21:52:18.798301 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797629    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 21:52:18.798301 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.797648    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.803857 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.803829    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 21:52:18.804012 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.803991    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 21:52:18.804537 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.804490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:18.805976 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.805954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 21:52:18.807105 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.807085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:18.807315 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.807295    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 21:52:18.807989 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.807973    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rdttt\""
Jul 12 21:52:18.808248 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.808226    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 21:52:18.810755 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.809861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 21:52:18.810844 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.810175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2bz6m\""
Jul 12 21:52:18.810906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.810275    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 21:52:18.810982 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.810315    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 21:52:18.811087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.810742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.814986 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.814043    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 21:52:18.814986 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.814321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 21:52:18.814986 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.814321    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6s24r\""
Jul 12 21:52:18.828149 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.828123    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m659s"
Jul 12 21:52:18.838123 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.838076    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m659s"
Jul 12 21:52:18.885223 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.885185    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 21:52:18.897736 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e72d54d-f9a5-4461-aa9e-ce5215d65399-tmp-dir\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.897906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:18.897906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-socket-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.897906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-ovn\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.897906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.897906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-var-lib-kubelet\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.897906 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-tuned\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-sys-fs\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.897989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-var-lib-kubelet\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-hostroot\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-serviceca\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-cnibin\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/590aa742-7560-457a-ae2b-7ab5b375b491-iptables-alerter-script\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-hostroot\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-modprobe-d\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e72d54d-f9a5-4461-aa9e-ce5215d65399-tmp-dir\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ca2f5b3-4c05-41b3-bab7-b173c7483852-dbus\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-kubelet\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.898259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-kubernetes\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-systemd\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898294    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-ovnkube-script-lib\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-daemon-config\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898361    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-modprobe-d\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysctl-d\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-run-netns\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-kubernetes\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-kubelet\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-systemd\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/590aa742-7560-457a-ae2b-7ab5b375b491-host-slash\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysctl-conf\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-lib-modules\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898534    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/590aa742-7560-457a-ae2b-7ab5b375b491-host-slash\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-lib-modules\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysctl-conf\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.898813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-tmp\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-cni-binary-copy\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4m5\" (UniqueName: \"kubernetes.io/projected/5e72d54d-f9a5-4461-aa9e-ce5215d65399-kube-api-access-nc4m5\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysctl-d\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvc2\" (UniqueName: \"kubernetes.io/projected/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-kube-api-access-nrvc2\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ca2f5b3-4c05-41b3-bab7-b173c7483852-kubelet-config\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/590aa742-7560-457a-ae2b-7ab5b375b491-iptables-alerter-script\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-slash\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898922    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-log-socket\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.898949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-cni-bin\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-daemon-config\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbafc029-4615-42c0-8762-b5a488225f05-agent-certs\") pod \"konnectivity-agent-gnflx\" (UID: \"fbafc029-4615-42c0-8762-b5a488225f05\") " pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-etc-kubernetes\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e72d54d-f9a5-4461-aa9e-ce5215d65399-hosts-file\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-etc-kubernetes\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.899686 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e72d54d-f9a5-4461-aa9e-ce5215d65399-hosts-file\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-registration-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-cni-netd\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.899476    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfwqm\" (UniqueName: \"kubernetes.io/projected/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-kube-api-access-cfwqm\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.899594    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:19.399570856 +0000 UTC m=+3.028401931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-system-cni-dir\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-os-release\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9p6\" (UniqueName: \"kubernetes.io/projected/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-kube-api-access-gf9p6\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-systemd\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-os-release\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-os-release\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8hg8\" (UniqueName: \"kubernetes.io/projected/05b59596-e593-4834-a61d-a79e87f1aa80-kube-api-access-s8hg8\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-conf-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-k8s-cni-cncf-io\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-system-cni-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.900383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.899982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-conf-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-cnibin\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-var-lib-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-k8s-cni-cncf-io\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-cni-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e50c15a7-7bc7-431d-90f0-fd16208762bc-cni-binary-copy\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-system-cni-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-cnibin\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-node-log\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp2rj\" (UniqueName: \"kubernetes.io/projected/1452c838-4673-4e09-9059-528a72b07cf0-kube-api-access-xp2rj\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-cni-dir\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysconfig\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-device-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-sysconfig\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-kubelet\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.901239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-systemd-units\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-etc-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-ovnkube-config\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1452c838-4673-4e09-9059-528a72b07cf0-ovn-node-metrics-cert\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-multus-certs\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-sys\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-multus-certs\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e50c15a7-7bc7-431d-90f0-fd16208762bc-cni-binary-copy\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-host\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbafc029-4615-42c0-8762-b5a488225f05-konnectivity-ca\") pod \"konnectivity-agent-gnflx\" (UID: \"fbafc029-4615-42c0-8762-b5a488225f05\") " pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-host\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-host\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-sys\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-netns\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xqj\" (UniqueName: \"kubernetes.io/projected/590aa742-7560-457a-ae2b-7ab5b375b491-kube-api-access-v4xqj\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.902052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-run-netns\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.900983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-socket-dir-parent\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-multus-socket-dir-parent\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-run\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-run\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxml\" (UniqueName: \"kubernetes.io/projected/a0f537ee-69ca-45ff-8367-668228a68333-kube-api-access-xjxml\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-env-overrides\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-cni-bin\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-cni-multus\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxnq\" (UniqueName: \"kubernetes.io/projected/e50c15a7-7bc7-431d-90f0-fd16208762bc-kube-api-access-dzxnq\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-cni-bin\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.901381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e50c15a7-7bc7-431d-90f0-fd16208762bc-host-var-lib-cni-multus\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.902120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-tmp\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.902949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.902315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-etc-tuned\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.907044 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.907013    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:18.907183 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.907060    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:18.907183 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.907076    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:18.907183 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:18.907147    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:52:19.407126819 +0000 UTC m=+3.035957899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:18.911260 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.911230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9p6\" (UniqueName: \"kubernetes.io/projected/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-kube-api-access-gf9p6\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:18.911748 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.911701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4m5\" (UniqueName: \"kubernetes.io/projected/5e72d54d-f9a5-4461-aa9e-ce5215d65399-kube-api-access-nc4m5\") pod \"node-resolver-jxj5m\" (UID: \"5e72d54d-f9a5-4461-aa9e-ce5215d65399\") " pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:18.914153 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.914129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxnq\" (UniqueName: \"kubernetes.io/projected/e50c15a7-7bc7-431d-90f0-fd16208762bc-kube-api-access-dzxnq\") pod \"multus-2qhv8\" (UID: \"e50c15a7-7bc7-431d-90f0-fd16208762bc\") " pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:18.917549 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.917469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvc2\" (UniqueName: \"kubernetes.io/projected/3d35f701-d452-48bb-a2b3-69ab4fbdb35c-kube-api-access-nrvc2\") pod \"tuned-nnzbh\" (UID: \"3d35f701-d452-48bb-a2b3-69ab4fbdb35c\") " pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:18.918976 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.918954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xqj\" (UniqueName: \"kubernetes.io/projected/590aa742-7560-457a-ae2b-7ab5b375b491-kube-api-access-v4xqj\") pod \"iptables-alerter-wk87j\" (UID: \"590aa742-7560-457a-ae2b-7ab5b375b491\") " pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:18.938684 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.938614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" event={"ID":"cf99d0edbd1a67e22cbdec612d00cb7c","Type":"ContainerStarted","Data":"7f456478d253cf2c1ec7efec788f9f5a77f3791016c60d78543bded2559005f8"}
Jul 12 21:52:18.944299 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:18.944259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal" event={"ID":"4740d71f911f75a9ff886271e50b3f9a","Type":"ContainerStarted","Data":"05c7a5dc3c15328bbc22b7d87fbbf4444666aca1d35f483892a63b23e5afad47"}
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxml\" (UniqueName: \"kubernetes.io/projected/a0f537ee-69ca-45ff-8367-668228a68333-kube-api-access-xjxml\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-env-overrides\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-socket-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-ovn\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-sys-fs\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-serviceca\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-cnibin\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.002336    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ca2f5b3-4c05-41b3-bab7-b173c7483852-dbus\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-ovnkube-script-lib\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.002400    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:19.502378603 +0000 UTC m=+3.131209673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-run-netns\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-cni-binary-copy\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ca2f5b3-4c05-41b3-bab7-b173c7483852-kubelet-config\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-slash\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-log-socket\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-cni-bin\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.002689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbafc029-4615-42c0-8762-b5a488225f05-agent-certs\") pod \"konnectivity-agent-gnflx\" (UID: \"fbafc029-4615-42c0-8762-b5a488225f05\") " pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-sys-fs\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-registration-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-cni-netd\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfwqm\" (UniqueName: \"kubernetes.io/projected/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-kube-api-access-cfwqm\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-system-cni-dir\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-systemd\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002835    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-socket-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-os-release\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8hg8\" (UniqueName: \"kubernetes.io/projected/05b59596-e593-4834-a61d-a79e87f1aa80-kube-api-access-s8hg8\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002893    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-ovn\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-var-lib-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-node-log\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.002987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp2rj\" (UniqueName: \"kubernetes.io/projected/1452c838-4673-4e09-9059-528a72b07cf0-kube-api-access-xp2rj\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-device-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.003631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-kubelet\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-systemd-units\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-etc-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-etc-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-cnibin\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-ovnkube-config\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1452c838-4673-4e09-9059-528a72b07cf0-ovn-node-metrics-cert\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbafc029-4615-42c0-8762-b5a488225f05-konnectivity-ca\") pod \"konnectivity-agent-gnflx\" (UID: \"fbafc029-4615-42c0-8762-b5a488225f05\") " pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-host\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-run-netns\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-registration-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-cni-netd\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-serviceca\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-system-cni-dir\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.004303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-systemd\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05b59596-e593-4834-a61d-a79e87f1aa80-os-release\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-var-lib-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ca2f5b3-4c05-41b3-bab7-b173c7483852-dbus\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-ovnkube-script-lib\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0f537ee-69ca-45ff-8367-668228a68333-device-dir\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.003963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-systemd-units\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-kubelet\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-env-overrides\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-cni-binary-copy\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1452c838-4673-4e09-9059-528a72b07cf0-ovnkube-config\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-node-log\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05b59596-e593-4834-a61d-a79e87f1aa80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.005114 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ca2f5b3-4c05-41b3-bab7-b173c7483852-kubelet-config\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.005846 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004965    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-slash\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005846 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.004973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-host\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.005846 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.005007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-run-openvswitch\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005846 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.005047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-log-socket\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005846 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.005083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1452c838-4673-4e09-9059-528a72b07cf0-host-cni-bin\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.005846 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.005459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbafc029-4615-42c0-8762-b5a488225f05-konnectivity-ca\") pod \"konnectivity-agent-gnflx\" (UID: \"fbafc029-4615-42c0-8762-b5a488225f05\") " pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:19.007801 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.007757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbafc029-4615-42c0-8762-b5a488225f05-agent-certs\") pod \"konnectivity-agent-gnflx\" (UID: \"fbafc029-4615-42c0-8762-b5a488225f05\") " pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:19.007934 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.007903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1452c838-4673-4e09-9059-528a72b07cf0-ovn-node-metrics-cert\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.016656 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.016628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp2rj\" (UniqueName: \"kubernetes.io/projected/1452c838-4673-4e09-9059-528a72b07cf0-kube-api-access-xp2rj\") pod \"ovnkube-node-lsjgt\" (UID: \"1452c838-4673-4e09-9059-528a72b07cf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.016803 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.016677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfwqm\" (UniqueName: \"kubernetes.io/projected/3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5-kube-api-access-cfwqm\") pod \"node-ca-2srjq\" (UID: \"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5\") " pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.016803 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.016740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8hg8\" (UniqueName: \"kubernetes.io/projected/05b59596-e593-4834-a61d-a79e87f1aa80-kube-api-access-s8hg8\") pod \"multus-additional-cni-plugins-qc7h2\" (UID: \"05b59596-e593-4834-a61d-a79e87f1aa80\") " pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.017138 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.017117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxml\" (UniqueName: \"kubernetes.io/projected/a0f537ee-69ca-45ff-8367-668228a68333-kube-api-access-xjxml\") pod \"aws-ebs-csi-driver-node-pf2fv\" (UID: \"a0f537ee-69ca-45ff-8367-668228a68333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.085174 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.085081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jxj5m"
Jul 12 21:52:19.096418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.096384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nnzbh"
Jul 12 21:52:19.117329 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.117107    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wk87j"
Jul 12 21:52:19.124363 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.124330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2qhv8"
Jul 12 21:52:19.134464 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.134434    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv"
Jul 12 21:52:19.143649 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.143620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:19.154725 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.154697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:19.162750 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.162722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2srjq"
Jul 12 21:52:19.169836 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.169817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qc7h2"
Jul 12 21:52:19.407965 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.407871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:19.407965 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.407927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:19.408234 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.408083    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:19.408234 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.408111    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:19.408234 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.408124    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:19.408234 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.408083    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:19.408234 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.408184    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:52:20.408166551 +0000 UTC m=+4.036997622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:19.408520 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.408246    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:20.408230018 +0000 UTC m=+4.037061072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:19.508539 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.508498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.508730 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.508656    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:19.508782 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.508738    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:20.508716401 +0000 UTC m=+4.137547475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:19.841779 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.841682    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 21:47:19 +0000 UTC" deadline="2027-12-10 12:18:06.573834321 +0000 UTC"
Jul 12 21:52:19.841779 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.841717    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12374h25m46.732121041s"
Jul 12 21:52:19.932092 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:19.932064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:19.932259 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:19.932192    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:20.138823 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:20.138410    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e72d54d_f9a5_4461_aa9e_ce5215d65399.slice/crio-66fc7463edf8b573eb28ac6b8583985190b72af2e368790d58f1dc3d5f1762c8 WatchSource:0}: Error finding container 66fc7463edf8b573eb28ac6b8583985190b72af2e368790d58f1dc3d5f1762c8: Status 404 returned error can't find the container with id 66fc7463edf8b573eb28ac6b8583985190b72af2e368790d58f1dc3d5f1762c8
Jul 12 21:52:20.143142 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:20.143107    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f537ee_69ca_45ff_8367_668228a68333.slice/crio-4c6e9629652b3cc1a87e5102b7c5c53642a7b9b4f24b758743fc722645648242 WatchSource:0}: Error finding container 4c6e9629652b3cc1a87e5102b7c5c53642a7b9b4f24b758743fc722645648242: Status 404 returned error can't find the container with id 4c6e9629652b3cc1a87e5102b7c5c53642a7b9b4f24b758743fc722645648242
Jul 12 21:52:20.143894 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:20.143868    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b59596_e593_4834_a61d_a79e87f1aa80.slice/crio-200a95712302e555c98d026445b36cf3f40884dae6bcc6e68583c3c781954525 WatchSource:0}: Error finding container 200a95712302e555c98d026445b36cf3f40884dae6bcc6e68583c3c781954525: Status 404 returned error can't find the container with id 200a95712302e555c98d026445b36cf3f40884dae6bcc6e68583c3c781954525
Jul 12 21:52:20.144964 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:20.144935    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1452c838_4673_4e09_9059_528a72b07cf0.slice/crio-7b5ee81e73ebe7b208b2558f9970da7425c8225ddd5b575e97bf40d8252e1c5f WatchSource:0}: Error finding container 7b5ee81e73ebe7b208b2558f9970da7425c8225ddd5b575e97bf40d8252e1c5f: Status 404 returned error can't find the container with id 7b5ee81e73ebe7b208b2558f9970da7425c8225ddd5b575e97bf40d8252e1c5f
Jul 12 21:52:20.416766 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.416740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:20.416855 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.416781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:20.416895 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.416882    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:20.416930 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.416903    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:20.416930 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.416924    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:20.416994 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.416939    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:20.416994 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.416930    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:22.416916723 +0000 UTC m=+6.045747776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:20.416994 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.416992    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:52:22.416974023 +0000 UTC m=+6.045805093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:20.517553 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.517510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:20.517708 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.517645    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:20.517747 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.517717    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:22.517699073 +0000 UTC m=+6.146530145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:20.842610 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.842491    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 21:47:19 +0000 UTC" deadline="2028-01-25 20:19:18.977756674 +0000 UTC"
Jul 12 21:52:20.842610 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.842562    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13486h26m58.135200102s"
Jul 12 21:52:20.934844 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.934804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:20.935022 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.934949    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:20.935427 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.935394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:20.935550 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:20.935526    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:20.955202 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.955161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2srjq" event={"ID":"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5","Type":"ContainerStarted","Data":"6d6d46e64da34696d99b23997d80346a79f2f207eb810f963f3bc426713b1d24"}
Jul 12 21:52:20.966741 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.966696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerStarted","Data":"200a95712302e555c98d026445b36cf3f40884dae6bcc6e68583c3c781954525"}
Jul 12 21:52:20.977722 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.977683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv" event={"ID":"a0f537ee-69ca-45ff-8367-668228a68333","Type":"ContainerStarted","Data":"4c6e9629652b3cc1a87e5102b7c5c53642a7b9b4f24b758743fc722645648242"}
Jul 12 21:52:20.981321 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.981284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jxj5m" event={"ID":"5e72d54d-f9a5-4461-aa9e-ce5215d65399","Type":"ContainerStarted","Data":"66fc7463edf8b573eb28ac6b8583985190b72af2e368790d58f1dc3d5f1762c8"}
Jul 12 21:52:20.991799 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:20.991762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnflx" event={"ID":"fbafc029-4615-42c0-8762-b5a488225f05","Type":"ContainerStarted","Data":"dda812d1da381e13045770c71dc3ad4706a5461f83bb56bd3fa9a34acbe1bdf0"}
Jul 12 21:52:21.004173 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.004115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal" event={"ID":"4740d71f911f75a9ff886271e50b3f9a","Type":"ContainerStarted","Data":"4d7860da94da1c93aa6282233a112c8b53d93341dbef9fa91297fd8780098b10"}
Jul 12 21:52:21.024206 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.024168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nnzbh" event={"ID":"3d35f701-d452-48bb-a2b3-69ab4fbdb35c","Type":"ContainerStarted","Data":"f5404cdd4fe99e51d28df808c92b1a1ccbd09b8730d1ac6ad157e0841d887f02"}
Jul 12 21:52:21.026676 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.026642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"7b5ee81e73ebe7b208b2558f9970da7425c8225ddd5b575e97bf40d8252e1c5f"}
Jul 12 21:52:21.028991 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.028933    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-23.ec2.internal" podStartSLOduration=3.028915744 podStartE2EDuration="3.028915744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:21.028548524 +0000 UTC m=+4.657379603" watchObservedRunningTime="2026-07-12 21:52:21.028915744 +0000 UTC m=+4.657746823"
Jul 12 21:52:21.043379 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.043338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2qhv8" event={"ID":"e50c15a7-7bc7-431d-90f0-fd16208762bc","Type":"ContainerStarted","Data":"b81345b0d2582d4086f4b3650975933db18d82f87ed7eed77988a7ed1ee2b0ad"}
Jul 12 21:52:21.047306 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.047262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wk87j" event={"ID":"590aa742-7560-457a-ae2b-7ab5b375b491","Type":"ContainerStarted","Data":"02588a70a6c8c59883c6a3674b8521bd328eddf4030dfe108f2de832236ebcef"}
Jul 12 21:52:21.057945 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.057905    2579 generic.go:356] "Generic (PLEG): container finished" podID="cf99d0edbd1a67e22cbdec612d00cb7c" containerID="7553a725e97ab35f94311a656f358a3f6a12ea07640a752e099d19f0e02ff06b" exitCode=0
Jul 12 21:52:21.058138 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.057959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" event={"ID":"cf99d0edbd1a67e22cbdec612d00cb7c","Type":"ContainerDied","Data":"7553a725e97ab35f94311a656f358a3f6a12ea07640a752e099d19f0e02ff06b"}
Jul 12 21:52:21.932461 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:21.932416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:21.933061 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:21.932556    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:22.066763 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:22.066717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" event={"ID":"cf99d0edbd1a67e22cbdec612d00cb7c","Type":"ContainerStarted","Data":"0d0c8474a69c308924b568071cbe425dd0fefe8f64912deefcde894cec7972da"}
Jul 12 21:52:22.434240 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:22.434202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:22.434433 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:22.434319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:22.434531 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.434511    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:22.434588 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.434540    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:22.434588 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.434554    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:22.434699 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.434622    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:52:26.434601646 +0000 UTC m=+10.063432721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:22.434763 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.434707    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:22.434763 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.434743    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:26.434731372 +0000 UTC m=+10.063562431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:22.536042 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:22.535997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:22.536708 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.536684    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:22.536831 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.536803    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:26.536769353 +0000 UTC m=+10.165600423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:22.934317 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:22.934251    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:22.934787 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:22.934262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:22.934787 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.934395    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:22.934787 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:22.934498    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:23.932680 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:23.932635    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:23.932877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:23.932785    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:24.932054 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:24.931941    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:24.932617 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:24.932113    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:24.932747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:24.932673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:24.932877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:24.932786    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:25.932934 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:25.932399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:25.932934 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:25.932545    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:26.471960 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:26.471920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:26.472140 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:26.472002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:26.472185 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.472147    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:26.472185 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.472156    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:26.472260 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.472230    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:34.472208928 +0000 UTC m=+18.101039994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:26.472260 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.472161    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:26.472336 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.472289    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:26.472376 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.472333    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:52:34.472319918 +0000 UTC m=+18.101150977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:26.572915 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:26.572873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:26.573533 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.573123    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:26.573533 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.573195    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:34.573177048 +0000 UTC m=+18.202008117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:26.933143 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:26.933042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:26.933601 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.933223    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:26.934057 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:26.934012    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:26.934305 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:26.934240    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:27.932083 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:27.932049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:27.932245 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:27.932170    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:28.934174 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:28.932750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:28.934174 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:28.932892    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:28.934174 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:28.932955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:28.934174 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:28.933088    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:29.931921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:29.931885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:29.932140 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:29.932016    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:30.932161 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:30.932127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:30.932611 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:30.932169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:30.932611 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:30.932275    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:30.932611 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:30.932354    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:31.932573 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:31.932533    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:31.933003 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:31.932676    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:32.931930 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:32.931890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:32.932138 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:32.931890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:32.932138 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:32.932051    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:32.932246 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:32.932121    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:33.931982 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:33.931949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:33.932449 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:33.932075    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:34.535724 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:34.535687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:34.535724 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:34.535731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:34.535949 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.535836    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:34.535949 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.535862    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:34.535949 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.535890    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:34.535949 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.535902    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:50.535883909 +0000 UTC m=+34.164714985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:34.535949 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.535904    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:34.536189 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.535959    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:52:50.53594395 +0000 UTC m=+34.164775003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:34.636606 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:34.636568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:34.636785 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.636720    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:34.636785 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.636785    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:50.636770307 +0000 UTC m=+34.265601359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:34.932699 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:34.932630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:34.933055 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.932732    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:34.933055 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:34.932815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:34.933055 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:34.932911    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:35.932282 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:35.932244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:35.932448 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:35.932380    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:36.934844 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:36.934813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:36.935259 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:36.934940    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:36.935259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:36.935006    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:36.935259 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:36.935114    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:37.932502 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:37.932462    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:37.932666 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:37.932603    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:38.934559 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:38.934523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:38.935005 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:38.934632    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:38.935005 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:38.934716    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:38.935005 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:38.934800    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:39.931994 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:39.931694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:39.932253 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:39.932215    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:40.106287 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.106238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2srjq" event={"ID":"3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5","Type":"ContainerStarted","Data":"f122c2aa4c80f501bb8b6e49dbf2b9f83c9e5620b3d4e82e62eeaf2da0a07ac4"}
Jul 12 21:52:40.107793 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.107758    2579 generic.go:356] "Generic (PLEG): container finished" podID="05b59596-e593-4834-a61d-a79e87f1aa80" containerID="23e0b8bfc22b90e4f0a589276ee5a8a0a99c69fd357db6f7be9f496bbe4adc36" exitCode=0
Jul 12 21:52:40.107936 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.107809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerDied","Data":"23e0b8bfc22b90e4f0a589276ee5a8a0a99c69fd357db6f7be9f496bbe4adc36"}
Jul 12 21:52:40.109262 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.109199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv" event={"ID":"a0f537ee-69ca-45ff-8367-668228a68333","Type":"ContainerStarted","Data":"f4f892878a055b442bc5a063c136f97689df3cc289b9ad7b58bb16dc699e3f94"}
Jul 12 21:52:40.110553 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.110517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jxj5m" event={"ID":"5e72d54d-f9a5-4461-aa9e-ce5215d65399","Type":"ContainerStarted","Data":"f6800ab7c2c086c5b2dd1f53a8637adb5d9aa1d9629c93d173b38f071ed1f417"}
Jul 12 21:52:40.112060 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.112039    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnflx" event={"ID":"fbafc029-4615-42c0-8762-b5a488225f05","Type":"ContainerStarted","Data":"eeaa77e582b2fafb9e22fb1b3f2d7415d05a47fa6e4de834d618eb15c587eae0"}
Jul 12 21:52:40.113360 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.113341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nnzbh" event={"ID":"3d35f701-d452-48bb-a2b3-69ab4fbdb35c","Type":"ContainerStarted","Data":"fc474851e2ab8e8947b9234bc61675893ce090a4e644a047ffb4135cce420641"}
Jul 12 21:52:40.114977 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.114959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2qhv8" event={"ID":"e50c15a7-7bc7-431d-90f0-fd16208762bc","Type":"ContainerStarted","Data":"46f8abe7014bed836ab353c8fc19bc2a61fe9b7e17edf831c4b499cf6f776007"}
Jul 12 21:52:40.124356 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.124319    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2srjq" podStartSLOduration=3.76225026 podStartE2EDuration="23.124307236s" totalImagesPullingTime="19.362056976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:40.124292053 +0000 UTC m=+23.753123127" watchObservedRunningTime="2026-07-12 21:52:40.124307236 +0000 UTC m=+23.753138309"
Jul 12 21:52:40.124619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.124599    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-23.ec2.internal" podStartSLOduration=22.124594888 podStartE2EDuration="22.124594888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:22.088581496 +0000 UTC m=+5.717412571" watchObservedRunningTime="2026-07-12 21:52:40.124594888 +0000 UTC m=+23.753425962"
Jul 12 21:52:40.141355 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.141312    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jxj5m" podStartSLOduration=3.837195777 podStartE2EDuration="23.141298404s" totalImagesPullingTime="19.304102627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:40.140822265 +0000 UTC m=+23.769653336" watchObservedRunningTime="2026-07-12 21:52:40.141298404 +0000 UTC m=+23.770129477"
Jul 12 21:52:40.162653 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.162606    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nnzbh" podStartSLOduration=3.798659713 podStartE2EDuration="23.162590405s" totalImagesPullingTime="19.363930692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:40.162049689 +0000 UTC m=+23.790880761" watchObservedRunningTime="2026-07-12 21:52:40.162590405 +0000 UTC m=+23.791421478"
Jul 12 21:52:40.184474 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.184425    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2qhv8" podStartSLOduration=3.765788805 podStartE2EDuration="23.184410675s" totalImagesPullingTime="19.41862187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:40.18414424 +0000 UTC m=+23.812975314" watchObservedRunningTime="2026-07-12 21:52:40.184410675 +0000 UTC m=+23.813241742"
Jul 12 21:52:40.211431 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.211378    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gnflx" podStartSLOduration=3.904932475 podStartE2EDuration="23.211362432s" totalImagesPullingTime="19.306429957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:40.211056037 +0000 UTC m=+23.839887105" watchObservedRunningTime="2026-07-12 21:52:40.211362432 +0000 UTC m=+23.840193507"
Jul 12 21:52:40.932459 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.932428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:40.932598 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:40.932541    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:40.932598 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:40.932431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:40.932710 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:40.932617    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:41.120609 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.120534    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:52:41.121332 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.120916    2579 generic.go:356] "Generic (PLEG): container finished" podID="1452c838-4673-4e09-9059-528a72b07cf0" containerID="25d6dca3da7c2882e90001fb6fe3d53c78dbb387bff86cf962b9953e9cae5b15" exitCode=1
Jul 12 21:52:41.121332 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.120998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"e4ea7a55f3170319a201ea01f6f20d2fa3593e162dc98e44fc575e60af44185c"}
Jul 12 21:52:41.121332 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.121090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"972e1b5757b274b079f386fc17f5e83b4e9532f98ed411a5c59c5e2f8ec90e44"}
Jul 12 21:52:41.121332 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.121139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"e20c231c4dc7761feb6bfaea21a008ae72ef7c71637955a58a185eea2311cf6e"}
Jul 12 21:52:41.121332 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.121170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerDied","Data":"25d6dca3da7c2882e90001fb6fe3d53c78dbb387bff86cf962b9953e9cae5b15"}
Jul 12 21:52:41.121332 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.121216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"b739064e754a3a97f9f59f22625cd0d30ac1bfaeac55c6e96aeaf08f8def1e46"}
Jul 12 21:52:41.122702 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.122673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wk87j" event={"ID":"590aa742-7560-457a-ae2b-7ab5b375b491","Type":"ContainerStarted","Data":"ff7339dbcb2dec21318c6715adb575b627cd80df3f469aeadeb0b77a31a75341"}
Jul 12 21:52:41.146363 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.146310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wk87j" podStartSLOduration=4.765169983 podStartE2EDuration="24.146294844s" totalImagesPullingTime="19.381124861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:41.145624766 +0000 UTC m=+24.774455841" watchObservedRunningTime="2026-07-12 21:52:41.146294844 +0000 UTC m=+24.775125918"
Jul 12 21:52:41.352883 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.352856    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 21:52:41.858359 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.858272    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T21:52:41.352873519Z","UUID":"8d54462d-51d2-481a-a8f5-076c33472aaf","Handler":null,"Name":"","Endpoint":""}
Jul 12 21:52:41.859879 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.859854    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 21:52:41.860057 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.859900    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 21:52:41.932633 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:41.932602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:41.932792 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:41.932719    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:42.127245 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:42.127154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv" event={"ID":"a0f537ee-69ca-45ff-8367-668228a68333","Type":"ContainerStarted","Data":"bf17fd7b2682c85ab99d46c6be01ada8200deda814cc66ddf9de376b048aed90"}
Jul 12 21:52:42.130389 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:42.130363    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:52:42.130833 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:42.130808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"4cadd996a922d7cc8d48525367333df7171de0a312228b9561005aceb753d78b"}
Jul 12 21:52:42.932608 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:42.932573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:42.932778 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:42.932573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:42.932778 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:42.932712    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:42.932894 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:42.932780    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:43.136550 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:43.136327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv" event={"ID":"a0f537ee-69ca-45ff-8367-668228a68333","Type":"ContainerStarted","Data":"6d5754f206f34c85e4ce64461b3a971e3db878578fc40363f2b937a2eb1092ac"}
Jul 12 21:52:43.157889 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:43.157835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf2fv" podStartSLOduration=4.364801807 podStartE2EDuration="26.157820138s" totalImagesPullingTime="21.793018331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:43.157507179 +0000 UTC m=+26.786338289" watchObservedRunningTime="2026-07-12 21:52:43.157820138 +0000 UTC m=+26.786651211"
Jul 12 21:52:43.931718 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:43.931682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:43.931930 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:43.931796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:44.534521 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:44.534485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:44.535241 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:44.535221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:44.932521 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:44.932427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:44.932675 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:44.932438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:44.932675 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:44.932539    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:44.932675 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:44.932616    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:45.143882 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.143849    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:52:45.144246 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.144220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"f039ab013e2df10f3601f13d2ec9bbacc12e88fc7c0f0b61bcf0ff906510ac42"}
Jul 12 21:52:45.145935 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.145907    2579 generic.go:356] "Generic (PLEG): container finished" podID="05b59596-e593-4834-a61d-a79e87f1aa80" containerID="825151e80daf3e2c3904b05a87e14d96d80e4deba0350076b51ac2dc8d00a10c" exitCode=0
Jul 12 21:52:45.146054 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.146001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerDied","Data":"825151e80daf3e2c3904b05a87e14d96d80e4deba0350076b51ac2dc8d00a10c"}
Jul 12 21:52:45.146253 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.146240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:45.146575 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.146561    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gnflx"
Jul 12 21:52:45.932807 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:45.932459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:45.933423 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:45.932959    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:46.935287 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:46.935052    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:46.935665 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:46.935115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:46.935665 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:46.935333    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:46.935665 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:46.935376    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:47.151710 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.151676    2579 generic.go:356] "Generic (PLEG): container finished" podID="05b59596-e593-4834-a61d-a79e87f1aa80" containerID="75acdf5f6142b7745a2eb6cef8065bf288f7bd12787b2ae7dead05e72ae37993" exitCode=0
Jul 12 21:52:47.151907 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.151761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerDied","Data":"75acdf5f6142b7745a2eb6cef8065bf288f7bd12787b2ae7dead05e72ae37993"}
Jul 12 21:52:47.155346 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.155329    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:52:47.155720 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.155687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"1a309ff55150ea453b038d4ca14cd710a3653a137e24af3ed1fe9d7ea93512e7"}
Jul 12 21:52:47.155947 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.155934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:47.155993 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.155981    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:47.156122 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.156108    2579 scope.go:117] "RemoveContainer" containerID="25d6dca3da7c2882e90001fb6fe3d53c78dbb387bff86cf962b9953e9cae5b15"
Jul 12 21:52:47.173356 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.173338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:47.931984 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:47.931943    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:47.932199 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:47.932156    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:48.160690 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.160660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:52:48.161131 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.160977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" event={"ID":"1452c838-4673-4e09-9059-528a72b07cf0","Type":"ContainerStarted","Data":"7a88efe3c38c22351b7591520f6102af553162ca5b4f2879567c490b63c6ddb8"}
Jul 12 21:52:48.161278 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.161259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:48.177428 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.177396    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:52:48.189803 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.189720    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt" podStartSLOduration=11.06328899 podStartE2EDuration="31.189705928s" totalImagesPullingTime="20.126416938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:48.188327066 +0000 UTC m=+31.817158144" watchObservedRunningTime="2026-07-12 21:52:48.189705928 +0000 UTC m=+31.818537001"
Jul 12 21:52:48.888009 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.887970    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58565"]
Jul 12 21:52:48.888181 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.888092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:48.888258 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:48.888177    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:48.892267 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.892228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85z9x"]
Jul 12 21:52:48.892410 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.892292    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8wtc"]
Jul 12 21:52:48.892410 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.892385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:48.892511 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:48.892495    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:48.892621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:48.892603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:48.892714 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:48.892693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:49.166229 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:49.166153    2579 generic.go:356] "Generic (PLEG): container finished" podID="05b59596-e593-4834-a61d-a79e87f1aa80" containerID="6d969bb0e64fe638d023ac0db3af53c6cbf1b6170e84f6e973aca2fbe83d0015" exitCode=0
Jul 12 21:52:49.166612 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:49.166237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerDied","Data":"6d969bb0e64fe638d023ac0db3af53c6cbf1b6170e84f6e973aca2fbe83d0015"}
Jul 12 21:52:50.566202 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:50.566160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:50.566224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.566337    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.566372    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.566383    2579 projected.go:196] Error preparing data for projected volume kube-api-access-djg4c for pod openshift-network-diagnostics/network-check-target-85z9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.566342    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.566439    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c podName:1be16b4d-97bc-49f0-9171-6f7b1d4c4cae nodeName:}" failed. No retries permitted until 2026-07-12 21:53:22.56642166 +0000 UTC m=+66.195252728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-djg4c" (UniqueName: "kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c") pod "network-check-target-85z9x" (UID: "1be16b4d-97bc-49f0-9171-6f7b1d4c4cae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:50.566762 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.566507    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:22.566490831 +0000 UTC m=+66.195321889 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:50.667192 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:50.667154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:50.667371 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.667268    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:50.667371 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.667319    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret podName:5ca2f5b3-4c05-41b3-bab7-b173c7483852 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:22.667306772 +0000 UTC m=+66.296137824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret") pod "global-pull-secret-syncer-58565" (UID: "5ca2f5b3-4c05-41b3-bab7-b173c7483852") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:50.932288 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:50.932205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:50.932449 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:50.932205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:50.932449 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.932337    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:50.932449 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:50.932347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:50.932449 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.932428    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:50.932667 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:50.932521    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:52.932815 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:52.932073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:52.932815 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:52.932073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:52.932815 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:52.932209    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-85z9x" podUID="1be16b4d-97bc-49f0-9171-6f7b1d4c4cae"
Jul 12 21:52:52.932815 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:52.932282    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58565" podUID="5ca2f5b3-4c05-41b3-bab7-b173c7483852"
Jul 12 21:52:52.932815 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:52.932089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:52.932815 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:52.932394    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8wtc" podUID="b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8"
Jul 12 21:52:53.645399 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.645369    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-23.ec2.internal" event="NodeReady"
Jul 12 21:52:53.645557 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.645515    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 21:52:53.728456 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.727202    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55765594d7-lvk9t"]
Jul 12 21:52:53.747089 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.747059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.750247 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.750212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 21:52:53.750558 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.750541    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jvnd\""
Jul 12 21:52:53.750659 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.750543    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 21:52:53.750894 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.750878    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 21:52:53.756903 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.756883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55765594d7-lvk9t"]
Jul 12 21:52:53.757536 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.757515    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lmpjn"]
Jul 12 21:52:53.758658 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.758639    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 21:52:53.777694 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.777658    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b69bm"]
Jul 12 21:52:53.777832 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.777794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:53.781849 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.781824    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 21:52:53.782302 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.782186    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 21:52:53.782302 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.782266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2rf25\""
Jul 12 21:52:53.782502 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.782232    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 21:52:53.793659 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.793637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmpjn"]
Jul 12 21:52:53.793787 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.793668    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b69bm"]
Jul 12 21:52:53.793787 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.793743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.800719 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.800700    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6dkr4\""
Jul 12 21:52:53.800844 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.800724    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 21:52:53.800844 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.800729    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 21:52:53.891573 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-certificates\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.891655 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-image-registry-private-configuration\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.891711 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-tmp-dir\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.891759 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.891813 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-ca-trust-extracted\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.891866 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-trusted-ca\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.891866 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsz7q\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-kube-api-access-fsz7q\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.891962 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfnh7\" (UniqueName: \"kubernetes.io/projected/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-kube-api-access-kfnh7\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.891962 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-config-volume\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.891962 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.891962 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwnr4\" (UniqueName: \"kubernetes.io/projected/1c71fae0-a8c3-4c04-a49f-0b4a421b3956-kube-api-access-vwnr4\") pod \"ingress-canary-lmpjn\" (UID: \"1c71fae0-a8c3-4c04-a49f-0b4a421b3956\") " pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:53.892164 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.891974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-bound-sa-token\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.892164 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.892058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c71fae0-a8c3-4c04-a49f-0b4a421b3956-cert\") pod \"ingress-canary-lmpjn\" (UID: \"1c71fae0-a8c3-4c04-a49f-0b4a421b3956\") " pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:53.892164 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.892116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-installation-pull-secrets\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-ca-trust-extracted\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-trusted-ca\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsz7q\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-kube-api-access-fsz7q\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfnh7\" (UniqueName: \"kubernetes.io/projected/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-kube-api-access-kfnh7\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-config-volume\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnr4\" (UniqueName: \"kubernetes.io/projected/1c71fae0-a8c3-4c04-a49f-0b4a421b3956-kube-api-access-vwnr4\") pod \"ingress-canary-lmpjn\" (UID: \"1c71fae0-a8c3-4c04-a49f-0b4a421b3956\") " pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-bound-sa-token\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c71fae0-a8c3-4c04-a49f-0b4a421b3956-cert\") pod \"ingress-canary-lmpjn\" (UID: \"1c71fae0-a8c3-4c04-a49f-0b4a421b3956\") " pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:53.993457    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:53.993480    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55765594d7-lvk9t: secret "image-registry-tls" not found
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-installation-pull-secrets\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-certificates\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:53.993540    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls podName:ccce646e-7763-47ec-ac9f-ca3c28a2ac70 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:54.493518115 +0000 UTC m=+38.122349186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls") pod "image-registry-55765594d7-lvk9t" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70") : secret "image-registry-tls" not found
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-ca-trust-extracted\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-image-registry-private-configuration\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.993854 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.993623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-tmp-dir\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.994703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.994091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-tmp-dir\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.994703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.994105    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-certificates\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.994703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.994293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-trusted-ca\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.994703 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:53.994384    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:53.994703 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:53.994438    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls podName:cf6dc6fc-df9e-4b92-92cf-902dc183e1c2 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:54.49442276 +0000 UTC m=+38.123253828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls") pod "dns-default-b69bm" (UID: "cf6dc6fc-df9e-4b92-92cf-902dc183e1c2") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:53.994703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.994452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-config-volume\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:53.998185 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.998048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-installation-pull-secrets\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.998296 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.998073    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-image-registry-private-configuration\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:53.998296 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:53.998094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c71fae0-a8c3-4c04-a49f-0b4a421b3956-cert\") pod \"ingress-canary-lmpjn\" (UID: \"1c71fae0-a8c3-4c04-a49f-0b4a421b3956\") " pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:54.007459 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.007433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsz7q\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-kube-api-access-fsz7q\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:54.007714 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.007693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-bound-sa-token\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:54.008173 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.008153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfnh7\" (UniqueName: \"kubernetes.io/projected/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-kube-api-access-kfnh7\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:54.008644 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.008623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwnr4\" (UniqueName: \"kubernetes.io/projected/1c71fae0-a8c3-4c04-a49f-0b4a421b3956-kube-api-access-vwnr4\") pod \"ingress-canary-lmpjn\" (UID: \"1c71fae0-a8c3-4c04-a49f-0b4a421b3956\") " pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:54.088540 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.088512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmpjn"
Jul 12 21:52:54.182545 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.182428    2579 generic.go:356] "Generic (PLEG): container finished" podID="05b59596-e593-4834-a61d-a79e87f1aa80" containerID="55ea8c9faaa73d60ea0a840920d6d5fcc4b4a29dbfe37984901440b9e85ca2c0" exitCode=0
Jul 12 21:52:54.182545 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.182475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerDied","Data":"55ea8c9faaa73d60ea0a840920d6d5fcc4b4a29dbfe37984901440b9e85ca2c0"}
Jul 12 21:52:54.288748 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.288722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmpjn"]
Jul 12 21:52:54.297144 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:52:54.297107    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c71fae0_a8c3_4c04_a49f_0b4a421b3956.slice/crio-54b0bd1c5468f8741b7b849ff5d8b09442c57123ba9a9606df399444d7ba75e5 WatchSource:0}: Error finding container 54b0bd1c5468f8741b7b849ff5d8b09442c57123ba9a9606df399444d7ba75e5: Status 404 returned error can't find the container with id 54b0bd1c5468f8741b7b849ff5d8b09442c57123ba9a9606df399444d7ba75e5
Jul 12 21:52:54.497520 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.497431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:54.497520 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.497473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:54.497750 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:54.497603    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:54.497750 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:54.497618    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:52:54.497750 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:54.497642    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55765594d7-lvk9t: secret "image-registry-tls" not found
Jul 12 21:52:54.497750 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:54.497652    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls podName:cf6dc6fc-df9e-4b92-92cf-902dc183e1c2 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:55.497639729 +0000 UTC m=+39.126470780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls") pod "dns-default-b69bm" (UID: "cf6dc6fc-df9e-4b92-92cf-902dc183e1c2") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:54.497750 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:54.497701    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls podName:ccce646e-7763-47ec-ac9f-ca3c28a2ac70 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:55.497684207 +0000 UTC m=+39.126515272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls") pod "image-registry-55765594d7-lvk9t" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70") : secret "image-registry-tls" not found
Jul 12 21:52:54.932744 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.932707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:52:54.932744 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.932721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:52:54.932991 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.932721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:52:54.938915 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.938889    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 21:52:54.939096 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.938958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j98hn\""
Jul 12 21:52:54.939096 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.939007    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 21:52:54.940093 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.940069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 21:52:54.940383 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.940364    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4x2vl\""
Jul 12 21:52:54.940589 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:54.940566    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 21:52:55.186317 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:55.186222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmpjn" event={"ID":"1c71fae0-a8c3-4c04-a49f-0b4a421b3956","Type":"ContainerStarted","Data":"54b0bd1c5468f8741b7b849ff5d8b09442c57123ba9a9606df399444d7ba75e5"}
Jul 12 21:52:55.189896 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:55.189867    2579 generic.go:356] "Generic (PLEG): container finished" podID="05b59596-e593-4834-a61d-a79e87f1aa80" containerID="a68a370f64c8b8df1f0e43ce27ae2da4a389a9a84416fcaa61f40475821f50dc" exitCode=0
Jul 12 21:52:55.190002 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:55.189920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerDied","Data":"a68a370f64c8b8df1f0e43ce27ae2da4a389a9a84416fcaa61f40475821f50dc"}
Jul 12 21:52:55.508134 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:55.507869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:55.508134 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:55.508081    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:52:55.508134 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:55.508104    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55765594d7-lvk9t: secret "image-registry-tls" not found
Jul 12 21:52:55.508134 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:55.508106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:55.508503 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:55.508170    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls podName:ccce646e-7763-47ec-ac9f-ca3c28a2ac70 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:57.50814776 +0000 UTC m=+41.136978833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls") pod "image-registry-55765594d7-lvk9t" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70") : secret "image-registry-tls" not found
Jul 12 21:52:55.508503 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:55.508199    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:55.508503 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:55.508240    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls podName:cf6dc6fc-df9e-4b92-92cf-902dc183e1c2 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:57.508227104 +0000 UTC m=+41.137058172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls") pod "dns-default-b69bm" (UID: "cf6dc6fc-df9e-4b92-92cf-902dc183e1c2") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:56.196620 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:56.196580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" event={"ID":"05b59596-e593-4834-a61d-a79e87f1aa80","Type":"ContainerStarted","Data":"9dfa4baad86bfc1467c2db9222b61bd10659cdae256f6797ee78f1fd50098a2b"}
Jul 12 21:52:56.233940 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:56.233881    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qc7h2" podStartSLOduration=8.298205613 podStartE2EDuration="39.23385893s" totalImagesPullingTime="30.935653317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:56.233770498 +0000 UTC m=+39.862601577" watchObservedRunningTime="2026-07-12 21:52:56.23385893 +0000 UTC m=+39.862689998"
Jul 12 21:52:57.527212 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:57.527114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:52:57.527212 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:57.527162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:52:57.527877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:57.527258    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:57.527877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:57.527265    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:52:57.527877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:57.527285    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55765594d7-lvk9t: secret "image-registry-tls" not found
Jul 12 21:52:57.527877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:57.527311    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls podName:cf6dc6fc-df9e-4b92-92cf-902dc183e1c2 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:01.527297148 +0000 UTC m=+45.156128200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls") pod "dns-default-b69bm" (UID: "cf6dc6fc-df9e-4b92-92cf-902dc183e1c2") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:57.527877 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:52:57.527337    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls podName:ccce646e-7763-47ec-ac9f-ca3c28a2ac70 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:01.527325085 +0000 UTC m=+45.156156166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls") pod "image-registry-55765594d7-lvk9t" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70") : secret "image-registry-tls" not found
Jul 12 21:52:58.202770 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:58.202737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmpjn" event={"ID":"1c71fae0-a8c3-4c04-a49f-0b4a421b3956","Type":"ContainerStarted","Data":"8d9fc77cdd509f7a14fd61b8e5b6840c432c54815053f4c051a034e8aeee87b5"}
Jul 12 21:52:58.221790 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:52:58.221740    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lmpjn" podStartSLOduration=2.34080753 podStartE2EDuration="5.221724827s" totalImagesPullingTime="2.880917297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:58.221177115 +0000 UTC m=+41.850008183" watchObservedRunningTime="2026-07-12 21:52:58.221724827 +0000 UTC m=+41.850555901"
Jul 12 21:53:01.560190 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:01.560145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:01.560650 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:01.560252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:01.560650 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:01.560317    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:53:01.560650 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:01.560339    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:01.560650 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:01.560349    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55765594d7-lvk9t: secret "image-registry-tls" not found
Jul 12 21:53:01.560650 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:01.560396    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls podName:ccce646e-7763-47ec-ac9f-ca3c28a2ac70 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.560383453 +0000 UTC m=+53.189214505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls") pod "image-registry-55765594d7-lvk9t" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70") : secret "image-registry-tls" not found
Jul 12 21:53:01.560650 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:01.560408    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls podName:cf6dc6fc-df9e-4b92-92cf-902dc183e1c2 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.560401899 +0000 UTC m=+53.189232951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls") pod "dns-default-b69bm" (UID: "cf6dc6fc-df9e-4b92-92cf-902dc183e1c2") : secret "dns-default-metrics-tls" not found
Jul 12 21:53:05.237517 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.237478    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"]
Jul 12 21:53:05.288207 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.288173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"]
Jul 12 21:53:05.288374 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.288292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.291113 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.291083    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 12 21:53:05.291113 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.291110    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.291303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.291083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 12 21:53:05.292217 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.292199    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.292317 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.292231    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-frx55\""
Jul 12 21:53:05.305264 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.305242    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"]
Jul 12 21:53:05.305363 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.305279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"]
Jul 12 21:53:05.305403 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.305362    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"
Jul 12 21:53:05.308889 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.308868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.308889 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.308884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-b27q5\""
Jul 12 21:53:05.309150 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.309137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.353206 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.353167    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-hj95z"]
Jul 12 21:53:05.377090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.377063    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-hj95z"]
Jul 12 21:53:05.377235 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.377159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.380189 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.380167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 12 21:53:05.380314 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.380189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-44qxl\""
Jul 12 21:53:05.380585 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.380545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 12 21:53:05.380693 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.380675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.380794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.380776    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.385541 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.385518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b6566c4-7598-444a-a807-65dda7e9d361-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.385659 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.385550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b6566c4-7598-444a-a807-65dda7e9d361-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.385721 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.385656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctjxt\" (UniqueName: \"kubernetes.io/projected/2b6566c4-7598-444a-a807-65dda7e9d361-kube-api-access-ctjxt\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.385721 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.385694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv5np\" (UniqueName: \"kubernetes.io/projected/7ab3d4a9-bf31-4e07-9b02-8be3263fc554-kube-api-access-jv5np\") pod \"volume-data-source-validator-78495597f6-5fkvz\" (UID: \"7ab3d4a9-bf31-4e07-9b02-8be3263fc554\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"
Jul 12 21:53:05.386356 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.386340    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 12 21:53:05.486644 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-trusted-ca\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.486816 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b6566c4-7598-444a-a807-65dda7e9d361-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.486816 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b6566c4-7598-444a-a807-65dda7e9d361-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.486949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9w86\" (UniqueName: \"kubernetes.io/projected/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-kube-api-access-l9w86\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.486949 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-serving-cert\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.487090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctjxt\" (UniqueName: \"kubernetes.io/projected/2b6566c4-7598-444a-a807-65dda7e9d361-kube-api-access-ctjxt\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.487090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.486990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv5np\" (UniqueName: \"kubernetes.io/projected/7ab3d4a9-bf31-4e07-9b02-8be3263fc554-kube-api-access-jv5np\") pod \"volume-data-source-validator-78495597f6-5fkvz\" (UID: \"7ab3d4a9-bf31-4e07-9b02-8be3263fc554\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"
Jul 12 21:53:05.487090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.487008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-config\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.487337 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.487315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b6566c4-7598-444a-a807-65dda7e9d361-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.490675 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.490629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b6566c4-7598-444a-a807-65dda7e9d361-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.497486 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.497456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctjxt\" (UniqueName: \"kubernetes.io/projected/2b6566c4-7598-444a-a807-65dda7e9d361-kube-api-access-ctjxt\") pod \"kube-storage-version-migrator-operator-799cb7f958-xtkmz\" (UID: \"2b6566c4-7598-444a-a807-65dda7e9d361\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.500223 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.500195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv5np\" (UniqueName: \"kubernetes.io/projected/7ab3d4a9-bf31-4e07-9b02-8be3263fc554-kube-api-access-jv5np\") pod \"volume-data-source-validator-78495597f6-5fkvz\" (UID: \"7ab3d4a9-bf31-4e07-9b02-8be3263fc554\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"
Jul 12 21:53:05.588330 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.588289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-trusted-ca\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.588505 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.588372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9w86\" (UniqueName: \"kubernetes.io/projected/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-kube-api-access-l9w86\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.588505 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.588397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-serving-cert\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.588505 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.588432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-config\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.589080 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.589057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-config\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.589236 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.589219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-trusted-ca\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.590923 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.590902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-serving-cert\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.597160 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.597131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"
Jul 12 21:53:05.599851 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.599807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9w86\" (UniqueName: \"kubernetes.io/projected/d707e5bb-844b-4e0d-bde0-83f3bb6a003d-kube-api-access-l9w86\") pod \"console-operator-7866497494-hj95z\" (UID: \"d707e5bb-844b-4e0d-bde0-83f3bb6a003d\") " pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.613496 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.613476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"
Jul 12 21:53:05.686874 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.686548    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:05.784161 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.784125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz"]
Jul 12 21:53:05.787546 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:05.787521    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6566c4_7598_444a_a807_65dda7e9d361.slice/crio-4d951da658f0d9334502cb4b71a553d3f70631adc14b345024c6e29cdd6cd16c WatchSource:0}: Error finding container 4d951da658f0d9334502cb4b71a553d3f70631adc14b345024c6e29cdd6cd16c: Status 404 returned error can't find the container with id 4d951da658f0d9334502cb4b71a553d3f70631adc14b345024c6e29cdd6cd16c
Jul 12 21:53:05.797872 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.797850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz"]
Jul 12 21:53:05.800875 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:05.800832    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab3d4a9_bf31_4e07_9b02_8be3263fc554.slice/crio-601ad0505053889f0ff02b598745120c376d8a31e28bfb55f5e168391818b216 WatchSource:0}: Error finding container 601ad0505053889f0ff02b598745120c376d8a31e28bfb55f5e168391818b216: Status 404 returned error can't find the container with id 601ad0505053889f0ff02b598745120c376d8a31e28bfb55f5e168391818b216
Jul 12 21:53:05.850345 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:05.850316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-hj95z"]
Jul 12 21:53:05.853283 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:05.853250    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd707e5bb_844b_4e0d_bde0_83f3bb6a003d.slice/crio-6ad6cbb03d969ec0ac311d5d22d2cf8992c024a438830ca1874d206cd9cfad75 WatchSource:0}: Error finding container 6ad6cbb03d969ec0ac311d5d22d2cf8992c024a438830ca1874d206cd9cfad75: Status 404 returned error can't find the container with id 6ad6cbb03d969ec0ac311d5d22d2cf8992c024a438830ca1874d206cd9cfad75
Jul 12 21:53:06.222219 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.222182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz" event={"ID":"7ab3d4a9-bf31-4e07-9b02-8be3263fc554","Type":"ContainerStarted","Data":"601ad0505053889f0ff02b598745120c376d8a31e28bfb55f5e168391818b216"}
Jul 12 21:53:06.223307 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.223282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hj95z" event={"ID":"d707e5bb-844b-4e0d-bde0-83f3bb6a003d","Type":"ContainerStarted","Data":"6ad6cbb03d969ec0ac311d5d22d2cf8992c024a438830ca1874d206cd9cfad75"}
Jul 12 21:53:06.224311 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.224291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz" event={"ID":"2b6566c4-7598-444a-a807-65dda7e9d361","Type":"ContainerStarted","Data":"4d951da658f0d9334502cb4b71a553d3f70631adc14b345024c6e29cdd6cd16c"}
Jul 12 21:53:06.836870 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.836838    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"]
Jul 12 21:53:06.838871 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.838849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"
Jul 12 21:53:06.842051 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.842008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mchdt\""
Jul 12 21:53:06.850770 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.850741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"]
Jul 12 21:53:06.901386 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:06.901346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qpk\" (UniqueName: \"kubernetes.io/projected/0b1b6786-597c-4e36-82e1-41468ab49319-kube-api-access-68qpk\") pod \"network-check-source-869dcfcdcd-6qq5j\" (UID: \"0b1b6786-597c-4e36-82e1-41468ab49319\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"
Jul 12 21:53:07.002434 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:07.002378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qpk\" (UniqueName: \"kubernetes.io/projected/0b1b6786-597c-4e36-82e1-41468ab49319-kube-api-access-68qpk\") pod \"network-check-source-869dcfcdcd-6qq5j\" (UID: \"0b1b6786-597c-4e36-82e1-41468ab49319\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"
Jul 12 21:53:07.020933 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:07.020891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qpk\" (UniqueName: \"kubernetes.io/projected/0b1b6786-597c-4e36-82e1-41468ab49319-kube-api-access-68qpk\") pod \"network-check-source-869dcfcdcd-6qq5j\" (UID: \"0b1b6786-597c-4e36-82e1-41468ab49319\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"
Jul 12 21:53:07.153884 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:07.153712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"
Jul 12 21:53:07.229551 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:07.229515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz" event={"ID":"7ab3d4a9-bf31-4e07-9b02-8be3263fc554","Type":"ContainerStarted","Data":"11b0aae622b261d968db9c3760505abe6dde03c319aa626b262314c929295beb"}
Jul 12 21:53:07.254062 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:07.251558    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-5fkvz" podStartSLOduration=0.975529155 podStartE2EDuration="2.251536542s" totalImagesPullingTime="1.276007387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:07.251203041 +0000 UTC m=+50.880034114" watchObservedRunningTime="2026-07-12 21:53:07.251536542 +0000 UTC m=+50.880367615"
Jul 12 21:53:07.302446 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:07.302403    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j"]
Jul 12 21:53:07.809788 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:07.809749    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1b6786_597c_4e36_82e1_41468ab49319.slice/crio-7f243275c2e0dcaa5095531ea1ce1c45a1c912c982026e4b22f6e95bbc59c32c WatchSource:0}: Error finding container 7f243275c2e0dcaa5095531ea1ce1c45a1c912c982026e4b22f6e95bbc59c32c: Status 404 returned error can't find the container with id 7f243275c2e0dcaa5095531ea1ce1c45a1c912c982026e4b22f6e95bbc59c32c
Jul 12 21:53:08.234204 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:08.234104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j" event={"ID":"0b1b6786-597c-4e36-82e1-41468ab49319","Type":"ContainerStarted","Data":"7f243275c2e0dcaa5095531ea1ce1c45a1c912c982026e4b22f6e95bbc59c32c"}
Jul 12 21:53:09.239040 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.239002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/0.log"
Jul 12 21:53:09.239477 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.239063    2579 generic.go:356] "Generic (PLEG): container finished" podID="d707e5bb-844b-4e0d-bde0-83f3bb6a003d" containerID="99af2fecc896d1930b30f4bbbc61e3e87cfef9101ccc3965091d6316a6e91eed" exitCode=255
Jul 12 21:53:09.239477 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.239156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hj95z" event={"ID":"d707e5bb-844b-4e0d-bde0-83f3bb6a003d","Type":"ContainerDied","Data":"99af2fecc896d1930b30f4bbbc61e3e87cfef9101ccc3965091d6316a6e91eed"}
Jul 12 21:53:09.239477 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.239353    2579 scope.go:117] "RemoveContainer" containerID="99af2fecc896d1930b30f4bbbc61e3e87cfef9101ccc3965091d6316a6e91eed"
Jul 12 21:53:09.241335 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.241313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz" event={"ID":"2b6566c4-7598-444a-a807-65dda7e9d361","Type":"ContainerStarted","Data":"8cdcca97f46d64601125ef245a7bfa6ba3d6394b746732294af354f78b60408a"}
Jul 12 21:53:09.273567 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.273510    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz" podStartSLOduration=1.768779718 podStartE2EDuration="4.273485436s" totalImagesPullingTime="2.504705718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:09.272562509 +0000 UTC m=+52.901393584" watchObservedRunningTime="2026-07-12 21:53:09.273485436 +0000 UTC m=+52.902316511"
Jul 12 21:53:09.626480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.626448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:09.626722 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.626568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:09.626722 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:09.626608    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:53:09.626722 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:09.626655    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:09.626722 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:09.626668    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55765594d7-lvk9t: secret "image-registry-tls" not found
Jul 12 21:53:09.626722 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:09.626677    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls podName:cf6dc6fc-df9e-4b92-92cf-902dc183e1c2 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:25.626655878 +0000 UTC m=+69.255486949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls") pod "dns-default-b69bm" (UID: "cf6dc6fc-df9e-4b92-92cf-902dc183e1c2") : secret "dns-default-metrics-tls" not found
Jul 12 21:53:09.626722 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:09.626699    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls podName:ccce646e-7763-47ec-ac9f-ca3c28a2ac70 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:25.626689992 +0000 UTC m=+69.255521045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls") pod "image-registry-55765594d7-lvk9t" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70") : secret "image-registry-tls" not found
Jul 12 21:53:09.967525 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.967440    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w2t94"]
Jul 12 21:53:09.970600 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.970574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:09.973965 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.973938    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 21:53:09.974152 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.974129    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 21:53:09.975645 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.975394    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 21:53:09.975645 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.975416    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 21:53:09.975645 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.975419    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwml9\""
Jul 12 21:53:09.990622 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:09.990598    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w2t94"]
Jul 12 21:53:10.029369 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.029332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.029549 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.029397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.029549 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.029422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85aea58e-c10b-4c62-b5c6-db20eab459d5-data-volume\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.029549 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.029464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85aea58e-c10b-4c62-b5c6-db20eab459d5-crio-socket\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.029549 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.029493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6stk6\" (UniqueName: \"kubernetes.io/projected/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-api-access-6stk6\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.130680 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.130636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85aea58e-c10b-4c62-b5c6-db20eab459d5-data-volume\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.130857 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.130701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85aea58e-c10b-4c62-b5c6-db20eab459d5-crio-socket\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.130907 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.130872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/85aea58e-c10b-4c62-b5c6-db20eab459d5-crio-socket\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.130938 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.130915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6stk6\" (UniqueName: \"kubernetes.io/projected/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-api-access-6stk6\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.131055 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.131005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.131055 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.131040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/85aea58e-c10b-4c62-b5c6-db20eab459d5-data-volume\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.131238 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.131098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.131238 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.131135    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.131238 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.131175    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.131238 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.131181    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:10.631168347 +0000 UTC m=+54.259999399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.131238 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.131221    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:10.631209049 +0000 UTC m=+54.260040104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.145129 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.145092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6stk6\" (UniqueName: \"kubernetes.io/projected/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-api-access-6stk6\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.246977 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.246895    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 21:53:10.247442 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.247424    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/0.log"
Jul 12 21:53:10.247509 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.247463    2579 generic.go:356] "Generic (PLEG): container finished" podID="d707e5bb-844b-4e0d-bde0-83f3bb6a003d" containerID="8de6763ae073baf67c8f649b5a6721a9964b9d31178bb47064f846a5060dd381" exitCode=255
Jul 12 21:53:10.247567 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.247549    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hj95z" event={"ID":"d707e5bb-844b-4e0d-bde0-83f3bb6a003d","Type":"ContainerDied","Data":"8de6763ae073baf67c8f649b5a6721a9964b9d31178bb47064f846a5060dd381"}
Jul 12 21:53:10.247616 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.247604    2579 scope.go:117] "RemoveContainer" containerID="99af2fecc896d1930b30f4bbbc61e3e87cfef9101ccc3965091d6316a6e91eed"
Jul 12 21:53:10.247825 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.247800    2579 scope.go:117] "RemoveContainer" containerID="8de6763ae073baf67c8f649b5a6721a9964b9d31178bb47064f846a5060dd381"
Jul 12 21:53:10.248079 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.248013    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hj95z_openshift-console-operator(d707e5bb-844b-4e0d-bde0-83f3bb6a003d)\"" pod="openshift-console-operator/console-operator-7866497494-hj95z" podUID="d707e5bb-844b-4e0d-bde0-83f3bb6a003d"
Jul 12 21:53:10.635471 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.635431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.635671 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:10.635493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:10.635671 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.635597    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.635671 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.635600    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.635671 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.635652    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:11.635637687 +0000 UTC m=+55.264468739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.635671 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:10.635672    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:11.635662611 +0000 UTC m=+55.264493680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:11.252270 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.252189    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 21:53:11.252798 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.252554    2579 scope.go:117] "RemoveContainer" containerID="8de6763ae073baf67c8f649b5a6721a9964b9d31178bb47064f846a5060dd381"
Jul 12 21:53:11.252798 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:11.252740    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hj95z_openshift-console-operator(d707e5bb-844b-4e0d-bde0-83f3bb6a003d)\"" pod="openshift-console-operator/console-operator-7866497494-hj95z" podUID="d707e5bb-844b-4e0d-bde0-83f3bb6a003d"
Jul 12 21:53:11.253864 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.253840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j" event={"ID":"0b1b6786-597c-4e36-82e1-41468ab49319","Type":"ContainerStarted","Data":"64c0b64fe5aa3fc4c1ff20dd59b770c5e2fbc9bd536e3045c81a37164b1d399f"}
Jul 12 21:53:11.288944 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.288883    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6qq5j" podStartSLOduration=2.237422388 podStartE2EDuration="5.288863403s" totalImagesPullingTime="3.051441015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:11.28837204 +0000 UTC m=+54.917203116" watchObservedRunningTime="2026-07-12 21:53:11.288863403 +0000 UTC m=+54.917694478"
Jul 12 21:53:11.645965 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.645924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:11.646193 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.645996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:11.646193 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:11.646116    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:11.646193 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:11.646191    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.646175213 +0000 UTC m=+57.275006287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:11.646305 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:11.646116    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:11.646305 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:11.646275    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.6462612 +0000 UTC m=+57.275092252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:11.943341 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:11.943260    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jxj5m_5e72d54d-f9a5-4461-aa9e-ce5215d65399/dns-node-resolver/0.log"
Jul 12 21:53:12.741190 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:12.741160    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2srjq_3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5/node-ca/0.log"
Jul 12 21:53:13.544071 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:13.544011    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmpjn_1c71fae0-a8c3-4c04-a49f-0b4a421b3956/serve-healthcheck-canary/0.log"
Jul 12 21:53:13.664492 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:13.664451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:13.664620 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:13.664514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:13.664659 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:13.664620    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:13.664659 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:13.664621    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:13.664720 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:13.664689    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:17.664670956 +0000 UTC m=+61.293502026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:13.664720 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:13.664709    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:17.664700602 +0000 UTC m=+61.293531667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:15.687094 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:15.687062    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:15.687456 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:15.687122    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:15.687456 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:15.687433    2579 scope.go:117] "RemoveContainer" containerID="8de6763ae073baf67c8f649b5a6721a9964b9d31178bb47064f846a5060dd381"
Jul 12 21:53:15.687592 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:15.687573    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hj95z_openshift-console-operator(d707e5bb-844b-4e0d-bde0-83f3bb6a003d)\"" pod="openshift-console-operator/console-operator-7866497494-hj95z" podUID="d707e5bb-844b-4e0d-bde0-83f3bb6a003d"
Jul 12 21:53:17.701621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:17.701573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:17.702052 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:17.701640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:17.702052 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:17.701740    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:17.702052 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:17.701776    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:17.702052 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:17.701816    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:25.701800559 +0000 UTC m=+69.330631611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:17.702052 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:17.701832    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:25.701824867 +0000 UTC m=+69.330655919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:20.179980 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:20.179948    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lsjgt"
Jul 12 21:53:22.649740 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.649694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:53:22.650195 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.649787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:53:22.652520 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.652501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djg4c\" (UniqueName: \"kubernetes.io/projected/1be16b4d-97bc-49f0-9171-6f7b1d4c4cae-kube-api-access-djg4c\") pod \"network-check-target-85z9x\" (UID: \"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae\") " pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:53:22.652863 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.652835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 21:53:22.660464 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:22.660440    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 12 21:53:22.660565 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:22.660513    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs podName:b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8 nodeName:}" failed. No retries permitted until 2026-07-12 21:54:26.66049755 +0000 UTC m=+130.289328602 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs") pod "network-metrics-daemon-z8wtc" (UID: "b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8") : secret "metrics-daemon-secret" not found
Jul 12 21:53:22.750627 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.750589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:53:22.753739 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.753712    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 21:53:22.763805 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.763783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca2f5b3-4c05-41b3-bab7-b173c7483852-original-pull-secret\") pod \"global-pull-secret-syncer-58565\" (UID: \"5ca2f5b3-4c05-41b3-bab7-b173c7483852\") " pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:53:22.849703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.849665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j98hn\""
Jul 12 21:53:22.854059 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.854040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58565"
Jul 12 21:53:22.856186 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.856165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:53:22.995364 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:22.995322    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-85z9x"]
Jul 12 21:53:22.998074 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:22.998048    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be16b4d_97bc_49f0_9171_6f7b1d4c4cae.slice/crio-43447ba38be9cd0b796d00e2f3d3732dd48cfe4e569644b4b049ad1bb7e8cad1 WatchSource:0}: Error finding container 43447ba38be9cd0b796d00e2f3d3732dd48cfe4e569644b4b049ad1bb7e8cad1: Status 404 returned error can't find the container with id 43447ba38be9cd0b796d00e2f3d3732dd48cfe4e569644b4b049ad1bb7e8cad1
Jul 12 21:53:23.010723 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:23.010695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58565"]
Jul 12 21:53:23.014311 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:23.014288    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca2f5b3_4c05_41b3_bab7_b173c7483852.slice/crio-7984e07f801228f27b7b837bc64be38ba0e3706fec3b94ff2697c23fd4509100 WatchSource:0}: Error finding container 7984e07f801228f27b7b837bc64be38ba0e3706fec3b94ff2697c23fd4509100: Status 404 returned error can't find the container with id 7984e07f801228f27b7b837bc64be38ba0e3706fec3b94ff2697c23fd4509100
Jul 12 21:53:23.290520 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:23.290484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58565" event={"ID":"5ca2f5b3-4c05-41b3-bab7-b173c7483852","Type":"ContainerStarted","Data":"7984e07f801228f27b7b837bc64be38ba0e3706fec3b94ff2697c23fd4509100"}
Jul 12 21:53:23.295756 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:23.295725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85z9x" event={"ID":"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae","Type":"ContainerStarted","Data":"dca96dabbda9f4f75bfd716a3ef453a1ec1638d2efc1bee11a800d5639b2bd09"}
Jul 12 21:53:23.295875 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:23.295799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-85z9x" event={"ID":"1be16b4d-97bc-49f0-9171-6f7b1d4c4cae","Type":"ContainerStarted","Data":"43447ba38be9cd0b796d00e2f3d3732dd48cfe4e569644b4b049ad1bb7e8cad1"}
Jul 12 21:53:23.295875 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:23.295838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:53:23.315874 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:23.315827    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-85z9x" podStartSLOduration=66.315812118 podStartE2EDuration="1m6.315812118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:23.314586317 +0000 UTC m=+66.943417390" watchObservedRunningTime="2026-07-12 21:53:23.315812118 +0000 UTC m=+66.944643191"
Jul 12 21:53:25.674586 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.674546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:25.675008 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.674601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:25.677384 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.677355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf6dc6fc-df9e-4b92-92cf-902dc183e1c2-metrics-tls\") pod \"dns-default-b69bm\" (UID: \"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2\") " pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:25.678033 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.677995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"image-registry-55765594d7-lvk9t\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") " pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:25.775672 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.775635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:25.775889 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.775689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:25.775889 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:25.775808    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:25.775889 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:53:25.775883    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls podName:85aea58e-c10b-4c62-b5c6-db20eab459d5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:41.775861771 +0000 UTC m=+85.404692841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w2t94" (UID: "85aea58e-c10b-4c62-b5c6-db20eab459d5") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:25.776307 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.776289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/85aea58e-c10b-4c62-b5c6-db20eab459d5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:25.860214 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.860180    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jvnd\""
Jul 12 21:53:25.867438 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.867407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:25.904311 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.904276    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6dkr4\""
Jul 12 21:53:25.911881 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:25.911848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:26.934220 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:26.934186    2579 scope.go:117] "RemoveContainer" containerID="8de6763ae073baf67c8f649b5a6721a9964b9d31178bb47064f846a5060dd381"
Jul 12 21:53:27.239989 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.239934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b69bm"]
Jul 12 21:53:27.243682 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:27.243658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6dc6fc_df9e_4b92_92cf_902dc183e1c2.slice/crio-1ed76c6ca1a43d053aaaeae4c39d10f8ea9b7e0d1c91ff43d888c67ab5f412a6 WatchSource:0}: Error finding container 1ed76c6ca1a43d053aaaeae4c39d10f8ea9b7e0d1c91ff43d888c67ab5f412a6: Status 404 returned error can't find the container with id 1ed76c6ca1a43d053aaaeae4c39d10f8ea9b7e0d1c91ff43d888c67ab5f412a6
Jul 12 21:53:27.257487 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.257372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55765594d7-lvk9t"]
Jul 12 21:53:27.260563 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:27.260540    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccce646e_7763_47ec_ac9f_ca3c28a2ac70.slice/crio-48dd61c5e88352f018a9d3557097834998dd807c55e00c826493f77639da520a WatchSource:0}: Error finding container 48dd61c5e88352f018a9d3557097834998dd807c55e00c826493f77639da520a: Status 404 returned error can't find the container with id 48dd61c5e88352f018a9d3557097834998dd807c55e00c826493f77639da520a
Jul 12 21:53:27.322550 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.322525    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 21:53:27.322702 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.322643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hj95z" event={"ID":"d707e5bb-844b-4e0d-bde0-83f3bb6a003d","Type":"ContainerStarted","Data":"e1a37c8c51e316c2863d3f3abb5354d678af0ce6f01c7f351d285ebeb6d5b554"}
Jul 12 21:53:27.323094 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.322985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:27.324703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.324670    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58565" event={"ID":"5ca2f5b3-4c05-41b3-bab7-b173c7483852","Type":"ContainerStarted","Data":"92a24070aa777ac3d2a2a6164eb66ff77491698bae6c15b041b092991f9be5a3"}
Jul 12 21:53:27.326490 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.326465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55765594d7-lvk9t" event={"ID":"ccce646e-7763-47ec-ac9f-ca3c28a2ac70","Type":"ContainerStarted","Data":"48dd61c5e88352f018a9d3557097834998dd807c55e00c826493f77639da520a"}
Jul 12 21:53:27.327664 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.327613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b69bm" event={"ID":"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2","Type":"ContainerStarted","Data":"1ed76c6ca1a43d053aaaeae4c39d10f8ea9b7e0d1c91ff43d888c67ab5f412a6"}
Jul 12 21:53:27.345455 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.345396    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-hj95z" podStartSLOduration=19.907718986 podStartE2EDuration="22.345376683s" totalImagesPullingTime="2.437657697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:27.344572329 +0000 UTC m=+70.973403407" watchObservedRunningTime="2026-07-12 21:53:27.345376683 +0000 UTC m=+70.974207739"
Jul 12 21:53:27.758467 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.758438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-hj95z"
Jul 12 21:53:27.780790 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:27.779896    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-58565" podStartSLOduration=66.678146218 podStartE2EDuration="1m10.779871661s" totalImagesPullingTime="4.101725443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:27.369906411 +0000 UTC m=+70.998737485" watchObservedRunningTime="2026-07-12 21:53:27.779871661 +0000 UTC m=+71.408702736"
Jul 12 21:53:28.333433 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:28.333395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55765594d7-lvk9t" event={"ID":"ccce646e-7763-47ec-ac9f-ca3c28a2ac70","Type":"ContainerStarted","Data":"1b1901bb3904bf44e538fde66a8d3c8c7081bd3aab90a95192d346a947f77275"}
Jul 12 21:53:28.359924 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:28.359874    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55765594d7-lvk9t" podStartSLOduration=71.359855959 podStartE2EDuration="1m11.359855959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:28.358446595 +0000 UTC m=+71.987277671" watchObservedRunningTime="2026-07-12 21:53:28.359855959 +0000 UTC m=+71.988687033"
Jul 12 21:53:29.338395 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:29.338354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b69bm" event={"ID":"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2","Type":"ContainerStarted","Data":"1eead9d6e3955d981dfca5dd503e84794f6867c5cfa962fe202e512c59c5f909"}
Jul 12 21:53:29.338877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:29.338421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b69bm" event={"ID":"cf6dc6fc-df9e-4b92-92cf-902dc183e1c2","Type":"ContainerStarted","Data":"2a2b96c29a0e6eea92e494074b688b3f242220acb70328c50747081457394334"}
Jul 12 21:53:29.338877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:29.338671    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:29.338877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:29.338721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:29.362816 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:29.362762    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b69bm" podStartSLOduration=34.74297856 podStartE2EDuration="36.36274532s" totalImagesPullingTime="1.61976676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:29.362303512 +0000 UTC m=+72.991134585" watchObservedRunningTime="2026-07-12 21:53:29.36274532 +0000 UTC m=+72.991576435"
Jul 12 21:53:35.757203 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.757168    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"]
Jul 12 21:53:35.760263 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.760245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:35.763007 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.762973    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 12 21:53:35.764189 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.764168    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 12 21:53:35.764263 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.764189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pphvt\""
Jul 12 21:53:35.771419 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.771398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"]
Jul 12 21:53:35.858505 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.858471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00961634-d346-4f7a-8cfd-11c84abbd005-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9lcg5\" (UID: \"00961634-d346-4f7a-8cfd-11c84abbd005\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:35.858678 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.858542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/00961634-d346-4f7a-8cfd-11c84abbd005-nginx-conf\") pod \"networking-console-plugin-6cf856758c-9lcg5\" (UID: \"00961634-d346-4f7a-8cfd-11c84abbd005\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:35.959500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.959465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00961634-d346-4f7a-8cfd-11c84abbd005-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9lcg5\" (UID: \"00961634-d346-4f7a-8cfd-11c84abbd005\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:35.959661 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.959527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/00961634-d346-4f7a-8cfd-11c84abbd005-nginx-conf\") pod \"networking-console-plugin-6cf856758c-9lcg5\" (UID: \"00961634-d346-4f7a-8cfd-11c84abbd005\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:35.960194 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.960173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/00961634-d346-4f7a-8cfd-11c84abbd005-nginx-conf\") pod \"networking-console-plugin-6cf856758c-9lcg5\" (UID: \"00961634-d346-4f7a-8cfd-11c84abbd005\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:35.962155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:35.962128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00961634-d346-4f7a-8cfd-11c84abbd005-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9lcg5\" (UID: \"00961634-d346-4f7a-8cfd-11c84abbd005\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:36.068840 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:36.068808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"
Jul 12 21:53:36.198395 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:36.198365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-9lcg5"]
Jul 12 21:53:36.201185 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:36.201140    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00961634_d346_4f7a_8cfd_11c84abbd005.slice/crio-b0b2809c8d570ccfb6cce2f3f808ced07642f0cfbadabd3a63b30286e4d26d8c WatchSource:0}: Error finding container b0b2809c8d570ccfb6cce2f3f808ced07642f0cfbadabd3a63b30286e4d26d8c: Status 404 returned error can't find the container with id b0b2809c8d570ccfb6cce2f3f808ced07642f0cfbadabd3a63b30286e4d26d8c
Jul 12 21:53:36.363086 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:36.362985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5" event={"ID":"00961634-d346-4f7a-8cfd-11c84abbd005","Type":"ContainerStarted","Data":"b0b2809c8d570ccfb6cce2f3f808ced07642f0cfbadabd3a63b30286e4d26d8c"}
Jul 12 21:53:38.371583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:38.371549    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5" event={"ID":"00961634-d346-4f7a-8cfd-11c84abbd005","Type":"ContainerStarted","Data":"dbf845db1b71d2c1f3833a1ce33913d1825c603335514c9ba5e592ce2729fd94"}
Jul 12 21:53:38.389812 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:38.389745    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-9lcg5" podStartSLOduration=2.269555499 podStartE2EDuration="3.38972901s" totalImagesPullingTime="1.120173511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:38.388832234 +0000 UTC m=+82.017663298" watchObservedRunningTime="2026-07-12 21:53:38.38972901 +0000 UTC m=+82.018560083"
Jul 12 21:53:39.346897 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:39.346869    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b69bm"
Jul 12 21:53:41.803466 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:41.803422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:41.805925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:41.805890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/85aea58e-c10b-4c62-b5c6-db20eab459d5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w2t94\" (UID: \"85aea58e-c10b-4c62-b5c6-db20eab459d5\") " pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:42.084748 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.084665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwml9\""
Jul 12 21:53:42.092058 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.092038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w2t94"
Jul 12 21:53:42.252972 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.252937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w2t94"]
Jul 12 21:53:42.256412 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:42.256384    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85aea58e_c10b_4c62_b5c6_db20eab459d5.slice/crio-d838121ecbcd6dedcfc7320644c4e072fa400b61254d261269eb0ade82e544d0 WatchSource:0}: Error finding container d838121ecbcd6dedcfc7320644c4e072fa400b61254d261269eb0ade82e544d0: Status 404 returned error can't find the container with id d838121ecbcd6dedcfc7320644c4e072fa400b61254d261269eb0ade82e544d0
Jul 12 21:53:42.260582 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.260560    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5946969795-kwt4l"]
Jul 12 21:53:42.281395 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.281366    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5946969795-kwt4l"]
Jul 12 21:53:42.281531 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.281464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.284900 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.284879    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 12 21:53:42.285072 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.284993    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gtz7b\""
Jul 12 21:53:42.285072 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.285048    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 12 21:53:42.285225 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.285206    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 12 21:53:42.285601 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.285581    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 12 21:53:42.285601 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.285600    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 12 21:53:42.285772 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.285673    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 12 21:53:42.286110 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.286093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 12 21:53:42.386521 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.386438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2t94" event={"ID":"85aea58e-c10b-4c62-b5c6-db20eab459d5","Type":"ContainerStarted","Data":"d838121ecbcd6dedcfc7320644c4e072fa400b61254d261269eb0ade82e544d0"}
Jul 12 21:53:42.410793 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.410759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-oauth-config\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.410793 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.410795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-service-ca\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.411009 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.410827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vktg5\" (UniqueName: \"kubernetes.io/projected/171b2f39-50cd-464a-87f7-84d20d936f8c-kube-api-access-vktg5\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.411009 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.410880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-serving-cert\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.411009 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.410924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-console-config\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.411009 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.410964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-oauth-serving-cert\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.512298 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.512266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-service-ca\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.512457 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.512307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vktg5\" (UniqueName: \"kubernetes.io/projected/171b2f39-50cd-464a-87f7-84d20d936f8c-kube-api-access-vktg5\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.512457 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.512366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-serving-cert\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.512457 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.512403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-console-config\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.512457 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.512445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-oauth-serving-cert\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.512657 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.512485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-oauth-config\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.513166 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.513128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-console-config\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.513303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.513283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-service-ca\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.513342 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.513283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-oauth-serving-cert\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.514869 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.514849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-oauth-config\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.515166 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.515149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-serving-cert\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.521815 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.521787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vktg5\" (UniqueName: \"kubernetes.io/projected/171b2f39-50cd-464a-87f7-84d20d936f8c-kube-api-access-vktg5\") pod \"console-5946969795-kwt4l\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") " pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.590795 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.590757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:42.773330 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:42.773248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5946969795-kwt4l"]
Jul 12 21:53:42.776871 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:42.776831    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171b2f39_50cd_464a_87f7_84d20d936f8c.slice/crio-4586dc593781d0cdb82b7937c584fe488ac69a0925f7a07cc4845e759e088ec8 WatchSource:0}: Error finding container 4586dc593781d0cdb82b7937c584fe488ac69a0925f7a07cc4845e759e088ec8: Status 404 returned error can't find the container with id 4586dc593781d0cdb82b7937c584fe488ac69a0925f7a07cc4845e759e088ec8
Jul 12 21:53:43.392581 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:43.392543    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5946969795-kwt4l" event={"ID":"171b2f39-50cd-464a-87f7-84d20d936f8c","Type":"ContainerStarted","Data":"4586dc593781d0cdb82b7937c584fe488ac69a0925f7a07cc4845e759e088ec8"}
Jul 12 21:53:45.781885 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.781849    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-95khp"]
Jul 12 21:53:45.785311 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.785286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:45.787940 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.787917    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 12 21:53:45.790371 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.790163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 21:53:45.790955 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.790618    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x5zmf\""
Jul 12 21:53:45.790955 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.790636    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 12 21:53:45.790955 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.790843    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 21:53:45.791218 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.791196    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 21:53:45.799807 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.799780    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-95khp"]
Jul 12 21:53:45.942861 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.942819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/232dc930-a0bb-4b00-a010-fcb4dbf1062c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:45.943062 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.942910    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knhs5\" (UniqueName: \"kubernetes.io/projected/232dc930-a0bb-4b00-a010-fcb4dbf1062c-kube-api-access-knhs5\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:45.943062 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.942949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/232dc930-a0bb-4b00-a010-fcb4dbf1062c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:45.943062 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:45.943051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/232dc930-a0bb-4b00-a010-fcb4dbf1062c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.044438 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.044358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/232dc930-a0bb-4b00-a010-fcb4dbf1062c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.044695 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.044439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/232dc930-a0bb-4b00-a010-fcb4dbf1062c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.044695 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.044478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knhs5\" (UniqueName: \"kubernetes.io/projected/232dc930-a0bb-4b00-a010-fcb4dbf1062c-kube-api-access-knhs5\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.044695 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.044498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/232dc930-a0bb-4b00-a010-fcb4dbf1062c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.045689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.045617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/232dc930-a0bb-4b00-a010-fcb4dbf1062c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.051260 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.051234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/232dc930-a0bb-4b00-a010-fcb4dbf1062c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.051396 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.051378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/232dc930-a0bb-4b00-a010-fcb4dbf1062c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.053479 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.053456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knhs5\" (UniqueName: \"kubernetes.io/projected/232dc930-a0bb-4b00-a010-fcb4dbf1062c-kube-api-access-knhs5\") pod \"prometheus-operator-64785b6675-95khp\" (UID: \"232dc930-a0bb-4b00-a010-fcb4dbf1062c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:46.098302 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:46.098260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-95khp"
Jul 12 21:53:47.364458 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:47.364423    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-95khp"]
Jul 12 21:53:47.368173 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:47.368084    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232dc930_a0bb_4b00_a010_fcb4dbf1062c.slice/crio-2dcaa1faf14f2b953bf13839a4fa745fb40345d061ecb73d9907eace02580531 WatchSource:0}: Error finding container 2dcaa1faf14f2b953bf13839a4fa745fb40345d061ecb73d9907eace02580531: Status 404 returned error can't find the container with id 2dcaa1faf14f2b953bf13839a4fa745fb40345d061ecb73d9907eace02580531
Jul 12 21:53:47.409232 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:47.409197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5946969795-kwt4l" event={"ID":"171b2f39-50cd-464a-87f7-84d20d936f8c","Type":"ContainerStarted","Data":"79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc"}
Jul 12 21:53:47.410417 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:47.410389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-95khp" event={"ID":"232dc930-a0bb-4b00-a010-fcb4dbf1062c","Type":"ContainerStarted","Data":"2dcaa1faf14f2b953bf13839a4fa745fb40345d061ecb73d9907eace02580531"}
Jul 12 21:53:47.411663 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:47.411643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2t94" event={"ID":"85aea58e-c10b-4c62-b5c6-db20eab459d5","Type":"ContainerStarted","Data":"9a65505e22e8cc36d271acdfc00a96e7b9d956525020b30f14e54d8ccfaf5801"}
Jul 12 21:53:47.429038 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:47.428978    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5946969795-kwt4l" podStartSLOduration=0.986461004 podStartE2EDuration="5.428961105s" totalImagesPullingTime="4.442500101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:47.428308226 +0000 UTC m=+91.057139300" watchObservedRunningTime="2026-07-12 21:53:47.428961105 +0000 UTC m=+91.057792179"
Jul 12 21:53:48.418465 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:48.418427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2t94" event={"ID":"85aea58e-c10b-4c62-b5c6-db20eab459d5","Type":"ContainerStarted","Data":"bb82daa677e12e1c7aaca5645325a7c97322dde47ddc907943a715f7ad5a1c81"}
Jul 12 21:53:49.428456 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:49.428411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-95khp" event={"ID":"232dc930-a0bb-4b00-a010-fcb4dbf1062c","Type":"ContainerStarted","Data":"22fb3e86843c6174b78084f2f7f2b4779621b7aaa3c47018a608e247bd9cca69"}
Jul 12 21:53:49.428917 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:49.428507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-95khp" event={"ID":"232dc930-a0bb-4b00-a010-fcb4dbf1062c","Type":"ContainerStarted","Data":"7ec9f6d964e531cb7934c6e7ab03286cc0e3e4c6396856d6ef8f4e07ce0a57e2"}
Jul 12 21:53:49.449035 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:49.448983    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-95khp" podStartSLOduration=3.18364977 podStartE2EDuration="4.448968123s" totalImagesPullingTime="1.265318353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:49.448843253 +0000 UTC m=+93.077674326" watchObservedRunningTime="2026-07-12 21:53:49.448968123 +0000 UTC m=+93.077799220"
Jul 12 21:53:50.348372 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:50.348344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:53:51.217752 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.217672    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jd8cv"]
Jul 12 21:53:51.220853 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.220836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.223602 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.223582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 21:53:51.224106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.224067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 21:53:51.224106 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.224080    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f6vqh\""
Jul 12 21:53:51.224254 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.224106    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 21:53:51.283270 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283270 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-tls\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-accelerators-collector-config\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njlnt\" (UniqueName: \"kubernetes.io/projected/ca765b83-e579-433f-8f2d-19ae69ac6c16-kube-api-access-njlnt\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-sys\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-wtmp\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-textfile\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283480 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-root\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.283648 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.283487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca765b83-e579-433f-8f2d-19ae69ac6c16-metrics-client-ca\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384072 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-tls\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384261 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-accelerators-collector-config\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384261 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njlnt\" (UniqueName: \"kubernetes.io/projected/ca765b83-e579-433f-8f2d-19ae69ac6c16-kube-api-access-njlnt\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384261 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-sys\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384261 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-wtmp\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384261 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-sys\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-textfile\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-wtmp\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-root\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca765b83-e579-433f-8f2d-19ae69ac6c16-metrics-client-ca\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca765b83-e579-433f-8f2d-19ae69ac6c16-root\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384850 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-textfile\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384850 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-accelerators-collector-config\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.384850 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.384841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca765b83-e579-433f-8f2d-19ae69ac6c16-metrics-client-ca\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.386553 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.386536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-tls\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.386927 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.386907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca765b83-e579-433f-8f2d-19ae69ac6c16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.393943 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.393920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njlnt\" (UniqueName: \"kubernetes.io/projected/ca765b83-e579-433f-8f2d-19ae69ac6c16-kube-api-access-njlnt\") pod \"node-exporter-jd8cv\" (UID: \"ca765b83-e579-433f-8f2d-19ae69ac6c16\") " pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.438230 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.438198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w2t94" event={"ID":"85aea58e-c10b-4c62-b5c6-db20eab459d5","Type":"ContainerStarted","Data":"d5f6500d874b1e31c1d9f014d7464640fdb835f34d7a66f0bf442caf3e56cdce"}
Jul 12 21:53:51.461845 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.461786    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w2t94" podStartSLOduration=34.029061075 podStartE2EDuration="42.461770597s" totalImagesPullingTime="8.432709522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:53:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:51.461266214 +0000 UTC m=+95.090097287" watchObservedRunningTime="2026-07-12 21:53:51.461770597 +0000 UTC m=+95.090601671"
Jul 12 21:53:51.530592 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:51.530562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jd8cv"
Jul 12 21:53:51.542651 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:51.542612    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca765b83_e579_433f_8f2d_19ae69ac6c16.slice/crio-50d5acf1e5dd1c0effbdaf2d39cb7eb155fa9d36d8dac038ec7e6bd87d3fd944 WatchSource:0}: Error finding container 50d5acf1e5dd1c0effbdaf2d39cb7eb155fa9d36d8dac038ec7e6bd87d3fd944: Status 404 returned error can't find the container with id 50d5acf1e5dd1c0effbdaf2d39cb7eb155fa9d36d8dac038ec7e6bd87d3fd944
Jul 12 21:53:52.443752 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:52.443714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jd8cv" event={"ID":"ca765b83-e579-433f-8f2d-19ae69ac6c16","Type":"ContainerStarted","Data":"50d5acf1e5dd1c0effbdaf2d39cb7eb155fa9d36d8dac038ec7e6bd87d3fd944"}
Jul 12 21:53:52.591869 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:52.591839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:52.592042 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:52.591897    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:52.597005 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:52.596982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:53.449151 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:53.449102    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca765b83-e579-433f-8f2d-19ae69ac6c16" containerID="08ea642ed932601739a8c45b222b81aa607cbc54d60b36057e0cf78c5677b24f" exitCode=0
Jul 12 21:53:53.449617 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:53.449199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jd8cv" event={"ID":"ca765b83-e579-433f-8f2d-19ae69ac6c16","Type":"ContainerDied","Data":"08ea642ed932601739a8c45b222b81aa607cbc54d60b36057e0cf78c5677b24f"}
Jul 12 21:53:53.453315 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:53.453298    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:53:54.303730 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:54.303695    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-85z9x"
Jul 12 21:53:54.454788 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:54.454748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jd8cv" event={"ID":"ca765b83-e579-433f-8f2d-19ae69ac6c16","Type":"ContainerStarted","Data":"14ef0fd9790c49734228e50db6cbf99a78155966a761ce573d2bb615a26cab86"}
Jul 12 21:53:54.455183 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:54.454805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jd8cv" event={"ID":"ca765b83-e579-433f-8f2d-19ae69ac6c16","Type":"ContainerStarted","Data":"092de44b431f98f719a25f170d012e656d095b54b1bc1d8d0e7fc71685b6c342"}
Jul 12 21:53:54.480596 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:54.480543    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jd8cv" podStartSLOduration=2.533464086 podStartE2EDuration="3.480525244s" totalImagesPullingTime="874.082586ms" totalInitContainerRuntime="72.978572ms" isStatefulPod=true podCreationTimestamp="2026-07-12 21:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:54.479527849 +0000 UTC m=+98.108358924" watchObservedRunningTime="2026-07-12 21:53:54.480525244 +0000 UTC m=+98.109356317"
Jul 12 21:53:55.501576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.501542    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85b77b975b-nr46f"]
Jul 12 21:53:55.504870 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.504850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.508841 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.508819    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 12 21:53:55.508993 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.508850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 21:53:55.508993 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.508822    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rqncs\""
Jul 12 21:53:55.509263 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.509248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 12 21:53:55.509263 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.509261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7kdic32gr13ab\""
Jul 12 21:53:55.509693 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.509678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 12 21:53:55.515920 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.515900    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85b77b975b-nr46f"]
Jul 12 21:53:55.518840 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.518817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c33d530-3052-4e33-8f7d-51ec67d604e0-audit-log\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.518953 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.518858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-secret-metrics-server-tls\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.518953 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.518883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-client-ca-bundle\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.519085 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.518972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c33d530-3052-4e33-8f7d-51ec67d604e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.519085 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.519069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4sjp\" (UniqueName: \"kubernetes.io/projected/7c33d530-3052-4e33-8f7d-51ec67d604e0-kube-api-access-z4sjp\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.519180 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.519103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-secret-metrics-server-client-certs\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.519180 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.519159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c33d530-3052-4e33-8f7d-51ec67d604e0-metrics-server-audit-profiles\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-secret-metrics-server-tls\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620418 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-client-ca-bundle\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620652 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c33d530-3052-4e33-8f7d-51ec67d604e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620652 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4sjp\" (UniqueName: \"kubernetes.io/projected/7c33d530-3052-4e33-8f7d-51ec67d604e0-kube-api-access-z4sjp\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620652 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620522    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-secret-metrics-server-client-certs\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620652 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c33d530-3052-4e33-8f7d-51ec67d604e0-metrics-server-audit-profiles\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.620652 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c33d530-3052-4e33-8f7d-51ec67d604e0-audit-log\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.621045 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.620996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c33d530-3052-4e33-8f7d-51ec67d604e0-audit-log\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.621316 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.621296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c33d530-3052-4e33-8f7d-51ec67d604e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.621532 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.621511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c33d530-3052-4e33-8f7d-51ec67d604e0-metrics-server-audit-profiles\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.623080 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.623062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-secret-metrics-server-client-certs\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.623481 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.623463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-client-ca-bundle\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.623556 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.623465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c33d530-3052-4e33-8f7d-51ec67d604e0-secret-metrics-server-tls\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.631848 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.631823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4sjp\" (UniqueName: \"kubernetes.io/projected/7c33d530-3052-4e33-8f7d-51ec67d604e0-kube-api-access-z4sjp\") pod \"metrics-server-85b77b975b-nr46f\" (UID: \"7c33d530-3052-4e33-8f7d-51ec67d604e0\") " pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.814126 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.814075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:53:55.967834 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.967757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85b77b975b-nr46f"]
Jul 12 21:53:55.972285 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:55.972243    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c33d530_3052_4e33_8f7d_51ec67d604e0.slice/crio-20ec3da84b219b7fe80d676abc551b0692fea1d5fa019169fafd8a4bca80b5a8 WatchSource:0}: Error finding container 20ec3da84b219b7fe80d676abc551b0692fea1d5fa019169fafd8a4bca80b5a8: Status 404 returned error can't find the container with id 20ec3da84b219b7fe80d676abc551b0692fea1d5fa019169fafd8a4bca80b5a8
Jul 12 21:53:55.996688 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:55.996657    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56656f9c6d-t5zxd"]
Jul 12 21:53:56.001071 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.001050    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.014175 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.014125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56656f9c6d-t5zxd"]
Jul 12 21:53:56.016989 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.016966    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 12 21:53:56.023507 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-config\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.023624 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-trusted-ca-bundle\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.023624 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-service-ca\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.023624 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-oauth-serving-cert\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.023624 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbh7k\" (UniqueName: \"kubernetes.io/projected/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-kube-api-access-xbh7k\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.023781 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-serving-cert\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.023781 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.023755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-oauth-config\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125302 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-serving-cert\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125302 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-oauth-config\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125302 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-config\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125571 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-trusted-ca-bundle\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125571 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-service-ca\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125571 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-oauth-serving-cert\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.125571 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.125387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbh7k\" (UniqueName: \"kubernetes.io/projected/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-kube-api-access-xbh7k\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.126283 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.126244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-config\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.126397 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.126325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-oauth-serving-cert\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.126518 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.126493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-service-ca\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.126915 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.126892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-trusted-ca-bundle\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.128105 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.128070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-oauth-config\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.128204 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.128189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-serving-cert\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.136268 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.136244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbh7k\" (UniqueName: \"kubernetes.io/projected/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-kube-api-access-xbh7k\") pod \"console-56656f9c6d-t5zxd\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") " pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.313004 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.312962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:53:56.451421 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.451390    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56656f9c6d-t5zxd"]
Jul 12 21:53:56.454808 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:53:56.454780    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0e37d4_4bf1_4a8e_8939_719a9ce6f386.slice/crio-eebda047dab85ffafd50aa6e2d38967fb1ac86f1447c3588615a0309ecd54a47 WatchSource:0}: Error finding container eebda047dab85ffafd50aa6e2d38967fb1ac86f1447c3588615a0309ecd54a47: Status 404 returned error can't find the container with id eebda047dab85ffafd50aa6e2d38967fb1ac86f1447c3588615a0309ecd54a47
Jul 12 21:53:56.466387 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.466357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56656f9c6d-t5zxd" event={"ID":"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386","Type":"ContainerStarted","Data":"eebda047dab85ffafd50aa6e2d38967fb1ac86f1447c3588615a0309ecd54a47"}
Jul 12 21:53:56.467366 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:56.467346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f" event={"ID":"7c33d530-3052-4e33-8f7d-51ec67d604e0","Type":"ContainerStarted","Data":"20ec3da84b219b7fe80d676abc551b0692fea1d5fa019169fafd8a4bca80b5a8"}
Jul 12 21:53:57.476630 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:57.476594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56656f9c6d-t5zxd" event={"ID":"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386","Type":"ContainerStarted","Data":"8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf"}
Jul 12 21:53:57.502604 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:57.502548    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56656f9c6d-t5zxd" podStartSLOduration=2.502523569 podStartE2EDuration="2.502523569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:57.498516225 +0000 UTC m=+101.127347300" watchObservedRunningTime="2026-07-12 21:53:57.502523569 +0000 UTC m=+101.131354648"
Jul 12 21:53:58.282343 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:58.282298    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55765594d7-lvk9t"]
Jul 12 21:53:58.482007 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:58.481966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f" event={"ID":"7c33d530-3052-4e33-8f7d-51ec67d604e0","Type":"ContainerStarted","Data":"0f1cb5d7891f7664479d16e9030187ec928689db27b9de343a013a6e06a53b28"}
Jul 12 21:53:58.503313 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:53:58.503261    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f" podStartSLOduration=1.83331995 podStartE2EDuration="3.503242694s" totalImagesPullingTime="1.669922744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:58.502665056 +0000 UTC m=+102.131496131" watchObservedRunningTime="2026-07-12 21:53:58.503242694 +0000 UTC m=+102.132073768"
Jul 12 21:54:06.313391 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:06.313353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:54:06.313882 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:06.313411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:54:06.318155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:06.318127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:54:06.515841 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:06.515812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:54:06.562605 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:06.562566    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5946969795-kwt4l"]
Jul 12 21:54:15.815161 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:15.815124    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:54:15.815566 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:15.815190    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:54:23.303551 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:23.303475    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55765594d7-lvk9t" podUID="ccce646e-7763-47ec-ac9f-ca3c28a2ac70" containerName="registry" containerID="cri-o://1b1901bb3904bf44e538fde66a8d3c8c7081bd3aab90a95192d346a947f77275" gracePeriod=30
Jul 12 21:54:23.573083 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:23.572997    2579 generic.go:356] "Generic (PLEG): container finished" podID="ccce646e-7763-47ec-ac9f-ca3c28a2ac70" containerID="1b1901bb3904bf44e538fde66a8d3c8c7081bd3aab90a95192d346a947f77275" exitCode=0
Jul 12 21:54:23.573348 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:23.573075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55765594d7-lvk9t" event={"ID":"ccce646e-7763-47ec-ac9f-ca3c28a2ac70","Type":"ContainerDied","Data":"1b1901bb3904bf44e538fde66a8d3c8c7081bd3aab90a95192d346a947f77275"}
Jul 12 21:54:24.041204 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.041176    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:54:24.158340 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsz7q\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-kube-api-access-fsz7q\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-bound-sa-token\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158400    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-image-registry-private-configuration\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158442    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-ca-trust-extracted\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-certificates\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158496    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-trusted-ca\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158828 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-installation-pull-secrets\") pod \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\" (UID: \"ccce646e-7763-47ec-ac9f-ca3c28a2ac70\") "
Jul 12 21:54:24.158979 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.158942    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:24.159994 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.159957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:24.161216 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.161180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:24.161399 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.161378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:54:24.161473 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.161401    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-kube-api-access-fsz7q" (OuterVolumeSpecName: "kube-api-access-fsz7q") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "kube-api-access-fsz7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:24.161529 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.161474    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:24.161639 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.161621    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:54:24.167078 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.166971    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ccce646e-7763-47ec-ac9f-ca3c28a2ac70" (UID: "ccce646e-7763-47ec-ac9f-ca3c28a2ac70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:54:24.259445 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259408    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-ca-trust-extracted\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259445 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259438    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-certificates\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259445 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259450    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-trusted-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259445 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259458    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-installation-pull-secrets\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259711 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259467    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-registry-tls\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259711 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259475    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsz7q\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-kube-api-access-fsz7q\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259711 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259485    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-bound-sa-token\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.259711 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.259493    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccce646e-7763-47ec-ac9f-ca3c28a2ac70-image-registry-private-configuration\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:24.577838 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.577804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55765594d7-lvk9t" event={"ID":"ccce646e-7763-47ec-ac9f-ca3c28a2ac70","Type":"ContainerDied","Data":"48dd61c5e88352f018a9d3557097834998dd807c55e00c826493f77639da520a"}
Jul 12 21:54:24.577838 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.577836    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55765594d7-lvk9t"
Jul 12 21:54:24.578330 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.577867    2579 scope.go:117] "RemoveContainer" containerID="1b1901bb3904bf44e538fde66a8d3c8c7081bd3aab90a95192d346a947f77275"
Jul 12 21:54:24.607581 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.607553    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55765594d7-lvk9t"]
Jul 12 21:54:24.610607 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.610581    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55765594d7-lvk9t"]
Jul 12 21:54:24.936753 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:24.936671    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccce646e-7763-47ec-ac9f-ca3c28a2ac70" path="/var/lib/kubelet/pods/ccce646e-7763-47ec-ac9f-ca3c28a2ac70/volumes"
Jul 12 21:54:26.681799 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:26.681762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:54:26.684284 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:26.684262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8-metrics-certs\") pod \"network-metrics-daemon-z8wtc\" (UID: \"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8\") " pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:54:26.763649 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:26.763609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4x2vl\""
Jul 12 21:54:26.771658 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:26.771637    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8wtc"
Jul 12 21:54:26.904679 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:26.904643    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8wtc"]
Jul 12 21:54:26.908670 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:54:26.908647    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29a7a3e_ea7d_4b89_bfa7_b10c9b7e06a8.slice/crio-ac9825b7713bb62aa8058819b6f8b1796f78e2f3f87c34666ecee822a78dafaa WatchSource:0}: Error finding container ac9825b7713bb62aa8058819b6f8b1796f78e2f3f87c34666ecee822a78dafaa: Status 404 returned error can't find the container with id ac9825b7713bb62aa8058819b6f8b1796f78e2f3f87c34666ecee822a78dafaa
Jul 12 21:54:27.590821 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:27.590782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8wtc" event={"ID":"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8","Type":"ContainerStarted","Data":"ac9825b7713bb62aa8058819b6f8b1796f78e2f3f87c34666ecee822a78dafaa"}
Jul 12 21:54:28.596086 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:28.596044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8wtc" event={"ID":"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8","Type":"ContainerStarted","Data":"03d0eba7ea7eaace1642ebfe11671b8156f680c361d2388549876001414462c2"}
Jul 12 21:54:28.596476 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:28.596105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8wtc" event={"ID":"b29a7a3e-ea7d-4b89-bfa7-b10c9b7e06a8","Type":"ContainerStarted","Data":"0d1f53a40766c7eb2e4a2d7fd6ea1475c1d2afe256a6c920c75404eb7ff58428"}
Jul 12 21:54:28.615200 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:28.615150    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z8wtc" podStartSLOduration=130.826863917 podStartE2EDuration="2m11.615132792s" totalImagesPullingTime="788.268875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:54:28.614200803 +0000 UTC m=+132.243031870" watchObservedRunningTime="2026-07-12 21:54:28.615132792 +0000 UTC m=+132.243963866"
Jul 12 21:54:31.584681 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.584639    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5946969795-kwt4l" podUID="171b2f39-50cd-464a-87f7-84d20d936f8c" containerName="console" containerID="cri-o://79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc" gracePeriod=15
Jul 12 21:54:31.832514 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.832486    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:54:31.926452 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-console-config\") pod \"171b2f39-50cd-464a-87f7-84d20d936f8c\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") "
Jul 12 21:54:31.926452 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-service-ca\") pod \"171b2f39-50cd-464a-87f7-84d20d936f8c\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") "
Jul 12 21:54:31.926452 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926421    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-oauth-serving-cert\") pod \"171b2f39-50cd-464a-87f7-84d20d936f8c\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") "
Jul 12 21:54:31.926808 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926579    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vktg5\" (UniqueName: \"kubernetes.io/projected/171b2f39-50cd-464a-87f7-84d20d936f8c-kube-api-access-vktg5\") pod \"171b2f39-50cd-464a-87f7-84d20d936f8c\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") "
Jul 12 21:54:31.926808 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926664    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-serving-cert\") pod \"171b2f39-50cd-464a-87f7-84d20d936f8c\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") "
Jul 12 21:54:31.926808 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926697    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-oauth-config\") pod \"171b2f39-50cd-464a-87f7-84d20d936f8c\" (UID: \"171b2f39-50cd-464a-87f7-84d20d936f8c\") "
Jul 12 21:54:31.926958 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926820    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "171b2f39-50cd-464a-87f7-84d20d936f8c" (UID: "171b2f39-50cd-464a-87f7-84d20d936f8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:31.926958 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926837    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-console-config" (OuterVolumeSpecName: "console-config") pod "171b2f39-50cd-464a-87f7-84d20d936f8c" (UID: "171b2f39-50cd-464a-87f7-84d20d936f8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:31.926958 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926859    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "171b2f39-50cd-464a-87f7-84d20d936f8c" (UID: "171b2f39-50cd-464a-87f7-84d20d936f8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:31.927109 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.926962    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-console-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:31.927109 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.927006    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:31.927109 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.927040    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/171b2f39-50cd-464a-87f7-84d20d936f8c-oauth-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:31.929077 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.929043    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "171b2f39-50cd-464a-87f7-84d20d936f8c" (UID: "171b2f39-50cd-464a-87f7-84d20d936f8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:54:31.929199 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.929082    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "171b2f39-50cd-464a-87f7-84d20d936f8c" (UID: "171b2f39-50cd-464a-87f7-84d20d936f8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:54:31.929199 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:31.929094    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/171b2f39-50cd-464a-87f7-84d20d936f8c-kube-api-access-vktg5" (OuterVolumeSpecName: "kube-api-access-vktg5") pod "171b2f39-50cd-464a-87f7-84d20d936f8c" (UID: "171b2f39-50cd-464a-87f7-84d20d936f8c"). InnerVolumeSpecName "kube-api-access-vktg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:32.028394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.028352    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vktg5\" (UniqueName: \"kubernetes.io/projected/171b2f39-50cd-464a-87f7-84d20d936f8c-kube-api-access-vktg5\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:32.028394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.028381    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:32.028394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.028391    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/171b2f39-50cd-464a-87f7-84d20d936f8c-console-oauth-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:54:32.610937 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.610901    2579 generic.go:356] "Generic (PLEG): container finished" podID="171b2f39-50cd-464a-87f7-84d20d936f8c" containerID="79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc" exitCode=0
Jul 12 21:54:32.611408 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.610950    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5946969795-kwt4l"
Jul 12 21:54:32.611408 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.610965    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5946969795-kwt4l" event={"ID":"171b2f39-50cd-464a-87f7-84d20d936f8c","Type":"ContainerDied","Data":"79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc"}
Jul 12 21:54:32.611408 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.611004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5946969795-kwt4l" event={"ID":"171b2f39-50cd-464a-87f7-84d20d936f8c","Type":"ContainerDied","Data":"4586dc593781d0cdb82b7937c584fe488ac69a0925f7a07cc4845e759e088ec8"}
Jul 12 21:54:32.611408 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.611047    2579 scope.go:117] "RemoveContainer" containerID="79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc"
Jul 12 21:54:32.621206 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.621187    2579 scope.go:117] "RemoveContainer" containerID="79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc"
Jul 12 21:54:32.621626 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:54:32.621598    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc\": container with ID starting with 79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc not found: ID does not exist" containerID="79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc"
Jul 12 21:54:32.621714 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.621637    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc"} err="failed to get container status \"79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc\": rpc error: code = NotFound desc = could not find container \"79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc\": container with ID starting with 79914e2296680243eb84bc29ff53ebfa5f115ff1cb1c61915c943ba506c548dc not found: ID does not exist"
Jul 12 21:54:32.631637 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.631608    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5946969795-kwt4l"]
Jul 12 21:54:32.637039 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.637002    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5946969795-kwt4l"]
Jul 12 21:54:32.936831 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:32.936751    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="171b2f39-50cd-464a-87f7-84d20d936f8c" path="/var/lib/kubelet/pods/171b2f39-50cd-464a-87f7-84d20d936f8c/volumes"
Jul 12 21:54:35.820282 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:35.820245    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:54:35.823993 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:35.823970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85b77b975b-nr46f"
Jul 12 21:54:44.659306 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:44.659269    2579 generic.go:356] "Generic (PLEG): container finished" podID="2b6566c4-7598-444a-a807-65dda7e9d361" containerID="8cdcca97f46d64601125ef245a7bfa6ba3d6394b746732294af354f78b60408a" exitCode=0
Jul 12 21:54:44.659724 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:44.659346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz" event={"ID":"2b6566c4-7598-444a-a807-65dda7e9d361","Type":"ContainerDied","Data":"8cdcca97f46d64601125ef245a7bfa6ba3d6394b746732294af354f78b60408a"}
Jul 12 21:54:44.659724 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:44.659645    2579 scope.go:117] "RemoveContainer" containerID="8cdcca97f46d64601125ef245a7bfa6ba3d6394b746732294af354f78b60408a"
Jul 12 21:54:45.664500 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:54:45.664460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xtkmz" event={"ID":"2b6566c4-7598-444a-a807-65dda7e9d361","Type":"ContainerStarted","Data":"6b96a5e07bfd308576dbd9264bbf80f870b1fea6ffe2312e62e50d431a325c9c"}
Jul 12 21:55:19.564517 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564486    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-776f48d9fd-lcg4f"]
Jul 12 21:55:19.564921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564734    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccce646e-7763-47ec-ac9f-ca3c28a2ac70" containerName="registry"
Jul 12 21:55:19.564921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564746    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccce646e-7763-47ec-ac9f-ca3c28a2ac70" containerName="registry"
Jul 12 21:55:19.564921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564765    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="171b2f39-50cd-464a-87f7-84d20d936f8c" containerName="console"
Jul 12 21:55:19.564921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564770    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="171b2f39-50cd-464a-87f7-84d20d936f8c" containerName="console"
Jul 12 21:55:19.564921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564807    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccce646e-7763-47ec-ac9f-ca3c28a2ac70" containerName="registry"
Jul 12 21:55:19.564921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.564816    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="171b2f39-50cd-464a-87f7-84d20d936f8c" containerName="console"
Jul 12 21:55:19.569370 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.569346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.583324 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.583289    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f48d9fd-lcg4f"]
Jul 12 21:55:19.706660 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-oauth-serving-cert\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.706822 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-serving-cert\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.706822 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-trusted-ca-bundle\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.706822 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbwn\" (UniqueName: \"kubernetes.io/projected/0d7086b5-5be8-415c-abea-93d7eec4decd-kube-api-access-fwbwn\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.706924 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-service-ca\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.706924 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-console-config\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.706988 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.706962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-oauth-config\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807504 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-service-ca\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807701 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-console-config\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807701 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-oauth-config\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807701 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-oauth-serving-cert\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807701 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-serving-cert\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807701 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-trusted-ca-bundle\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.807701 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.807681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbwn\" (UniqueName: \"kubernetes.io/projected/0d7086b5-5be8-415c-abea-93d7eec4decd-kube-api-access-fwbwn\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.808373 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.808334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-service-ca\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.808498 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.808408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-oauth-serving-cert\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.808498 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.808462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-console-config\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.808704 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.808680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-trusted-ca-bundle\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.810334 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.810308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-serving-cert\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.810425 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.810329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-oauth-config\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.816407 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.816345    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbwn\" (UniqueName: \"kubernetes.io/projected/0d7086b5-5be8-415c-abea-93d7eec4decd-kube-api-access-fwbwn\") pod \"console-776f48d9fd-lcg4f\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") " pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:19.879690 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:19.879312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:20.026498 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:20.026475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f48d9fd-lcg4f"]
Jul 12 21:55:20.031116 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:55:20.031081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7086b5_5be8_415c_abea_93d7eec4decd.slice/crio-0ff9b58d1a1011e6c0357880370fdcdd2b24d2cb6411e7bfb7d8c66c507f2d70 WatchSource:0}: Error finding container 0ff9b58d1a1011e6c0357880370fdcdd2b24d2cb6411e7bfb7d8c66c507f2d70: Status 404 returned error can't find the container with id 0ff9b58d1a1011e6c0357880370fdcdd2b24d2cb6411e7bfb7d8c66c507f2d70
Jul 12 21:55:20.794967 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:20.794929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f48d9fd-lcg4f" event={"ID":"0d7086b5-5be8-415c-abea-93d7eec4decd","Type":"ContainerStarted","Data":"411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c"}
Jul 12 21:55:20.795366 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:20.795012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f48d9fd-lcg4f" event={"ID":"0d7086b5-5be8-415c-abea-93d7eec4decd","Type":"ContainerStarted","Data":"0ff9b58d1a1011e6c0357880370fdcdd2b24d2cb6411e7bfb7d8c66c507f2d70"}
Jul 12 21:55:20.813085 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:20.813006    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-776f48d9fd-lcg4f" podStartSLOduration=1.812991085 podStartE2EDuration="1.812991085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:55:20.812433348 +0000 UTC m=+184.441264421" watchObservedRunningTime="2026-07-12 21:55:20.812991085 +0000 UTC m=+184.441822159"
Jul 12 21:55:29.880715 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:29.880673    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:29.881161 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:29.880742    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:29.885577 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:29.885553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:30.833677 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:30.833647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:55:30.900317 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:30.900283    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56656f9c6d-t5zxd"]
Jul 12 21:55:55.921673 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:55.921611    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56656f9c6d-t5zxd" podUID="1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" containerName="console" containerID="cri-o://8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf" gracePeriod=15
Jul 12 21:55:56.166293 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.166268    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:55:56.302578 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302546    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-config\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.302747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302601    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbh7k\" (UniqueName: \"kubernetes.io/projected/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-kube-api-access-xbh7k\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.302747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-oauth-serving-cert\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.302747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302659    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-serving-cert\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.302747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302683    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-service-ca\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.302747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-oauth-config\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.302747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.302729    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-trusted-ca-bundle\") pod \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\" (UID: \"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386\") "
Jul 12 21:55:56.303227 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.303083    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:56.303227 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.303133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-config" (OuterVolumeSpecName: "console-config") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:56.303386 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.303230    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:56.303386 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.303298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:56.305003 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.304978    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:56.305003 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.304993    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-kube-api-access-xbh7k" (OuterVolumeSpecName: "kube-api-access-xbh7k") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "kube-api-access-xbh7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:55:56.305171 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.305050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" (UID: "1f0e37d4-4bf1-4a8e-8939-719a9ce6f386"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:56.403411 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403362    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbh7k\" (UniqueName: \"kubernetes.io/projected/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-kube-api-access-xbh7k\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.403411 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403402    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-oauth-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.403411 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403413    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.403411 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403422    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.403411 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403429    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-oauth-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.403700 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403438    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-trusted-ca-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.403700 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.403447    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386-console-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:55:56.922911 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.922877    2579 generic.go:356] "Generic (PLEG): container finished" podID="1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" containerID="8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf" exitCode=0
Jul 12 21:55:56.922911 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.922915    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56656f9c6d-t5zxd"
Jul 12 21:55:56.923434 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.922972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56656f9c6d-t5zxd" event={"ID":"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386","Type":"ContainerDied","Data":"8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf"}
Jul 12 21:55:56.923434 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.923032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56656f9c6d-t5zxd" event={"ID":"1f0e37d4-4bf1-4a8e-8939-719a9ce6f386","Type":"ContainerDied","Data":"eebda047dab85ffafd50aa6e2d38967fb1ac86f1447c3588615a0309ecd54a47"}
Jul 12 21:55:56.923434 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.923065    2579 scope.go:117] "RemoveContainer" containerID="8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf"
Jul 12 21:55:56.931725 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.931705    2579 scope.go:117] "RemoveContainer" containerID="8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf"
Jul 12 21:55:56.931989 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:55:56.931971    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf\": container with ID starting with 8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf not found: ID does not exist" containerID="8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf"
Jul 12 21:55:56.932082 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.931998    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf"} err="failed to get container status \"8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf\": rpc error: code = NotFound desc = could not find container \"8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf\": container with ID starting with 8ba43c0ae0758aa943f394b84129cc6de368f6aef6eb1d8f52401700476daecf not found: ID does not exist"
Jul 12 21:55:56.944642 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.944613    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56656f9c6d-t5zxd"]
Jul 12 21:55:56.954276 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:56.954250    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56656f9c6d-t5zxd"]
Jul 12 21:55:58.936257 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:55:58.936216    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" path="/var/lib/kubelet/pods/1f0e37d4-4bf1-4a8e-8939-719a9ce6f386/volumes"
Jul 12 21:56:27.218672 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.218628    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7f76d56f-nzdc9"]
Jul 12 21:56:27.219287 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.219045    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" containerName="console"
Jul 12 21:56:27.219287 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.219064    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" containerName="console"
Jul 12 21:56:27.219287 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.219132    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f0e37d4-4bf1-4a8e-8939-719a9ce6f386" containerName="console"
Jul 12 21:56:27.223122 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.223098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.237367 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.237345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7f76d56f-nzdc9"]
Jul 12 21:56:27.340382 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-config\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.340382 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-serving-cert\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.340619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-trusted-ca-bundle\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.340619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7rrv\" (UniqueName: \"kubernetes.io/projected/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-kube-api-access-b7rrv\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.340619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-oauth-serving-cert\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.340619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-oauth-config\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.340619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.340576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-service-ca\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441413 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-trusted-ca-bundle\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441413 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7rrv\" (UniqueName: \"kubernetes.io/projected/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-kube-api-access-b7rrv\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441708 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-oauth-serving-cert\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441708 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-oauth-config\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441708 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-service-ca\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441708 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-config\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.441708 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.441666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-serving-cert\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.442235 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.442201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-oauth-serving-cert\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.442366 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.442241    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-service-ca\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.442366 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.442296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-config\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.442617 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.442595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-trusted-ca-bundle\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.443990 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.443970    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-oauth-config\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.444309 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.444290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-serving-cert\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.451551 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.451523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7rrv\" (UniqueName: \"kubernetes.io/projected/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-kube-api-access-b7rrv\") pod \"console-6d7f76d56f-nzdc9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") " pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.533453 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.533417    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:27.672548 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:27.672513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7f76d56f-nzdc9"]
Jul 12 21:56:27.675461 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:56:27.675436    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e8d6ce_4e64_4d98_8c00_3580d302e4a9.slice/crio-bb088f894e65992d1877b6e26def4aa474c6973241cf9942d17fea001d2cf0ae WatchSource:0}: Error finding container bb088f894e65992d1877b6e26def4aa474c6973241cf9942d17fea001d2cf0ae: Status 404 returned error can't find the container with id bb088f894e65992d1877b6e26def4aa474c6973241cf9942d17fea001d2cf0ae
Jul 12 21:56:28.032991 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:28.032958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7f76d56f-nzdc9" event={"ID":"42e8d6ce-4e64-4d98-8c00-3580d302e4a9","Type":"ContainerStarted","Data":"10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606"}
Jul 12 21:56:28.033180 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:28.033005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7f76d56f-nzdc9" event={"ID":"42e8d6ce-4e64-4d98-8c00-3580d302e4a9","Type":"ContainerStarted","Data":"bb088f894e65992d1877b6e26def4aa474c6973241cf9942d17fea001d2cf0ae"}
Jul 12 21:56:28.056121 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:28.056072    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7f76d56f-nzdc9" podStartSLOduration=1.05605529 podStartE2EDuration="1.05605529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:56:28.05495299 +0000 UTC m=+251.683784064" watchObservedRunningTime="2026-07-12 21:56:28.05605529 +0000 UTC m=+251.684886364"
Jul 12 21:56:37.534578 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:37.534532    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:37.535048 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:37.534600    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:37.539446 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:37.539420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:38.072469 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:38.072437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 21:56:38.129530 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:56:38.129497    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f48d9fd-lcg4f"]
Jul 12 21:57:03.151117 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.151049    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-776f48d9fd-lcg4f" podUID="0d7086b5-5be8-415c-abea-93d7eec4decd" containerName="console" containerID="cri-o://411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c" gracePeriod=15
Jul 12 21:57:03.391836 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.391810    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:57:03.537415 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537377    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwbwn\" (UniqueName: \"kubernetes.io/projected/0d7086b5-5be8-415c-abea-93d7eec4decd-kube-api-access-fwbwn\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537415 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-service-ca\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537668 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-oauth-config\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537668 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-console-config\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537668 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-serving-cert\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537668 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537519    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-oauth-serving-cert\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537668 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537546    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-trusted-ca-bundle\") pod \"0d7086b5-5be8-415c-abea-93d7eec4decd\" (UID: \"0d7086b5-5be8-415c-abea-93d7eec4decd\") "
Jul 12 21:57:03.537969 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537941    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:57:03.538011 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.537950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-console-config" (OuterVolumeSpecName: "console-config") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:57:03.538091 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.538013    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:57:03.538294 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.538267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:57:03.539708 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.539684    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:57:03.540298 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.540270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:57:03.540298 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.540281    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7086b5-5be8-415c-abea-93d7eec4decd-kube-api-access-fwbwn" (OuterVolumeSpecName: "kube-api-access-fwbwn") pod "0d7086b5-5be8-415c-abea-93d7eec4decd" (UID: "0d7086b5-5be8-415c-abea-93d7eec4decd"). InnerVolumeSpecName "kube-api-access-fwbwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:57:03.638619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638570    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwbwn\" (UniqueName: \"kubernetes.io/projected/0d7086b5-5be8-415c-abea-93d7eec4decd-kube-api-access-fwbwn\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:03.638619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638614    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:03.638619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638624    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-oauth-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:03.638619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638632    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-console-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:03.638619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638640    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7086b5-5be8-415c-abea-93d7eec4decd-console-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:03.638914 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638648    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-oauth-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:03.638914 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:03.638658    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d7086b5-5be8-415c-abea-93d7eec4decd-trusted-ca-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:04.168951 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.168910    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d7086b5-5be8-415c-abea-93d7eec4decd" containerID="411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c" exitCode=0
Jul 12 21:57:04.169422 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.168960    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f48d9fd-lcg4f"
Jul 12 21:57:04.169422 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.168997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f48d9fd-lcg4f" event={"ID":"0d7086b5-5be8-415c-abea-93d7eec4decd","Type":"ContainerDied","Data":"411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c"}
Jul 12 21:57:04.169422 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.169077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f48d9fd-lcg4f" event={"ID":"0d7086b5-5be8-415c-abea-93d7eec4decd","Type":"ContainerDied","Data":"0ff9b58d1a1011e6c0357880370fdcdd2b24d2cb6411e7bfb7d8c66c507f2d70"}
Jul 12 21:57:04.169422 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.169113    2579 scope.go:117] "RemoveContainer" containerID="411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c"
Jul 12 21:57:04.177843 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.177827    2579 scope.go:117] "RemoveContainer" containerID="411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c"
Jul 12 21:57:04.178156 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:57:04.178137    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c\": container with ID starting with 411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c not found: ID does not exist" containerID="411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c"
Jul 12 21:57:04.178216 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.178165    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c"} err="failed to get container status \"411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c\": rpc error: code = NotFound desc = could not find container \"411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c\": container with ID starting with 411cb2156e97db2fb038835d27440594e398336820e1c6d8db35ceba6bdf7d6c not found: ID does not exist"
Jul 12 21:57:04.189739 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.189713    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f48d9fd-lcg4f"]
Jul 12 21:57:04.191941 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.191920    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-776f48d9fd-lcg4f"]
Jul 12 21:57:04.940491 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:04.940451    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7086b5-5be8-415c-abea-93d7eec4decd" path="/var/lib/kubelet/pods/0d7086b5-5be8-415c-abea-93d7eec4decd/volumes"
Jul 12 21:57:12.839786 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.839749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"]
Jul 12 21:57:12.840240 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.840042    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7086b5-5be8-415c-abea-93d7eec4decd" containerName="console"
Jul 12 21:57:12.840240 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.840054    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7086b5-5be8-415c-abea-93d7eec4decd" containerName="console"
Jul 12 21:57:12.840240 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.840097    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7086b5-5be8-415c-abea-93d7eec4decd" containerName="console"
Jul 12 21:57:12.842974 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.842957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:12.845955 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.845931    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 21:57:12.846091 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.845929    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7h4ww\""
Jul 12 21:57:12.847392 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.847375    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 21:57:12.852918 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.852893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"]
Jul 12 21:57:12.915657 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.915625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4f28\" (UniqueName: \"kubernetes.io/projected/50a06094-525a-4084-bb9a-be5cbd665ae8-kube-api-access-m4f28\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:12.915802 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.915669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:12.915802 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:12.915738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.016636 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.016589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.016836 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.016670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4f28\" (UniqueName: \"kubernetes.io/projected/50a06094-525a-4084-bb9a-be5cbd665ae8-kube-api-access-m4f28\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.016836 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.016708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.017054 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.017004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.017129 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.017060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.027624 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.027599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4f28\" (UniqueName: \"kubernetes.io/projected/50a06094-525a-4084-bb9a-be5cbd665ae8-kube-api-access-m4f28\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.152164 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.152073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:13.288621 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:13.288588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"]
Jul 12 21:57:13.292810 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:13.292779    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a06094_525a_4084_bb9a_be5cbd665ae8.slice/crio-bbec2e45e0532d048c9b3d08644317e5ebd8e1fd7c5911fbe115f6e6418b52b3 WatchSource:0}: Error finding container bbec2e45e0532d048c9b3d08644317e5ebd8e1fd7c5911fbe115f6e6418b52b3: Status 404 returned error can't find the container with id bbec2e45e0532d048c9b3d08644317e5ebd8e1fd7c5911fbe115f6e6418b52b3
Jul 12 21:57:14.208829 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:14.208787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8" event={"ID":"50a06094-525a-4084-bb9a-be5cbd665ae8","Type":"ContainerStarted","Data":"bbec2e45e0532d048c9b3d08644317e5ebd8e1fd7c5911fbe115f6e6418b52b3"}
Jul 12 21:57:16.790986 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:16.790954    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 21:57:16.797110 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:16.797077    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 21:57:16.798286 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:16.798254    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:57:16.805904 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:16.805782    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 21:57:16.806600 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:16.806579    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 21:57:19.231134 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:19.231009    2579 generic.go:356] "Generic (PLEG): container finished" podID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerID="2bc538f04f1ca2fb28a51fc360cc28f386bf9842caf764827f8ab74a0bfd512e" exitCode=0
Jul 12 21:57:19.231134 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:19.231054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8" event={"ID":"50a06094-525a-4084-bb9a-be5cbd665ae8","Type":"ContainerDied","Data":"2bc538f04f1ca2fb28a51fc360cc28f386bf9842caf764827f8ab74a0bfd512e"}
Jul 12 21:57:19.232068 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:19.232052    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 21:57:22.244414 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:22.244373    2579 generic.go:356] "Generic (PLEG): container finished" podID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerID="df398e615e3cb76be3f60dc2c34ed3304f90cb965d0eaf478ae0fcc34998f78b" exitCode=0
Jul 12 21:57:22.244791 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:22.244456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8" event={"ID":"50a06094-525a-4084-bb9a-be5cbd665ae8","Type":"ContainerDied","Data":"df398e615e3cb76be3f60dc2c34ed3304f90cb965d0eaf478ae0fcc34998f78b"}
Jul 12 21:57:29.277059 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:29.277003    2579 generic.go:356] "Generic (PLEG): container finished" podID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerID="6669bfd4b327a18ce4269f561563e0dcb8be09f02dc18c251d6f08053969e285" exitCode=0
Jul 12 21:57:29.277475 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:29.277102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8" event={"ID":"50a06094-525a-4084-bb9a-be5cbd665ae8","Type":"ContainerDied","Data":"6669bfd4b327a18ce4269f561563e0dcb8be09f02dc18c251d6f08053969e285"}
Jul 12 21:57:30.373896 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.373858    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"]
Jul 12 21:57:30.377821 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.377798    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"]
Jul 12 21:57:30.377966 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.377930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.380505 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.380478    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 12 21:57:30.381607 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.381586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.382155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.381983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fxn8x\""
Jul 12 21:57:30.382155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.382001    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 12 21:57:30.382155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.382058    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 12 21:57:30.382155 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.382151    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 12 21:57:30.384012 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.383992    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 12 21:57:30.390907 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.390878    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"]
Jul 12 21:57:30.392637 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.392615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"]
Jul 12 21:57:30.429753 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.429719    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:30.565877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.565792    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-util\") pod \"50a06094-525a-4084-bb9a-be5cbd665ae8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") "
Jul 12 21:57:30.565877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.565829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4f28\" (UniqueName: \"kubernetes.io/projected/50a06094-525a-4084-bb9a-be5cbd665ae8-kube-api-access-m4f28\") pod \"50a06094-525a-4084-bb9a-be5cbd665ae8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") "
Jul 12 21:57:30.566090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.565899    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-bundle\") pod \"50a06094-525a-4084-bb9a-be5cbd665ae8\" (UID: \"50a06094-525a-4084-bb9a-be5cbd665ae8\") "
Jul 12 21:57:30.566090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.566078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-klusterlet-config\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.566167 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.566122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-tmp\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.566167 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.566148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f4c7d3e-245a-47b6-8067-d23e703b2ecf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7755449cb8-bz9h6\" (UID: \"9f4c7d3e-245a-47b6-8067-d23e703b2ecf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.566271 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.566234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgxx\" (UniqueName: \"kubernetes.io/projected/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-kube-api-access-7pgxx\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.566333 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.566313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l777x\" (UniqueName: \"kubernetes.io/projected/9f4c7d3e-245a-47b6-8067-d23e703b2ecf-kube-api-access-l777x\") pod \"managed-serviceaccount-addon-agent-7755449cb8-bz9h6\" (UID: \"9f4c7d3e-245a-47b6-8067-d23e703b2ecf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.566703 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.566676    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-bundle" (OuterVolumeSpecName: "bundle") pod "50a06094-525a-4084-bb9a-be5cbd665ae8" (UID: "50a06094-525a-4084-bb9a-be5cbd665ae8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:57:30.568317 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.568290    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a06094-525a-4084-bb9a-be5cbd665ae8-kube-api-access-m4f28" (OuterVolumeSpecName: "kube-api-access-m4f28") pod "50a06094-525a-4084-bb9a-be5cbd665ae8" (UID: "50a06094-525a-4084-bb9a-be5cbd665ae8"). InnerVolumeSpecName "kube-api-access-m4f28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:57:30.570497 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.570472    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-util" (OuterVolumeSpecName: "util") pod "50a06094-525a-4084-bb9a-be5cbd665ae8" (UID: "50a06094-525a-4084-bb9a-be5cbd665ae8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:57:30.666666 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-klusterlet-config\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.666666 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-tmp\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.666925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f4c7d3e-245a-47b6-8067-d23e703b2ecf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7755449cb8-bz9h6\" (UID: \"9f4c7d3e-245a-47b6-8067-d23e703b2ecf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.666925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgxx\" (UniqueName: \"kubernetes.io/projected/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-kube-api-access-7pgxx\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.666925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l777x\" (UniqueName: \"kubernetes.io/projected/9f4c7d3e-245a-47b6-8067-d23e703b2ecf-kube-api-access-l777x\") pod \"managed-serviceaccount-addon-agent-7755449cb8-bz9h6\" (UID: \"9f4c7d3e-245a-47b6-8067-d23e703b2ecf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.666925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666791    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:30.666925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666800    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50a06094-525a-4084-bb9a-be5cbd665ae8-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:30.666925 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.666809    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4f28\" (UniqueName: \"kubernetes.io/projected/50a06094-525a-4084-bb9a-be5cbd665ae8-kube-api-access-m4f28\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:30.667251 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.667130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-tmp\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.669278 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.669255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-klusterlet-config\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.669375 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.669303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f4c7d3e-245a-47b6-8067-d23e703b2ecf-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7755449cb8-bz9h6\" (UID: \"9f4c7d3e-245a-47b6-8067-d23e703b2ecf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.675171 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.675148    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgxx\" (UniqueName: \"kubernetes.io/projected/317f80fc-eb6f-44c7-bd2c-550ce9cc1872-kube-api-access-7pgxx\") pod \"klusterlet-addon-workmgr-6df6644d7c-fjrll\" (UID: \"317f80fc-eb6f-44c7-bd2c-550ce9cc1872\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.675320 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.675202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l777x\" (UniqueName: \"kubernetes.io/projected/9f4c7d3e-245a-47b6-8067-d23e703b2ecf-kube-api-access-l777x\") pod \"managed-serviceaccount-addon-agent-7755449cb8-bz9h6\" (UID: \"9f4c7d3e-245a-47b6-8067-d23e703b2ecf\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.717093 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.717063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"
Jul 12 21:57:30.724161 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.724144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:30.857714 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.857557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6"]
Jul 12 21:57:30.860397 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:30.860368    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f4c7d3e_245a_47b6_8067_d23e703b2ecf.slice/crio-e5b6764ac37f46649e59df1f4f7217a1daf59d667b59e96d24d1c58cf4ce30e3 WatchSource:0}: Error finding container e5b6764ac37f46649e59df1f4f7217a1daf59d667b59e96d24d1c58cf4ce30e3: Status 404 returned error can't find the container with id e5b6764ac37f46649e59df1f4f7217a1daf59d667b59e96d24d1c58cf4ce30e3
Jul 12 21:57:30.871536 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:30.871427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"]
Jul 12 21:57:30.873979 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:30.873954    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317f80fc_eb6f_44c7_bd2c_550ce9cc1872.slice/crio-3d385586bc48fbe0ad1919d3332e2a37289034056c8589e5acf034537362c89c WatchSource:0}: Error finding container 3d385586bc48fbe0ad1919d3332e2a37289034056c8589e5acf034537362c89c: Status 404 returned error can't find the container with id 3d385586bc48fbe0ad1919d3332e2a37289034056c8589e5acf034537362c89c
Jul 12 21:57:31.285310 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:31.285269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll" event={"ID":"317f80fc-eb6f-44c7-bd2c-550ce9cc1872","Type":"ContainerStarted","Data":"3d385586bc48fbe0ad1919d3332e2a37289034056c8589e5acf034537362c89c"}
Jul 12 21:57:31.287015 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:31.287000    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8"
Jul 12 21:57:31.287144 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:31.287011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plzg8" event={"ID":"50a06094-525a-4084-bb9a-be5cbd665ae8","Type":"ContainerDied","Data":"bbec2e45e0532d048c9b3d08644317e5ebd8e1fd7c5911fbe115f6e6418b52b3"}
Jul 12 21:57:31.287144 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:31.287066    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbec2e45e0532d048c9b3d08644317e5ebd8e1fd7c5911fbe115f6e6418b52b3"
Jul 12 21:57:31.288136 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:31.288116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6" event={"ID":"9f4c7d3e-245a-47b6-8067-d23e703b2ecf","Type":"ContainerStarted","Data":"e5b6764ac37f46649e59df1f4f7217a1daf59d667b59e96d24d1c58cf4ce30e3"}
Jul 12 21:57:35.306734 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.306703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6" event={"ID":"9f4c7d3e-245a-47b6-8067-d23e703b2ecf","Type":"ContainerStarted","Data":"e52a735ad562bb5b101b8daac9a27824ed66f0df1de5504c2eb0f32fd8acec8e"}
Jul 12 21:57:35.308259 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.308232    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll" event={"ID":"317f80fc-eb6f-44c7-bd2c-550ce9cc1872","Type":"ContainerStarted","Data":"61fb37b684309d2d65057b5539291b24ff6666851757da573768db12488d67c4"}
Jul 12 21:57:35.308420 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.308403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:35.310312 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.310286    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll"
Jul 12 21:57:35.326068 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.326000    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7755449cb8-bz9h6" podStartSLOduration=1.398978364 podStartE2EDuration="5.325984628s" totalImagesPullingTime="3.927006264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:57:35.325367278 +0000 UTC m=+318.954198365" watchObservedRunningTime="2026-07-12 21:57:35.325984628 +0000 UTC m=+318.954815770"
Jul 12 21:57:35.353482 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.353429    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df6644d7c-fjrll" podStartSLOduration=1.427836426 podStartE2EDuration="5.353410894s" totalImagesPullingTime="3.925574468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:57:35.352244755 +0000 UTC m=+318.981075829" watchObservedRunningTime="2026-07-12 21:57:35.353410894 +0000 UTC m=+318.982241968"
Jul 12 21:57:35.822198 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.822166    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"]
Jul 12 21:57:35.823086 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823052    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="extract"
Jul 12 21:57:35.823086 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823085    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="extract"
Jul 12 21:57:35.823271 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823121    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="pull"
Jul 12 21:57:35.823271 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823130    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="pull"
Jul 12 21:57:35.823271 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823166    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="util"
Jul 12 21:57:35.823271 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823174    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="util"
Jul 12 21:57:35.823456 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.823307    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a06094-525a-4084-bb9a-be5cbd665ae8" containerName="extract"
Jul 12 21:57:35.841469 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.841432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"]
Jul 12 21:57:35.841640 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.841523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:35.844478 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.844452    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 12 21:57:35.844478 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.844470    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p7lcz\""
Jul 12 21:57:35.844673 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.844497    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:57:35.904358 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.904325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mp7p\" (UniqueName: \"kubernetes.io/projected/d0b1d454-ddc7-4b9d-8b10-8890350f5ba0-kube-api-access-2mp7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-bgvn9\" (UID: \"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:35.904525 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:35.904403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0b1d454-ddc7-4b9d-8b10-8890350f5ba0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bgvn9\" (UID: \"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:36.004921 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:36.004869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mp7p\" (UniqueName: \"kubernetes.io/projected/d0b1d454-ddc7-4b9d-8b10-8890350f5ba0-kube-api-access-2mp7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-bgvn9\" (UID: \"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:36.005143 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:36.004966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0b1d454-ddc7-4b9d-8b10-8890350f5ba0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bgvn9\" (UID: \"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:36.005397 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:36.005376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0b1d454-ddc7-4b9d-8b10-8890350f5ba0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bgvn9\" (UID: \"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:36.017144 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:36.017120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mp7p\" (UniqueName: \"kubernetes.io/projected/d0b1d454-ddc7-4b9d-8b10-8890350f5ba0-kube-api-access-2mp7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-bgvn9\" (UID: \"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:36.151307 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:36.151221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"
Jul 12 21:57:36.326012 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:36.325987    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9"]
Jul 12 21:57:36.327538 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:36.327502    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b1d454_ddc7_4b9d_8b10_8890350f5ba0.slice/crio-5138809624b13b719a22b963fd83ae9cf29044b69e3abd925d6353848e27f5bc WatchSource:0}: Error finding container 5138809624b13b719a22b963fd83ae9cf29044b69e3abd925d6353848e27f5bc: Status 404 returned error can't find the container with id 5138809624b13b719a22b963fd83ae9cf29044b69e3abd925d6353848e27f5bc
Jul 12 21:57:37.316679 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:37.316640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9" event={"ID":"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0","Type":"ContainerStarted","Data":"5138809624b13b719a22b963fd83ae9cf29044b69e3abd925d6353848e27f5bc"}
Jul 12 21:57:38.322918 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:38.322840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9" event={"ID":"d0b1d454-ddc7-4b9d-8b10-8890350f5ba0","Type":"ContainerStarted","Data":"fc468c44a3796e67e6e58135cb20661aca409457b3d62088cdc020912fb04a32"}
Jul 12 21:57:38.347743 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:38.347686    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bgvn9" podStartSLOduration=1.617060452 podStartE2EDuration="3.347664259s" totalImagesPullingTime="1.730603807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:57:38.346192033 +0000 UTC m=+321.975023110" watchObservedRunningTime="2026-07-12 21:57:38.347664259 +0000 UTC m=+321.976495334"
Jul 12 21:57:39.894179 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.894147    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r982g"]
Jul 12 21:57:39.916634 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.916601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r982g"]
Jul 12 21:57:39.916835 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.916700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:39.919671 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.919649    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 21:57:39.919785 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.919650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 21:57:39.919785 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.919695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xcqfl\""
Jul 12 21:57:39.931611 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.931586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9q4\" (UniqueName: \"kubernetes.io/projected/1ff6d731-7bca-4e28-9cb7-d23ae9acd149-kube-api-access-cf9q4\") pod \"cert-manager-webhook-6486ffd997-r982g\" (UID: \"1ff6d731-7bca-4e28-9cb7-d23ae9acd149\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:39.931724 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:39.931637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ff6d731-7bca-4e28-9cb7-d23ae9acd149-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r982g\" (UID: \"1ff6d731-7bca-4e28-9cb7-d23ae9acd149\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:40.032783 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.032747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9q4\" (UniqueName: \"kubernetes.io/projected/1ff6d731-7bca-4e28-9cb7-d23ae9acd149-kube-api-access-cf9q4\") pod \"cert-manager-webhook-6486ffd997-r982g\" (UID: \"1ff6d731-7bca-4e28-9cb7-d23ae9acd149\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:40.032952 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.032802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ff6d731-7bca-4e28-9cb7-d23ae9acd149-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r982g\" (UID: \"1ff6d731-7bca-4e28-9cb7-d23ae9acd149\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:40.043878 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.043851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9q4\" (UniqueName: \"kubernetes.io/projected/1ff6d731-7bca-4e28-9cb7-d23ae9acd149-kube-api-access-cf9q4\") pod \"cert-manager-webhook-6486ffd997-r982g\" (UID: \"1ff6d731-7bca-4e28-9cb7-d23ae9acd149\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:40.046809 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.046781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ff6d731-7bca-4e28-9cb7-d23ae9acd149-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r982g\" (UID: \"1ff6d731-7bca-4e28-9cb7-d23ae9acd149\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:40.145271 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.145192    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"]
Jul 12 21:57:40.160340 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.160311    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.163542 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.163505    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 21:57:40.163691 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.163549    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7h4ww\""
Jul 12 21:57:40.163691 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.163575    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 21:57:40.164812 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.164783    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"]
Jul 12 21:57:40.226681 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.226647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:40.234218 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.234192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssn7j\" (UniqueName: \"kubernetes.io/projected/55585f4b-4a24-4057-80a1-032d40259de3-kube-api-access-ssn7j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.234300 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.234255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.234338 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.234310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.335573 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.335536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.335573 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.335571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.335739 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.335610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssn7j\" (UniqueName: \"kubernetes.io/projected/55585f4b-4a24-4057-80a1-032d40259de3-kube-api-access-ssn7j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.336002 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.335967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.336075 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.336047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.347842 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.347809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssn7j\" (UniqueName: \"kubernetes.io/projected/55585f4b-4a24-4057-80a1-032d40259de3-kube-api-access-ssn7j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.387154 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.387122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r982g"]
Jul 12 21:57:40.392310 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:40.392280    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ff6d731_7bca_4e28_9cb7_d23ae9acd149.slice/crio-d6528e84bc6a74a1f6c36462cb34cac1a0699c9dceae285dbf616c380b8a1d6f WatchSource:0}: Error finding container d6528e84bc6a74a1f6c36462cb34cac1a0699c9dceae285dbf616c380b8a1d6f: Status 404 returned error can't find the container with id d6528e84bc6a74a1f6c36462cb34cac1a0699c9dceae285dbf616c380b8a1d6f
Jul 12 21:57:40.470715 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.470665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:40.653292 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:40.653206    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"]
Jul 12 21:57:40.656438 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:40.656405    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55585f4b_4a24_4057_80a1_032d40259de3.slice/crio-b72f01aed045a5cfcfad9ad2a90267f70886691bda8af441332dbe97c9ec7e22 WatchSource:0}: Error finding container b72f01aed045a5cfcfad9ad2a90267f70886691bda8af441332dbe97c9ec7e22: Status 404 returned error can't find the container with id b72f01aed045a5cfcfad9ad2a90267f70886691bda8af441332dbe97c9ec7e22
Jul 12 21:57:41.337713 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:41.337661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g" event={"ID":"1ff6d731-7bca-4e28-9cb7-d23ae9acd149","Type":"ContainerStarted","Data":"d6528e84bc6a74a1f6c36462cb34cac1a0699c9dceae285dbf616c380b8a1d6f"}
Jul 12 21:57:41.339649 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:41.339618    2579 generic.go:356] "Generic (PLEG): container finished" podID="55585f4b-4a24-4057-80a1-032d40259de3" containerID="611e2cdc6fae2def75c99452ab062fdb03d25c636144e9f203a76c1fdb67bb88" exitCode=0
Jul 12 21:57:41.339777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:41.339692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s" event={"ID":"55585f4b-4a24-4057-80a1-032d40259de3","Type":"ContainerDied","Data":"611e2cdc6fae2def75c99452ab062fdb03d25c636144e9f203a76c1fdb67bb88"}
Jul 12 21:57:41.339777 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:41.339732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s" event={"ID":"55585f4b-4a24-4057-80a1-032d40259de3","Type":"ContainerStarted","Data":"b72f01aed045a5cfcfad9ad2a90267f70886691bda8af441332dbe97c9ec7e22"}
Jul 12 21:57:44.355829 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:44.355793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g" event={"ID":"1ff6d731-7bca-4e28-9cb7-d23ae9acd149","Type":"ContainerStarted","Data":"16923ffa21f47a0de3f942d95ef918bbbdea8afbd844bb7de18fae7b6677d212"}
Jul 12 21:57:44.356324 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:44.355901    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:44.357650 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:44.357624    2579 generic.go:356] "Generic (PLEG): container finished" podID="55585f4b-4a24-4057-80a1-032d40259de3" containerID="4bb4737fb960be74aa37640cd640ad646e495ab972e7d320358b03e7ebbdd331" exitCode=0
Jul 12 21:57:44.357773 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:44.357710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s" event={"ID":"55585f4b-4a24-4057-80a1-032d40259de3","Type":"ContainerDied","Data":"4bb4737fb960be74aa37640cd640ad646e495ab972e7d320358b03e7ebbdd331"}
Jul 12 21:57:44.375321 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:44.375264    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g" podStartSLOduration=1.811163056 podStartE2EDuration="5.375243278s" totalImagesPullingTime="3.564080222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:57:44.373917925 +0000 UTC m=+328.002749000" watchObservedRunningTime="2026-07-12 21:57:44.375243278 +0000 UTC m=+328.004074353"
Jul 12 21:57:45.363660 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:45.363622    2579 generic.go:356] "Generic (PLEG): container finished" podID="55585f4b-4a24-4057-80a1-032d40259de3" containerID="20f81d345d56582dc1220e711ce3422d24b78e43a9c2c5539183f417c7b2977c" exitCode=0
Jul 12 21:57:45.364087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:45.363713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s" event={"ID":"55585f4b-4a24-4057-80a1-032d40259de3","Type":"ContainerDied","Data":"20f81d345d56582dc1220e711ce3422d24b78e43a9c2c5539183f417c7b2977c"}
Jul 12 21:57:46.498342 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.498316    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:46.587239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.587203    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-bundle\") pod \"55585f4b-4a24-4057-80a1-032d40259de3\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") "
Jul 12 21:57:46.587406 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.587260    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-util\") pod \"55585f4b-4a24-4057-80a1-032d40259de3\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") "
Jul 12 21:57:46.587406 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.587283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssn7j\" (UniqueName: \"kubernetes.io/projected/55585f4b-4a24-4057-80a1-032d40259de3-kube-api-access-ssn7j\") pod \"55585f4b-4a24-4057-80a1-032d40259de3\" (UID: \"55585f4b-4a24-4057-80a1-032d40259de3\") "
Jul 12 21:57:46.587704 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.587676    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-bundle" (OuterVolumeSpecName: "bundle") pod "55585f4b-4a24-4057-80a1-032d40259de3" (UID: "55585f4b-4a24-4057-80a1-032d40259de3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:57:46.589576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.589546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55585f4b-4a24-4057-80a1-032d40259de3-kube-api-access-ssn7j" (OuterVolumeSpecName: "kube-api-access-ssn7j") pod "55585f4b-4a24-4057-80a1-032d40259de3" (UID: "55585f4b-4a24-4057-80a1-032d40259de3"). InnerVolumeSpecName "kube-api-access-ssn7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:57:46.591394 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.591373    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-util" (OuterVolumeSpecName: "util") pod "55585f4b-4a24-4057-80a1-032d40259de3" (UID: "55585f4b-4a24-4057-80a1-032d40259de3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:57:46.688818 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.688729    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:46.688818 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.688758    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssn7j\" (UniqueName: \"kubernetes.io/projected/55585f4b-4a24-4057-80a1-032d40259de3-kube-api-access-ssn7j\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:46.688818 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:46.688769    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55585f4b-4a24-4057-80a1-032d40259de3-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:57:47.373818 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:47.373776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s" event={"ID":"55585f4b-4a24-4057-80a1-032d40259de3","Type":"ContainerDied","Data":"b72f01aed045a5cfcfad9ad2a90267f70886691bda8af441332dbe97c9ec7e22"}
Jul 12 21:57:47.373986 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:47.373828    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsvj9s"
Jul 12 21:57:47.373986 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:47.373836    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b72f01aed045a5cfcfad9ad2a90267f70886691bda8af441332dbe97c9ec7e22"
Jul 12 21:57:50.366041 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:50.365990    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r982g"
Jul 12 21:57:55.257713 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.257673    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"]
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.257952    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="util"
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.257964    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="util"
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.257973    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="extract"
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.257979    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="extract"
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.257996    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="pull"
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.258002    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="pull"
Jul 12 21:57:55.258087 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.258068    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="55585f4b-4a24-4057-80a1-032d40259de3" containerName="extract"
Jul 12 21:57:55.261638 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.261619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.264239 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.264215    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:57:55.264377 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.264361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 21:57:55.265305 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.265287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xzthr\""
Jul 12 21:57:55.270540 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.270518    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"]
Jul 12 21:57:55.360173 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.360131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213e38e0-9c7a-471c-b48e-f87522281a0f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rqttr\" (UID: \"213e38e0-9c7a-471c-b48e-f87522281a0f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.360357 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.360199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw9f9\" (UniqueName: \"kubernetes.io/projected/213e38e0-9c7a-471c-b48e-f87522281a0f-kube-api-access-nw9f9\") pod \"openshift-lws-operator-fd8ccff4c-rqttr\" (UID: \"213e38e0-9c7a-471c-b48e-f87522281a0f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.460769 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.460729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213e38e0-9c7a-471c-b48e-f87522281a0f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rqttr\" (UID: \"213e38e0-9c7a-471c-b48e-f87522281a0f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.460961 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.460802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw9f9\" (UniqueName: \"kubernetes.io/projected/213e38e0-9c7a-471c-b48e-f87522281a0f-kube-api-access-nw9f9\") pod \"openshift-lws-operator-fd8ccff4c-rqttr\" (UID: \"213e38e0-9c7a-471c-b48e-f87522281a0f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.461220 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.461200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/213e38e0-9c7a-471c-b48e-f87522281a0f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rqttr\" (UID: \"213e38e0-9c7a-471c-b48e-f87522281a0f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.469783 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.469764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw9f9\" (UniqueName: \"kubernetes.io/projected/213e38e0-9c7a-471c-b48e-f87522281a0f-kube-api-access-nw9f9\") pod \"openshift-lws-operator-fd8ccff4c-rqttr\" (UID: \"213e38e0-9c7a-471c-b48e-f87522281a0f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.571803 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.571773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"
Jul 12 21:57:55.705736 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:55.705713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr"]
Jul 12 21:57:55.708162 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:57:55.708138    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod213e38e0_9c7a_471c_b48e_f87522281a0f.slice/crio-6566ba9b70195698ff225d98cfc14761c491b3cc0591fa9bec75ac93d2c800a4 WatchSource:0}: Error finding container 6566ba9b70195698ff225d98cfc14761c491b3cc0591fa9bec75ac93d2c800a4: Status 404 returned error can't find the container with id 6566ba9b70195698ff225d98cfc14761c491b3cc0591fa9bec75ac93d2c800a4
Jul 12 21:57:56.420316 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:56.420274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr" event={"ID":"213e38e0-9c7a-471c-b48e-f87522281a0f","Type":"ContainerStarted","Data":"6566ba9b70195698ff225d98cfc14761c491b3cc0591fa9bec75ac93d2c800a4"}
Jul 12 21:57:58.430110 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:58.430075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr" event={"ID":"213e38e0-9c7a-471c-b48e-f87522281a0f","Type":"ContainerStarted","Data":"c4c010979f1c46169a11c1b749cb7294bc0c57cf161c7788e6f31550582c3b78"}
Jul 12 21:57:58.448336 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:57:58.448293    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rqttr" podStartSLOduration=1.695629474 podStartE2EDuration="3.448278369s" totalImagesPullingTime="1.752648895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:57:58.447363621 +0000 UTC m=+342.076194697" watchObservedRunningTime="2026-07-12 21:57:58.448278369 +0000 UTC m=+342.077109443"
Jul 12 21:58:00.971127 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:00.971095    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"]
Jul 12 21:58:00.974475 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:00.974455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:00.977063 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:00.977039    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 12 21:58:00.977957 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:00.977942    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7h4ww\""
Jul 12 21:58:00.978062 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:00.977976    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 12 21:58:00.983494 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:00.983466    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"]
Jul 12 21:58:01.010877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.010844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.010877 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.010879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf448\" (UniqueName: \"kubernetes.io/projected/28c2911b-75f9-4858-bf32-d8e1a6db9452-kube-api-access-cf448\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.011097 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.010909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.111583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.111539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.111766 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.111588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf448\" (UniqueName: \"kubernetes.io/projected/28c2911b-75f9-4858-bf32-d8e1a6db9452-kube-api-access-cf448\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.111766 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.111620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.111933 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.111913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.112004 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.111981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.121525 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.121491    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf448\" (UniqueName: \"kubernetes.io/projected/28c2911b-75f9-4858-bf32-d8e1a6db9452-kube-api-access-cf448\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.284987 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.284954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:01.421353 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:01.421272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"]
Jul 12 21:58:01.443994 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:58:01.443959    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c2911b_75f9_4858_bf32_d8e1a6db9452.slice/crio-924caff018f37210f0eaa117b66f0ae107e734f54bd6220cd669a9df37532348 WatchSource:0}: Error finding container 924caff018f37210f0eaa117b66f0ae107e734f54bd6220cd669a9df37532348: Status 404 returned error can't find the container with id 924caff018f37210f0eaa117b66f0ae107e734f54bd6220cd669a9df37532348
Jul 12 21:58:02.453631 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:02.453549    2579 generic.go:356] "Generic (PLEG): container finished" podID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerID="5b27480e2762c2bc6f21d3b02a48ae18a04f0af5043a66b45e0a9fc5111aa27a" exitCode=0
Jul 12 21:58:02.454051 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:02.453640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn" event={"ID":"28c2911b-75f9-4858-bf32-d8e1a6db9452","Type":"ContainerDied","Data":"5b27480e2762c2bc6f21d3b02a48ae18a04f0af5043a66b45e0a9fc5111aa27a"}
Jul 12 21:58:02.454051 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:02.453689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn" event={"ID":"28c2911b-75f9-4858-bf32-d8e1a6db9452","Type":"ContainerStarted","Data":"924caff018f37210f0eaa117b66f0ae107e734f54bd6220cd669a9df37532348"}
Jul 12 21:58:03.459326 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:03.459292    2579 generic.go:356] "Generic (PLEG): container finished" podID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerID="0da5738901ebb5b31c0a1be70081c5f4e061ad2c8803ab49299cf07d6e48761e" exitCode=0
Jul 12 21:58:03.459809 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:03.459388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn" event={"ID":"28c2911b-75f9-4858-bf32-d8e1a6db9452","Type":"ContainerDied","Data":"0da5738901ebb5b31c0a1be70081c5f4e061ad2c8803ab49299cf07d6e48761e"}
Jul 12 21:58:04.466393 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:04.466364    2579 generic.go:356] "Generic (PLEG): container finished" podID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerID="a7b6e43b95f27d7cfd049c6f2c06039bd12d249bce32a669a7202ee33a6e51bd" exitCode=0
Jul 12 21:58:04.466808 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:04.466455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn" event={"ID":"28c2911b-75f9-4858-bf32-d8e1a6db9452","Type":"ContainerDied","Data":"a7b6e43b95f27d7cfd049c6f2c06039bd12d249bce32a669a7202ee33a6e51bd"}
Jul 12 21:58:05.597855 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.597829    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:05.645225 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.645190    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-util\") pod \"28c2911b-75f9-4858-bf32-d8e1a6db9452\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") "
Jul 12 21:58:05.645409 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.645249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf448\" (UniqueName: \"kubernetes.io/projected/28c2911b-75f9-4858-bf32-d8e1a6db9452-kube-api-access-cf448\") pod \"28c2911b-75f9-4858-bf32-d8e1a6db9452\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") "
Jul 12 21:58:05.645409 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.645285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-bundle\") pod \"28c2911b-75f9-4858-bf32-d8e1a6db9452\" (UID: \"28c2911b-75f9-4858-bf32-d8e1a6db9452\") "
Jul 12 21:58:05.646070 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.646015    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-bundle" (OuterVolumeSpecName: "bundle") pod "28c2911b-75f9-4858-bf32-d8e1a6db9452" (UID: "28c2911b-75f9-4858-bf32-d8e1a6db9452"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:58:05.647528 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.647505    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c2911b-75f9-4858-bf32-d8e1a6db9452-kube-api-access-cf448" (OuterVolumeSpecName: "kube-api-access-cf448") pod "28c2911b-75f9-4858-bf32-d8e1a6db9452" (UID: "28c2911b-75f9-4858-bf32-d8e1a6db9452"). InnerVolumeSpecName "kube-api-access-cf448". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:58:05.650697 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.650664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-util" (OuterVolumeSpecName: "util") pod "28c2911b-75f9-4858-bf32-d8e1a6db9452" (UID: "28c2911b-75f9-4858-bf32-d8e1a6db9452"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:58:05.746288 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.746197    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:58:05.746288 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.746229    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf448\" (UniqueName: \"kubernetes.io/projected/28c2911b-75f9-4858-bf32-d8e1a6db9452-kube-api-access-cf448\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:58:05.746288 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:05.746240    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c2911b-75f9-4858-bf32-d8e1a6db9452-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:58:06.477043 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:06.476995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn" event={"ID":"28c2911b-75f9-4858-bf32-d8e1a6db9452","Type":"ContainerDied","Data":"924caff018f37210f0eaa117b66f0ae107e734f54bd6220cd669a9df37532348"}
Jul 12 21:58:06.477212 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:06.477050    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7ctgn"
Jul 12 21:58:06.477212 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:06.477061    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="924caff018f37210f0eaa117b66f0ae107e734f54bd6220cd669a9df37532348"
Jul 12 21:58:16.972220 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972145    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"]
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972415    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="extract"
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972426    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="extract"
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972437    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="pull"
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972443    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="pull"
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972450    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="util"
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972455    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="util"
Jul 12 21:58:16.972583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:16.972510    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c2911b-75f9-4858-bf32-d8e1a6db9452" containerName="extract"
Jul 12 21:58:17.014709 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.014674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"]
Jul 12 21:58:17.014866 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.014800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.018070 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.018046    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 21:58:17.018396 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.018380    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 21:58:17.018728 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.018712    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 21:58:17.018728 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.018712    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 21:58:17.019008 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.018991    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2p5vq\""
Jul 12 21:58:17.143523 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.143485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e214b820-2e1d-459b-a5c1-e481354233f7-manifests\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.143523 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.143529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e214b820-2e1d-459b-a5c1-e481354233f7-tmp\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.143794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.143551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8c6q\" (UniqueName: \"kubernetes.io/projected/e214b820-2e1d-459b-a5c1-e481354233f7-kube-api-access-q8c6q\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.143794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.143572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e214b820-2e1d-459b-a5c1-e481354233f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.143794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.143683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e214b820-2e1d-459b-a5c1-e481354233f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.244554 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.244449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e214b820-2e1d-459b-a5c1-e481354233f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.244554 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.244541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e214b820-2e1d-459b-a5c1-e481354233f7-manifests\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.244794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.244575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e214b820-2e1d-459b-a5c1-e481354233f7-tmp\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.244794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.244603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8c6q\" (UniqueName: \"kubernetes.io/projected/e214b820-2e1d-459b-a5c1-e481354233f7-kube-api-access-q8c6q\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.244794 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.244667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e214b820-2e1d-459b-a5c1-e481354233f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.245156 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.245128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e214b820-2e1d-459b-a5c1-e481354233f7-manifests\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.247214 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.247189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e214b820-2e1d-459b-a5c1-e481354233f7-tmp\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.247326 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.247298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e214b820-2e1d-459b-a5c1-e481354233f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.247367 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.247344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e214b820-2e1d-459b-a5c1-e481354233f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.255283 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.255258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8c6q\" (UniqueName: \"kubernetes.io/projected/e214b820-2e1d-459b-a5c1-e481354233f7-kube-api-access-q8c6q\") pod \"opendatahub-operator-controller-manager-d867dd548-ctvl7\" (UID: \"e214b820-2e1d-459b-a5c1-e481354233f7\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.325891 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.325857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:17.468496 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.468470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"]
Jul 12 21:58:17.471138 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:58:17.471106    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode214b820_2e1d_459b_a5c1_e481354233f7.slice/crio-3a28f50a0fb706c6b0d9ca7f2453f6fc83da97b70374353782374d532f18dfc2 WatchSource:0}: Error finding container 3a28f50a0fb706c6b0d9ca7f2453f6fc83da97b70374353782374d532f18dfc2: Status 404 returned error can't find the container with id 3a28f50a0fb706c6b0d9ca7f2453f6fc83da97b70374353782374d532f18dfc2
Jul 12 21:58:17.524808 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:17.524720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7" event={"ID":"e214b820-2e1d-459b-a5c1-e481354233f7","Type":"ContainerStarted","Data":"3a28f50a0fb706c6b0d9ca7f2453f6fc83da97b70374353782374d532f18dfc2"}
Jul 12 21:58:20.541224 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:20.541187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7" event={"ID":"e214b820-2e1d-459b-a5c1-e481354233f7","Type":"ContainerStarted","Data":"08867be4a31368ee43d04443279e91237b8dc793d6c93cd8a6e61a41ae71d3e3"}
Jul 12 21:58:22.551461 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:22.551427    2579 generic.go:356] "Generic (PLEG): container finished" podID="e214b820-2e1d-459b-a5c1-e481354233f7" containerID="08867be4a31368ee43d04443279e91237b8dc793d6c93cd8a6e61a41ae71d3e3" exitCode=0
Jul 12 21:58:22.551844 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:22.551470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7" event={"ID":"e214b820-2e1d-459b-a5c1-e481354233f7","Type":"ContainerDied","Data":"08867be4a31368ee43d04443279e91237b8dc793d6c93cd8a6e61a41ae71d3e3"}
Jul 12 21:58:23.557537 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:23.557501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7" event={"ID":"e214b820-2e1d-459b-a5c1-e481354233f7","Type":"ContainerStarted","Data":"e805647b326072cf190694c5fc0e14c8ab54ecd1319dfe2c2517e4f95654cd5e"}
Jul 12 21:58:23.557954 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:23.557728    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:23.593492 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:23.593438    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7" podStartSLOduration=3.281767697 podStartE2EDuration="7.593421619s" totalImagesPullingTime="3.250181247s" totalInitContainerRuntime="1.061472675s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:23.59286148 +0000 UTC m=+367.221692554" watchObservedRunningTime="2026-07-12 21:58:23.593421619 +0000 UTC m=+367.222252693"
Jul 12 21:58:34.564150 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:34.564120    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ctvl7"
Jul 12 21:58:37.141245 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.141201    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"]
Jul 12 21:58:37.149321 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.149299    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.155421 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.155374    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 21:58:37.155569 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.155525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v9x82\""
Jul 12 21:58:37.155755 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.155740    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 21:58:37.156349 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.156320    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 21:58:37.165522 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.165498    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"]
Jul 12 21:58:37.186719 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.186688    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"]
Jul 12 21:58:37.189893 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.189868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.195851 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.195826    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 21:58:37.195851 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.195836    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lr7j7\""
Jul 12 21:58:37.197342 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.197092    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 21:58:37.197342 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.197299    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 21:58:37.197675 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.197655    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 21:58:37.206130 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.206105    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"]
Jul 12 21:58:37.215998 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.215973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tls-certs\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.216133 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.216007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tmp\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.216133 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.216071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv27w\" (UniqueName: \"kubernetes.io/projected/e034fdf5-9fa0-4802-9d44-27a34b083018-kube-api-access-tv27w\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.216133 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.216091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e034fdf5-9fa0-4802-9d44-27a34b083018-manager-config\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.216133 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.216108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e034fdf5-9fa0-4802-9d44-27a34b083018-metrics-cert\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.216282 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.216258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e034fdf5-9fa0-4802-9d44-27a34b083018-cert\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.216320 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.216305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjzt\" (UniqueName: \"kubernetes.io/projected/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-kube-api-access-5hjzt\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.317181 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tls-certs\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.317181 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tmp\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.317430 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv27w\" (UniqueName: \"kubernetes.io/projected/e034fdf5-9fa0-4802-9d44-27a34b083018-kube-api-access-tv27w\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.317430 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e034fdf5-9fa0-4802-9d44-27a34b083018-manager-config\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.317430 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e034fdf5-9fa0-4802-9d44-27a34b083018-metrics-cert\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.317430 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e034fdf5-9fa0-4802-9d44-27a34b083018-cert\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.317430 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:58:37.317319    2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 12 21:58:37.317430 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjzt\" (UniqueName: \"kubernetes.io/projected/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-kube-api-access-5hjzt\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.317743 ip-10-0-141-23 kubenswrapper[2579]: E0712 21:58:37.317475    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tls-certs podName:4e4c4cfa-f9b5-457d-ad52-d596903b2f17 nodeName:}" failed. No retries permitted until 2026-07-12 21:58:37.817452691 +0000 UTC m=+381.446283774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tls-certs") pod "kube-auth-proxy-66b84d88d8-tk4pz" (UID: "4e4c4cfa-f9b5-457d-ad52-d596903b2f17") : secret "kube-auth-proxy-tls" not found
Jul 12 21:58:37.317967 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.317945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e034fdf5-9fa0-4802-9d44-27a34b083018-manager-config\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.319764 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.319739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tmp\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.319907 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.319891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e034fdf5-9fa0-4802-9d44-27a34b083018-metrics-cert\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.319950 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.319916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e034fdf5-9fa0-4802-9d44-27a34b083018-cert\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.342096 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.342063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjzt\" (UniqueName: \"kubernetes.io/projected/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-kube-api-access-5hjzt\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.343282 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.343256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv27w\" (UniqueName: \"kubernetes.io/projected/e034fdf5-9fa0-4802-9d44-27a34b083018-kube-api-access-tv27w\") pod \"lws-controller-manager-db9cf56f-rkq6n\" (UID: \"e034fdf5-9fa0-4802-9d44-27a34b083018\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.458842 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.458762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:37.614352 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.614327    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"]
Jul 12 21:58:37.616923 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:58:37.616887    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode034fdf5_9fa0_4802_9d44_27a34b083018.slice/crio-8a8f75ae676d1f2dd7d9cfbd423d93b676d48a91d2d8776820468042aaba8ce7 WatchSource:0}: Error finding container 8a8f75ae676d1f2dd7d9cfbd423d93b676d48a91d2d8776820468042aaba8ce7: Status 404 returned error can't find the container with id 8a8f75ae676d1f2dd7d9cfbd423d93b676d48a91d2d8776820468042aaba8ce7
Jul 12 21:58:37.821985 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.821952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tls-certs\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:37.824705 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:37.824669    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4c4cfa-f9b5-457d-ad52-d596903b2f17-tls-certs\") pod \"kube-auth-proxy-66b84d88d8-tk4pz\" (UID: \"4e4c4cfa-f9b5-457d-ad52-d596903b2f17\") " pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:38.099769 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:38.099681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"
Jul 12 21:58:38.268728 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:38.268697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz"]
Jul 12 21:58:38.271134 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:58:38.271100    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4c4cfa_f9b5_457d_ad52_d596903b2f17.slice/crio-6c9b77596a8051294489cc81bb41e05fee3e463cde4dd8dbe521458d030689b2 WatchSource:0}: Error finding container 6c9b77596a8051294489cc81bb41e05fee3e463cde4dd8dbe521458d030689b2: Status 404 returned error can't find the container with id 6c9b77596a8051294489cc81bb41e05fee3e463cde4dd8dbe521458d030689b2
Jul 12 21:58:38.625423 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:38.625383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz" event={"ID":"4e4c4cfa-f9b5-457d-ad52-d596903b2f17","Type":"ContainerStarted","Data":"6c9b77596a8051294489cc81bb41e05fee3e463cde4dd8dbe521458d030689b2"}
Jul 12 21:58:38.626681 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:38.626655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n" event={"ID":"e034fdf5-9fa0-4802-9d44-27a34b083018","Type":"ContainerStarted","Data":"8a8f75ae676d1f2dd7d9cfbd423d93b676d48a91d2d8776820468042aaba8ce7"}
Jul 12 21:58:39.632415 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:39.632382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n" event={"ID":"e034fdf5-9fa0-4802-9d44-27a34b083018","Type":"ContainerStarted","Data":"ee402242bbc33608114a186550e93b905a776f951923737ac453d95018e3c933"}
Jul 12 21:58:39.632799 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:39.632460    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:58:39.683125 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:39.683063    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n" podStartSLOduration=1.225326663 podStartE2EDuration="2.683045854s" totalImagesPullingTime="1.457719191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:39.682172002 +0000 UTC m=+383.311003075" watchObservedRunningTime="2026-07-12 21:58:39.683045854 +0000 UTC m=+383.311876927"
Jul 12 21:58:41.644367 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:41.644335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz" event={"ID":"4e4c4cfa-f9b5-457d-ad52-d596903b2f17","Type":"ContainerStarted","Data":"a4637e1d47c0d7d4918caf1d05a5526641cda5418d77d7f30ddbcb4dd65ab8a0"}
Jul 12 21:58:41.663681 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:41.663627    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66b84d88d8-tk4pz" podStartSLOduration=2.21324081 podStartE2EDuration="4.663609536s" totalImagesPullingTime="2.450368726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:41.662608073 +0000 UTC m=+385.291439150" watchObservedRunningTime="2026-07-12 21:58:41.663609536 +0000 UTC m=+385.292440611"
Jul 12 21:58:50.640837 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:58:50.640804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-rkq6n"
Jul 12 21:59:53.238171 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.238129    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"]
Jul 12 21:59:53.241625 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.241606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.244358 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.244334    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 21:59:53.245347 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.245325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4vb66\""
Jul 12 21:59:53.245475 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.245345    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 21:59:53.250897 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.250871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"]
Jul 12 21:59:53.342689 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.342654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-944ht\" (UniqueName: \"kubernetes.io/projected/806f9222-796a-4424-82e6-7bed056aecae-kube-api-access-944ht\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.342865 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.342700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.342865 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.342813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.443385 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.443347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.443546 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.443399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-944ht\" (UniqueName: \"kubernetes.io/projected/806f9222-796a-4424-82e6-7bed056aecae-kube-api-access-944ht\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.443546 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.443514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.443747 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.443727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.443816 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.443800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.453531 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.453499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-944ht\" (UniqueName: \"kubernetes.io/projected/806f9222-796a-4424-82e6-7bed056aecae-kube-api-access-944ht\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.551847 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.551810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:53.690326 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.690299    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"]
Jul 12 21:59:53.692246 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:59:53.692219    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806f9222_796a_4424_82e6_7bed056aecae.slice/crio-6711f52c54d6c8e7e4b8ee52968029a1503bca14bee113090733b932cc0b9fd2 WatchSource:0}: Error finding container 6711f52c54d6c8e7e4b8ee52968029a1503bca14bee113090733b932cc0b9fd2: Status 404 returned error can't find the container with id 6711f52c54d6c8e7e4b8ee52968029a1503bca14bee113090733b932cc0b9fd2
Jul 12 21:59:53.816583 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.816512    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"]
Jul 12 21:59:53.819825 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.819807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.829141 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.829105    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"]
Jul 12 21:59:53.847221 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.847188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.847374 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.847233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmv2m\" (UniqueName: \"kubernetes.io/projected/0e29ccc1-c200-40d0-a186-99b3f41207ea-kube-api-access-hmv2m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.847374 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.847281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.948335 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.948294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.948335 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.948341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.948550 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.948372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmv2m\" (UniqueName: \"kubernetes.io/projected/0e29ccc1-c200-40d0-a186-99b3f41207ea-kube-api-access-hmv2m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.948702 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.948682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.948750 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.948698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.958078 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.958052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmv2m\" (UniqueName: \"kubernetes.io/projected/0e29ccc1-c200-40d0-a186-99b3f41207ea-kube-api-access-hmv2m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:53.988399 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.988369    2579 generic.go:356] "Generic (PLEG): container finished" podID="806f9222-796a-4424-82e6-7bed056aecae" containerID="51922f5db9dc3c8b752bb537c41a22a879e306e15c1e47ec06820cbdeb992395" exitCode=0
Jul 12 21:59:53.988536 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.988405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52" event={"ID":"806f9222-796a-4424-82e6-7bed056aecae","Type":"ContainerDied","Data":"51922f5db9dc3c8b752bb537c41a22a879e306e15c1e47ec06820cbdeb992395"}
Jul 12 21:59:53.988536 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:53.988441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52" event={"ID":"806f9222-796a-4424-82e6-7bed056aecae","Type":"ContainerStarted","Data":"6711f52c54d6c8e7e4b8ee52968029a1503bca14bee113090733b932cc0b9fd2"}
Jul 12 21:59:54.171207 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.171126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:54.221697 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.221344    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"]
Jul 12 21:59:54.225125 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.225086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.234852 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.234827    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"]
Jul 12 21:59:54.309489 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.309466    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"]
Jul 12 21:59:54.311611 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:59:54.311587    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e29ccc1_c200_40d0_a186_99b3f41207ea.slice/crio-35789308f588ca93674f88bc3012861669f11abc4d6c1e6981a0bb13942b28e9 WatchSource:0}: Error finding container 35789308f588ca93674f88bc3012861669f11abc4d6c1e6981a0bb13942b28e9: Status 404 returned error can't find the container with id 35789308f588ca93674f88bc3012861669f11abc4d6c1e6981a0bb13942b28e9
Jul 12 21:59:54.351850 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.351827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkwd\" (UniqueName: \"kubernetes.io/projected/cab8fa3a-151b-4ecd-aea1-163729527ccf-kube-api-access-lwkwd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.351960 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.351866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.352004 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.351989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.452666 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.452573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkwd\" (UniqueName: \"kubernetes.io/projected/cab8fa3a-151b-4ecd-aea1-163729527ccf-kube-api-access-lwkwd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.452666 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.452614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.452886 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.452674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.453000 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.452982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.453090 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.453040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.462473 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.462452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkwd\" (UniqueName: \"kubernetes.io/projected/cab8fa3a-151b-4ecd-aea1-163729527ccf-kube-api-access-lwkwd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.538330 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.538294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:54.635738 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.635704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"]
Jul 12 21:59:54.639189 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.639146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.653149 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.653121    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"]
Jul 12 21:59:54.703799 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.703777    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"]
Jul 12 21:59:54.705490 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:59:54.705466    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab8fa3a_151b_4ecd_aea1_163729527ccf.slice/crio-77ff6b95f1c8879f9357ad9269357c4b72dbb4e03c1e4770236c10906debae81 WatchSource:0}: Error finding container 77ff6b95f1c8879f9357ad9269357c4b72dbb4e03c1e4770236c10906debae81: Status 404 returned error can't find the container with id 77ff6b95f1c8879f9357ad9269357c4b72dbb4e03c1e4770236c10906debae81
Jul 12 21:59:54.755634 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.755605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.755792 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.755679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vwpj\" (UniqueName: \"kubernetes.io/projected/1d115f5f-6669-45ce-8aa3-e69385843c7c-kube-api-access-5vwpj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.755792 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.755712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.856981 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.856945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vwpj\" (UniqueName: \"kubernetes.io/projected/1d115f5f-6669-45ce-8aa3-e69385843c7c-kube-api-access-5vwpj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.856981 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.856982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.857235 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.857068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.857405 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.857384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.857457 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.857419    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.866488 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.866466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vwpj\" (UniqueName: \"kubernetes.io/projected/1d115f5f-6669-45ce-8aa3-e69385843c7c-kube-api-access-5vwpj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.951770 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.951729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:54.995449 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.995414    2579 generic.go:356] "Generic (PLEG): container finished" podID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerID="4b7a1dca886d0934d3c3b28ae4e0aa9e3e0f6bae761bc4dc8dead222bd1e9ea3" exitCode=0
Jul 12 21:59:54.995615 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.995493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k" event={"ID":"cab8fa3a-151b-4ecd-aea1-163729527ccf","Type":"ContainerDied","Data":"4b7a1dca886d0934d3c3b28ae4e0aa9e3e0f6bae761bc4dc8dead222bd1e9ea3"}
Jul 12 21:59:54.995615 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.995537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k" event={"ID":"cab8fa3a-151b-4ecd-aea1-163729527ccf","Type":"ContainerStarted","Data":"77ff6b95f1c8879f9357ad9269357c4b72dbb4e03c1e4770236c10906debae81"}
Jul 12 21:59:54.997589 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.997564    2579 generic.go:356] "Generic (PLEG): container finished" podID="806f9222-796a-4424-82e6-7bed056aecae" containerID="87711ab7f3215d45b55acfab04f45edbc74bdb3ccc4b59e4561ab93501c4fbb5" exitCode=0
Jul 12 21:59:54.997729 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:54.997635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52" event={"ID":"806f9222-796a-4424-82e6-7bed056aecae","Type":"ContainerDied","Data":"87711ab7f3215d45b55acfab04f45edbc74bdb3ccc4b59e4561ab93501c4fbb5"}
Jul 12 21:59:55.001867 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:55.001813    2579 generic.go:356] "Generic (PLEG): container finished" podID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerID="f5de8811adf1d09f6e2fc6b6f043c8903ce4900fba2dde91e582028c5d8cf430" exitCode=0
Jul 12 21:59:55.002008 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:55.001904    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx" event={"ID":"0e29ccc1-c200-40d0-a186-99b3f41207ea","Type":"ContainerDied","Data":"f5de8811adf1d09f6e2fc6b6f043c8903ce4900fba2dde91e582028c5d8cf430"}
Jul 12 21:59:55.002008 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:55.001993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx" event={"ID":"0e29ccc1-c200-40d0-a186-99b3f41207ea","Type":"ContainerStarted","Data":"35789308f588ca93674f88bc3012861669f11abc4d6c1e6981a0bb13942b28e9"}
Jul 12 21:59:55.096875 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:55.096846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"]
Jul 12 21:59:55.099426 ip-10-0-141-23 kubenswrapper[2579]: W0712 21:59:55.099396    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d115f5f_6669_45ce_8aa3_e69385843c7c.slice/crio-faa6725ce72c6aaa0efe77899f58f5d8f9c987de2413f21114d09265d49de619 WatchSource:0}: Error finding container faa6725ce72c6aaa0efe77899f58f5d8f9c987de2413f21114d09265d49de619: Status 404 returned error can't find the container with id faa6725ce72c6aaa0efe77899f58f5d8f9c987de2413f21114d09265d49de619
Jul 12 21:59:56.008812 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.008782    2579 generic.go:356] "Generic (PLEG): container finished" podID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerID="bd672c8c8a20ce7ab770209838569ddf98c073a381697d4db57fc3f966d75a09" exitCode=0
Jul 12 21:59:56.009220 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.008860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k" event={"ID":"cab8fa3a-151b-4ecd-aea1-163729527ccf","Type":"ContainerDied","Data":"bd672c8c8a20ce7ab770209838569ddf98c073a381697d4db57fc3f966d75a09"}
Jul 12 21:59:56.010409 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.010365    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerID="0206c989624311691beae844b4f9e1426e286daa4de5c3ee9883d1ebfe54b7aa" exitCode=0
Jul 12 21:59:56.010473 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.010453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j" event={"ID":"1d115f5f-6669-45ce-8aa3-e69385843c7c","Type":"ContainerDied","Data":"0206c989624311691beae844b4f9e1426e286daa4de5c3ee9883d1ebfe54b7aa"}
Jul 12 21:59:56.010519 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.010500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j" event={"ID":"1d115f5f-6669-45ce-8aa3-e69385843c7c","Type":"ContainerStarted","Data":"faa6725ce72c6aaa0efe77899f58f5d8f9c987de2413f21114d09265d49de619"}
Jul 12 21:59:56.012576 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.012555    2579 generic.go:356] "Generic (PLEG): container finished" podID="806f9222-796a-4424-82e6-7bed056aecae" containerID="ae848c088936eff83d7aa11d6e36adbcbecd95b91dc3a18f1b023bf4a6ba0898" exitCode=0
Jul 12 21:59:56.012696 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.012620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52" event={"ID":"806f9222-796a-4424-82e6-7bed056aecae","Type":"ContainerDied","Data":"ae848c088936eff83d7aa11d6e36adbcbecd95b91dc3a18f1b023bf4a6ba0898"}
Jul 12 21:59:56.014658 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.014635    2579 generic.go:356] "Generic (PLEG): container finished" podID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerID="e192f92f23b8357a496c6cd07e638d49ddae68ed5067a92ead1f6dc289e122fd" exitCode=0
Jul 12 21:59:56.014741 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:56.014672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx" event={"ID":"0e29ccc1-c200-40d0-a186-99b3f41207ea","Type":"ContainerDied","Data":"e192f92f23b8357a496c6cd07e638d49ddae68ed5067a92ead1f6dc289e122fd"}
Jul 12 21:59:57.021331 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.021243    2579 generic.go:356] "Generic (PLEG): container finished" podID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerID="dd28fac8b66d490b071572e3553e91a1c72dfd35c7b79bb10a561b95467c1ae7" exitCode=0
Jul 12 21:59:57.021724 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.021334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx" event={"ID":"0e29ccc1-c200-40d0-a186-99b3f41207ea","Type":"ContainerDied","Data":"dd28fac8b66d490b071572e3553e91a1c72dfd35c7b79bb10a561b95467c1ae7"}
Jul 12 21:59:57.023486 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.023462    2579 generic.go:356] "Generic (PLEG): container finished" podID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerID="86ece35e2d796d2f735961c9cb1651dce0a6f11cbd55bf1779a68af404d8f3fb" exitCode=0
Jul 12 21:59:57.023486 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.023484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k" event={"ID":"cab8fa3a-151b-4ecd-aea1-163729527ccf","Type":"ContainerDied","Data":"86ece35e2d796d2f735961c9cb1651dce0a6f11cbd55bf1779a68af404d8f3fb"}
Jul 12 21:59:57.025238 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.025218    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerID="26b1d4c84fbefa8c6663a94cc1f938cca45ce3cea931e9348049757f497f5476" exitCode=0
Jul 12 21:59:57.025342 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.025309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j" event={"ID":"1d115f5f-6669-45ce-8aa3-e69385843c7c","Type":"ContainerDied","Data":"26b1d4c84fbefa8c6663a94cc1f938cca45ce3cea931e9348049757f497f5476"}
Jul 12 21:59:57.161861 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.161834    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:57.277328 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.277233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-944ht\" (UniqueName: \"kubernetes.io/projected/806f9222-796a-4424-82e6-7bed056aecae-kube-api-access-944ht\") pod \"806f9222-796a-4424-82e6-7bed056aecae\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") "
Jul 12 21:59:57.277328 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.277281    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-bundle\") pod \"806f9222-796a-4424-82e6-7bed056aecae\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") "
Jul 12 21:59:57.277328 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.277299    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-util\") pod \"806f9222-796a-4424-82e6-7bed056aecae\" (UID: \"806f9222-796a-4424-82e6-7bed056aecae\") "
Jul 12 21:59:57.277757 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.277729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-bundle" (OuterVolumeSpecName: "bundle") pod "806f9222-796a-4424-82e6-7bed056aecae" (UID: "806f9222-796a-4424-82e6-7bed056aecae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:57.279806 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.279780    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/806f9222-796a-4424-82e6-7bed056aecae-kube-api-access-944ht" (OuterVolumeSpecName: "kube-api-access-944ht") pod "806f9222-796a-4424-82e6-7bed056aecae" (UID: "806f9222-796a-4424-82e6-7bed056aecae"). InnerVolumeSpecName "kube-api-access-944ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:59:57.282665 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.282637    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-util" (OuterVolumeSpecName: "util") pod "806f9222-796a-4424-82e6-7bed056aecae" (UID: "806f9222-796a-4424-82e6-7bed056aecae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:57.378215 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.378179    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-944ht\" (UniqueName: \"kubernetes.io/projected/806f9222-796a-4424-82e6-7bed056aecae-kube-api-access-944ht\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:57.378215 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.378208    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:57.378215 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:57.378218    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/806f9222-796a-4424-82e6-7bed056aecae-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:58.033200 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.033169    2579 generic.go:356] "Generic (PLEG): container finished" podID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerID="e1780bf18fb831c3e98463b76c8f1f9153c7e5df09fce8ba38e1757730d71f9a" exitCode=0
Jul 12 21:59:58.033619 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.033251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j" event={"ID":"1d115f5f-6669-45ce-8aa3-e69385843c7c","Type":"ContainerDied","Data":"e1780bf18fb831c3e98463b76c8f1f9153c7e5df09fce8ba38e1757730d71f9a"}
Jul 12 21:59:58.035065 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.035045    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52"
Jul 12 21:59:58.035199 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.035066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52" event={"ID":"806f9222-796a-4424-82e6-7bed056aecae","Type":"ContainerDied","Data":"6711f52c54d6c8e7e4b8ee52968029a1503bca14bee113090733b932cc0b9fd2"}
Jul 12 21:59:58.035199 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.035106    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6711f52c54d6c8e7e4b8ee52968029a1503bca14bee113090733b932cc0b9fd2"
Jul 12 21:59:58.174216 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.174185    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:58.206944 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.206919    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:58.286286 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286222    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-util\") pod \"cab8fa3a-151b-4ecd-aea1-163729527ccf\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") "
Jul 12 21:59:58.286286 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmv2m\" (UniqueName: \"kubernetes.io/projected/0e29ccc1-c200-40d0-a186-99b3f41207ea-kube-api-access-hmv2m\") pod \"0e29ccc1-c200-40d0-a186-99b3f41207ea\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") "
Jul 12 21:59:58.286441 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286306    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-util\") pod \"0e29ccc1-c200-40d0-a186-99b3f41207ea\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") "
Jul 12 21:59:58.286441 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286324    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-bundle\") pod \"cab8fa3a-151b-4ecd-aea1-163729527ccf\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") "
Jul 12 21:59:58.286441 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-bundle\") pod \"0e29ccc1-c200-40d0-a186-99b3f41207ea\" (UID: \"0e29ccc1-c200-40d0-a186-99b3f41207ea\") "
Jul 12 21:59:58.286441 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwkwd\" (UniqueName: \"kubernetes.io/projected/cab8fa3a-151b-4ecd-aea1-163729527ccf-kube-api-access-lwkwd\") pod \"cab8fa3a-151b-4ecd-aea1-163729527ccf\" (UID: \"cab8fa3a-151b-4ecd-aea1-163729527ccf\") "
Jul 12 21:59:58.287038 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.286980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-bundle" (OuterVolumeSpecName: "bundle") pod "0e29ccc1-c200-40d0-a186-99b3f41207ea" (UID: "0e29ccc1-c200-40d0-a186-99b3f41207ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:58.287175 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.287148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-bundle" (OuterVolumeSpecName: "bundle") pod "cab8fa3a-151b-4ecd-aea1-163729527ccf" (UID: "cab8fa3a-151b-4ecd-aea1-163729527ccf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:58.288743 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.288718    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab8fa3a-151b-4ecd-aea1-163729527ccf-kube-api-access-lwkwd" (OuterVolumeSpecName: "kube-api-access-lwkwd") pod "cab8fa3a-151b-4ecd-aea1-163729527ccf" (UID: "cab8fa3a-151b-4ecd-aea1-163729527ccf"). InnerVolumeSpecName "kube-api-access-lwkwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:59:58.288936 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.288914    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e29ccc1-c200-40d0-a186-99b3f41207ea-kube-api-access-hmv2m" (OuterVolumeSpecName: "kube-api-access-hmv2m") pod "0e29ccc1-c200-40d0-a186-99b3f41207ea" (UID: "0e29ccc1-c200-40d0-a186-99b3f41207ea"). InnerVolumeSpecName "kube-api-access-hmv2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:59:58.292119 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.292081    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-util" (OuterVolumeSpecName: "util") pod "cab8fa3a-151b-4ecd-aea1-163729527ccf" (UID: "cab8fa3a-151b-4ecd-aea1-163729527ccf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:58.292903 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.292885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-util" (OuterVolumeSpecName: "util") pod "0e29ccc1-c200-40d0-a186-99b3f41207ea" (UID: "0e29ccc1-c200-40d0-a186-99b3f41207ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:58.387868 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.387832    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:58.387868 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.387862    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmv2m\" (UniqueName: \"kubernetes.io/projected/0e29ccc1-c200-40d0-a186-99b3f41207ea-kube-api-access-hmv2m\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:58.387868 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.387872    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:58.388132 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.387880    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cab8fa3a-151b-4ecd-aea1-163729527ccf-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:58.388132 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.387888    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e29ccc1-c200-40d0-a186-99b3f41207ea-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:58.388132 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:58.387895    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwkwd\" (UniqueName: \"kubernetes.io/projected/cab8fa3a-151b-4ecd-aea1-163729527ccf-kube-api-access-lwkwd\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:59.041683 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.041651    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx"
Jul 12 21:59:59.042162 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.041683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx" event={"ID":"0e29ccc1-c200-40d0-a186-99b3f41207ea","Type":"ContainerDied","Data":"35789308f588ca93674f88bc3012861669f11abc4d6c1e6981a0bb13942b28e9"}
Jul 12 21:59:59.042162 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.041734    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35789308f588ca93674f88bc3012861669f11abc4d6c1e6981a0bb13942b28e9"
Jul 12 21:59:59.043835 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.043803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k" event={"ID":"cab8fa3a-151b-4ecd-aea1-163729527ccf","Type":"ContainerDied","Data":"77ff6b95f1c8879f9357ad9269357c4b72dbb4e03c1e4770236c10906debae81"}
Jul 12 21:59:59.044065 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.043853    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77ff6b95f1c8879f9357ad9269357c4b72dbb4e03c1e4770236c10906debae81"
Jul 12 21:59:59.044065 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.044052    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k"
Jul 12 21:59:59.175197 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.175174    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 21:59:59.294910 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.294880    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-bundle\") pod \"1d115f5f-6669-45ce-8aa3-e69385843c7c\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") "
Jul 12 21:59:59.295132 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.294942    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vwpj\" (UniqueName: \"kubernetes.io/projected/1d115f5f-6669-45ce-8aa3-e69385843c7c-kube-api-access-5vwpj\") pod \"1d115f5f-6669-45ce-8aa3-e69385843c7c\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") "
Jul 12 21:59:59.295132 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.294978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-util\") pod \"1d115f5f-6669-45ce-8aa3-e69385843c7c\" (UID: \"1d115f5f-6669-45ce-8aa3-e69385843c7c\") "
Jul 12 21:59:59.295422 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.295394    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-bundle" (OuterVolumeSpecName: "bundle") pod "1d115f5f-6669-45ce-8aa3-e69385843c7c" (UID: "1d115f5f-6669-45ce-8aa3-e69385843c7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:59.297319 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.297293    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d115f5f-6669-45ce-8aa3-e69385843c7c-kube-api-access-5vwpj" (OuterVolumeSpecName: "kube-api-access-5vwpj") pod "1d115f5f-6669-45ce-8aa3-e69385843c7c" (UID: "1d115f5f-6669-45ce-8aa3-e69385843c7c"). InnerVolumeSpecName "kube-api-access-5vwpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:59:59.300304 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.300282    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-util" (OuterVolumeSpecName: "util") pod "1d115f5f-6669-45ce-8aa3-e69385843c7c" (UID: "1d115f5f-6669-45ce-8aa3-e69385843c7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:59:59.396303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.396262    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-util\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:59.396303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.396295    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d115f5f-6669-45ce-8aa3-e69385843c7c-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 21:59:59.396303 ip-10-0-141-23 kubenswrapper[2579]: I0712 21:59:59.396306    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vwpj\" (UniqueName: \"kubernetes.io/projected/1d115f5f-6669-45ce-8aa3-e69385843c7c-kube-api-access-5vwpj\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:00.050626 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:00.050589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j" event={"ID":"1d115f5f-6669-45ce-8aa3-e69385843c7c","Type":"ContainerDied","Data":"faa6725ce72c6aaa0efe77899f58f5d8f9c987de2413f21114d09265d49de619"}
Jul 12 22:00:00.051002 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:00.050642    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faa6725ce72c6aaa0efe77899f58f5d8f9c987de2413f21114d09265d49de619"
Jul 12 22:00:00.051002 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:00.050600    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j"
Jul 12 22:00:20.162989 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.162951    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7fd8b4b8-xxbtw"]
Jul 12 22:00:20.163530 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163491    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="extract"
Jul 12 22:00:20.163530 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163511    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="extract"
Jul 12 22:00:20.163530 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163522    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="util"
Jul 12 22:00:20.163530 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163530    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="util"
Jul 12 22:00:20.163801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163542    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="util"
Jul 12 22:00:20.163801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163551    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="util"
Jul 12 22:00:20.163801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163565    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="extract"
Jul 12 22:00:20.163801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163576    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="extract"
Jul 12 22:00:20.163801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163586    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="extract"
Jul 12 22:00:20.163801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163595    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="extract"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.163979    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="util"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164012    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="util"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164056    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="pull"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164066    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="pull"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164099    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="pull"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164108    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="pull"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164118    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="extract"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164126    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="extract"
Jul 12 22:00:20.164154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164153    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="util"
Jul 12 22:00:20.164549 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164161    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="util"
Jul 12 22:00:20.164549 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164184    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="pull"
Jul 12 22:00:20.164549 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164193    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="pull"
Jul 12 22:00:20.164549 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164202    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="pull"
Jul 12 22:00:20.164549 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.164210    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="pull"
Jul 12 22:00:20.167379 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.167345    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e29ccc1-c200-40d0-a186-99b3f41207ea" containerName="extract"
Jul 12 22:00:20.167520 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.167391    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="806f9222-796a-4424-82e6-7bed056aecae" containerName="extract"
Jul 12 22:00:20.167520 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.167404    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab8fa3a-151b-4ecd-aea1-163729527ccf" containerName="extract"
Jul 12 22:00:20.167520 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.167415    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d115f5f-6669-45ce-8aa3-e69385843c7c" containerName="extract"
Jul 12 22:00:20.172985 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.172953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.177587 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.177554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7fd8b4b8-xxbtw"]
Jul 12 22:00:20.283391 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-service-ca\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.283559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-trusted-ca-bundle\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.283559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-oauth-serving-cert\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.283559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ee66af-1545-46dd-acfb-972945540650-console-serving-cert\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.283559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-console-config\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.283691 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0ee66af-1545-46dd-acfb-972945540650-console-oauth-config\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.283691 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.283636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjdkd\" (UniqueName: \"kubernetes.io/projected/c0ee66af-1545-46dd-acfb-972945540650-kube-api-access-bjdkd\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.384653 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-trusted-ca-bundle\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.384653 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-oauth-serving-cert\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.384866 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ee66af-1545-46dd-acfb-972945540650-console-serving-cert\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.384866 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-console-config\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.384937 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0ee66af-1545-46dd-acfb-972945540650-console-oauth-config\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.384937 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjdkd\" (UniqueName: \"kubernetes.io/projected/c0ee66af-1545-46dd-acfb-972945540650-kube-api-access-bjdkd\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.385008 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.384996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-service-ca\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.385634 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.385544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-console-config\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.385634 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.385584    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-oauth-serving-cert\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.385892 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.385707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-service-ca\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.385892 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.385873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ee66af-1545-46dd-acfb-972945540650-trusted-ca-bundle\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.387428 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.387407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0ee66af-1545-46dd-acfb-972945540650-console-oauth-config\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.387646 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.387622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ee66af-1545-46dd-acfb-972945540650-console-serving-cert\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.394827 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.394803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjdkd\" (UniqueName: \"kubernetes.io/projected/c0ee66af-1545-46dd-acfb-972945540650-kube-api-access-bjdkd\") pod \"console-f7fd8b4b8-xxbtw\" (UID: \"c0ee66af-1545-46dd-acfb-972945540650\") " pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.484863 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.484768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:20.635337 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:20.635312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7fd8b4b8-xxbtw"]
Jul 12 22:00:20.637221 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:00:20.637192    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee66af_1545_46dd_acfb_972945540650.slice/crio-25faa630e75ee6777001d3907db0725a2f5e20867d908c097ea686ebcc884b0f WatchSource:0}: Error finding container 25faa630e75ee6777001d3907db0725a2f5e20867d908c097ea686ebcc884b0f: Status 404 returned error can't find the container with id 25faa630e75ee6777001d3907db0725a2f5e20867d908c097ea686ebcc884b0f
Jul 12 22:00:21.161186 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:21.161152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7fd8b4b8-xxbtw" event={"ID":"c0ee66af-1545-46dd-acfb-972945540650","Type":"ContainerStarted","Data":"57f8cc4757f306258d904bffab6e2b04658dd78951e0e8082a13857144f5f4dc"}
Jul 12 22:00:21.161373 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:21.161199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7fd8b4b8-xxbtw" event={"ID":"c0ee66af-1545-46dd-acfb-972945540650","Type":"ContainerStarted","Data":"25faa630e75ee6777001d3907db0725a2f5e20867d908c097ea686ebcc884b0f"}
Jul 12 22:00:21.180617 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:21.180560    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f7fd8b4b8-xxbtw" podStartSLOduration=1.180544683 podStartE2EDuration="1.180544683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:00:21.178752536 +0000 UTC m=+484.807583612" watchObservedRunningTime="2026-07-12 22:00:21.180544683 +0000 UTC m=+484.809375757"
Jul 12 22:00:26.315436 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.315393    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"]
Jul 12 22:00:26.318917 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.318891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.321582 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.321559    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 22:00:26.322597 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.322575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 12 22:00:26.322774 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.322613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 12 22:00:26.322774 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.322574    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 22:00:26.322774 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.322582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4vb66\""
Jul 12 22:00:26.332424 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.332401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"]
Jul 12 22:00:26.436733 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.436699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da9f695b-3977-4e15-9077-f76036c56aa1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.436733 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.436735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da9f695b-3977-4e15-9077-f76036c56aa1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.436977 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.436816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv77l\" (UniqueName: \"kubernetes.io/projected/da9f695b-3977-4e15-9077-f76036c56aa1-kube-api-access-zv77l\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.537831 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.537794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da9f695b-3977-4e15-9077-f76036c56aa1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.537831 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.537832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da9f695b-3977-4e15-9077-f76036c56aa1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.538123 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.537973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv77l\" (UniqueName: \"kubernetes.io/projected/da9f695b-3977-4e15-9077-f76036c56aa1-kube-api-access-zv77l\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.538596 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.538526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da9f695b-3977-4e15-9077-f76036c56aa1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.540392 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.540369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da9f695b-3977-4e15-9077-f76036c56aa1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.546719 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.546692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv77l\" (UniqueName: \"kubernetes.io/projected/da9f695b-3977-4e15-9077-f76036c56aa1-kube-api-access-zv77l\") pod \"kuadrant-console-plugin-66b5774985-z6st2\" (UID: \"da9f695b-3977-4e15-9077-f76036c56aa1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.628580 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.628494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"
Jul 12 22:00:26.774087 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:26.774060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2"]
Jul 12 22:00:26.775713 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:00:26.775685    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda9f695b_3977_4e15_9077_f76036c56aa1.slice/crio-9abad19902d6b568534cb59fe446bfb375e73ecdadb9405b9c7ed8eac111e438 WatchSource:0}: Error finding container 9abad19902d6b568534cb59fe446bfb375e73ecdadb9405b9c7ed8eac111e438: Status 404 returned error can't find the container with id 9abad19902d6b568534cb59fe446bfb375e73ecdadb9405b9c7ed8eac111e438
Jul 12 22:00:27.189994 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:27.189959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2" event={"ID":"da9f695b-3977-4e15-9077-f76036c56aa1","Type":"ContainerStarted","Data":"9abad19902d6b568534cb59fe446bfb375e73ecdadb9405b9c7ed8eac111e438"}
Jul 12 22:00:30.485784 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:30.485734    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:30.486374 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:30.485859    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:30.492441 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:30.492410    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:31.225864 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:31.225750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7fd8b4b8-xxbtw"
Jul 12 22:00:31.295489 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:31.295124    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7f76d56f-nzdc9"]
Jul 12 22:00:48.315565 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:48.315523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2" event={"ID":"da9f695b-3977-4e15-9077-f76036c56aa1","Type":"ContainerStarted","Data":"5898e4e2a99452ee45fe75e74de223d78191a2075a9a0a8e14f38007f3d34caa"}
Jul 12 22:00:48.333009 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:48.332960    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z6st2" podStartSLOduration=0.931960231 podStartE2EDuration="22.332944431s" totalImagesPullingTime="21.4009842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:00:48.33205611 +0000 UTC m=+511.960887189" watchObservedRunningTime="2026-07-12 22:00:48.332944431 +0000 UTC m=+511.961775505"
Jul 12 22:00:56.328225 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.328155    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d7f76d56f-nzdc9" podUID="42e8d6ce-4e64-4d98-8c00-3580d302e4a9" containerName="console" containerID="cri-o://10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606" gracePeriod=15
Jul 12 22:00:56.574589 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.574557    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 22:00:56.718764 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718665    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7rrv\" (UniqueName: \"kubernetes.io/projected/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-kube-api-access-b7rrv\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.718764 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-oauth-config\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.718764 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718763    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-config\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.719089 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718779    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-serving-cert\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.719089 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-trusted-ca-bundle\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.719089 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-oauth-serving-cert\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.719089 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.718924    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-service-ca\") pod \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\" (UID: \"42e8d6ce-4e64-4d98-8c00-3580d302e4a9\") "
Jul 12 22:00:56.719283 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.719245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:00:56.719283 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.719259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-config" (OuterVolumeSpecName: "console-config") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:00:56.719396 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.719284    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:00:56.719396 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.719300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:00:56.721062 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.721038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:00:56.721199 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.721179    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-kube-api-access-b7rrv" (OuterVolumeSpecName: "kube-api-access-b7rrv") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "kube-api-access-b7rrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:00:56.721275 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.721259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42e8d6ce-4e64-4d98-8c00-3580d302e4a9" (UID: "42e8d6ce-4e64-4d98-8c00-3580d302e4a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:00:56.820685 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820643    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:56.820685 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820676    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:56.820685 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820689    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-trusted-ca-bundle\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:56.820956 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820703    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-oauth-serving-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:56.820956 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820716    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:56.820956 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820726    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7rrv\" (UniqueName: \"kubernetes.io/projected/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-kube-api-access-b7rrv\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:56.820956 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:56.820737    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e8d6ce-4e64-4d98-8c00-3580d302e4a9-console-oauth-config\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:00:57.360416 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.360384    2579 generic.go:356] "Generic (PLEG): container finished" podID="42e8d6ce-4e64-4d98-8c00-3580d302e4a9" containerID="10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606" exitCode=0
Jul 12 22:00:57.360827 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.360425    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7f76d56f-nzdc9"
Jul 12 22:00:57.360827 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.360460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7f76d56f-nzdc9" event={"ID":"42e8d6ce-4e64-4d98-8c00-3580d302e4a9","Type":"ContainerDied","Data":"10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606"}
Jul 12 22:00:57.360827 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.360511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7f76d56f-nzdc9" event={"ID":"42e8d6ce-4e64-4d98-8c00-3580d302e4a9","Type":"ContainerDied","Data":"bb088f894e65992d1877b6e26def4aa474c6973241cf9942d17fea001d2cf0ae"}
Jul 12 22:00:57.360827 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.360539    2579 scope.go:117] "RemoveContainer" containerID="10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606"
Jul 12 22:00:57.369753 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.369724    2579 scope.go:117] "RemoveContainer" containerID="10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606"
Jul 12 22:00:57.370277 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:00:57.370228    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606\": container with ID starting with 10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606 not found: ID does not exist" containerID="10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606"
Jul 12 22:00:57.370397 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.370285    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606"} err="failed to get container status \"10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606\": rpc error: code = NotFound desc = could not find container \"10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606\": container with ID starting with 10fee06eb5e61ad830b256a61281c5f43174dab18eae81bda1bd7d35c9c20606 not found: ID does not exist"
Jul 12 22:00:57.384069 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.384044    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7f76d56f-nzdc9"]
Jul 12 22:00:57.398538 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:57.398509    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d7f76d56f-nzdc9"]
Jul 12 22:00:58.938062 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:00:58.938010    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e8d6ce-4e64-4d98-8c00-3580d302e4a9" path="/var/lib/kubelet/pods/42e8d6ce-4e64-4d98-8c00-3580d302e4a9/volumes"
Jul 12 22:01:07.412524 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.412484    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:07.412971 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.412780    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e8d6ce-4e64-4d98-8c00-3580d302e4a9" containerName="console"
Jul 12 22:01:07.412971 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.412791    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e8d6ce-4e64-4d98-8c00-3580d302e4a9" containerName="console"
Jul 12 22:01:07.412971 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.412851    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e8d6ce-4e64-4d98-8c00-3580d302e4a9" containerName="console"
Jul 12 22:01:07.492555 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.492524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:07.492723 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.492630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.495372 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.495339    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 22:01:07.508621 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.508593    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:07.617655 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.617622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbzgv\" (UniqueName: \"kubernetes.io/projected/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-kube-api-access-wbzgv\") pod \"limitador-limitador-64c94fd64f-9d95p\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.617826 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.617687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-config-file\") pod \"limitador-limitador-64c94fd64f-9d95p\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.718173 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.718063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-config-file\") pod \"limitador-limitador-64c94fd64f-9d95p\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.718173 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.718141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbzgv\" (UniqueName: \"kubernetes.io/projected/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-kube-api-access-wbzgv\") pod \"limitador-limitador-64c94fd64f-9d95p\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.718688 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.718668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-config-file\") pod \"limitador-limitador-64c94fd64f-9d95p\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.728985 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.728948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbzgv\" (UniqueName: \"kubernetes.io/projected/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-kube-api-access-wbzgv\") pod \"limitador-limitador-64c94fd64f-9d95p\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.805640 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.805602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:07.965687 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:07.965611    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:07.969767 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:01:07.969705    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9bc174_7fbd_4866_9556_8abb1e63cfaa.slice/crio-2e80950fc14ced43613a5e3934af54148723cc646019a671d2e8f73bdacb1781 WatchSource:0}: Error finding container 2e80950fc14ced43613a5e3934af54148723cc646019a671d2e8f73bdacb1781: Status 404 returned error can't find the container with id 2e80950fc14ced43613a5e3934af54148723cc646019a671d2e8f73bdacb1781
Jul 12 22:01:08.421707 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.421673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p" event={"ID":"7a9bc174-7fbd-4866-9556-8abb1e63cfaa","Type":"ContainerStarted","Data":"2e80950fc14ced43613a5e3934af54148723cc646019a671d2e8f73bdacb1781"}
Jul 12 22:01:08.439902 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.439870    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-96v4v"]
Jul 12 22:01:08.478838 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.478807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-96v4v"]
Jul 12 22:01:08.478993 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.478901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:08.481758 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.481733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-58dxb\""
Jul 12 22:01:08.625630 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.625594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsd6\" (UniqueName: \"kubernetes.io/projected/9df76a0f-6fdb-4e50-85f1-6cfc22776937-kube-api-access-grsd6\") pod \"authorino-75d556bd77-96v4v\" (UID: \"9df76a0f-6fdb-4e50-85f1-6cfc22776937\") " pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:08.727089 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.726924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsd6\" (UniqueName: \"kubernetes.io/projected/9df76a0f-6fdb-4e50-85f1-6cfc22776937-kube-api-access-grsd6\") pod \"authorino-75d556bd77-96v4v\" (UID: \"9df76a0f-6fdb-4e50-85f1-6cfc22776937\") " pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:08.737699 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.737656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsd6\" (UniqueName: \"kubernetes.io/projected/9df76a0f-6fdb-4e50-85f1-6cfc22776937-kube-api-access-grsd6\") pod \"authorino-75d556bd77-96v4v\" (UID: \"9df76a0f-6fdb-4e50-85f1-6cfc22776937\") " pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:08.788128 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.788085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:08.988457 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:08.988386    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-96v4v"]
Jul 12 22:01:08.991427 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:01:08.991360    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df76a0f_6fdb_4e50_85f1_6cfc22776937.slice/crio-4ed2ac94eee9c94039e8e64e921298620018f6ba49cafa32682f6bd0a17979be WatchSource:0}: Error finding container 4ed2ac94eee9c94039e8e64e921298620018f6ba49cafa32682f6bd0a17979be: Status 404 returned error can't find the container with id 4ed2ac94eee9c94039e8e64e921298620018f6ba49cafa32682f6bd0a17979be
Jul 12 22:01:09.433288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:09.433246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-96v4v" event={"ID":"9df76a0f-6fdb-4e50-85f1-6cfc22776937","Type":"ContainerStarted","Data":"4ed2ac94eee9c94039e8e64e921298620018f6ba49cafa32682f6bd0a17979be"}
Jul 12 22:01:14.462742 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:14.462690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p" event={"ID":"7a9bc174-7fbd-4866-9556-8abb1e63cfaa","Type":"ContainerStarted","Data":"c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30"}
Jul 12 22:01:14.463505 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:14.462773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:14.464658 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:14.464596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-96v4v" event={"ID":"9df76a0f-6fdb-4e50-85f1-6cfc22776937","Type":"ContainerStarted","Data":"7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84"}
Jul 12 22:01:14.486054 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:14.482799    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p" podStartSLOduration=1.38653375 podStartE2EDuration="7.482759673s" totalImagesPullingTime="6.096225923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:14.480540194 +0000 UTC m=+538.109371269" watchObservedRunningTime="2026-07-12 22:01:14.482759673 +0000 UTC m=+538.111596234"
Jul 12 22:01:14.502617 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:14.502562    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-96v4v" podStartSLOduration=1.164170275 podStartE2EDuration="6.502544099s" totalImagesPullingTime="5.338373824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:14.500688219 +0000 UTC m=+538.129519293" watchObservedRunningTime="2026-07-12 22:01:14.502544099 +0000 UTC m=+538.131375172"
Jul 12 22:01:21.903378 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:21.903335    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:21.903815 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:21.903561    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p" podUID="7a9bc174-7fbd-4866-9556-8abb1e63cfaa" containerName="limitador" containerID="cri-o://c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30" gracePeriod=30
Jul 12 22:01:21.905811 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:21.905787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:22.459313 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.459290    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:22.504173 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.504081    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a9bc174-7fbd-4866-9556-8abb1e63cfaa" containerID="c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30" exitCode=0
Jul 12 22:01:22.504173 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.504129    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p"
Jul 12 22:01:22.504468 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.504165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p" event={"ID":"7a9bc174-7fbd-4866-9556-8abb1e63cfaa","Type":"ContainerDied","Data":"c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30"}
Jul 12 22:01:22.504468 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.504232    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9d95p" event={"ID":"7a9bc174-7fbd-4866-9556-8abb1e63cfaa","Type":"ContainerDied","Data":"2e80950fc14ced43613a5e3934af54148723cc646019a671d2e8f73bdacb1781"}
Jul 12 22:01:22.504468 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.504263    2579 scope.go:117] "RemoveContainer" containerID="c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30"
Jul 12 22:01:22.512793 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.512773    2579 scope.go:117] "RemoveContainer" containerID="c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30"
Jul 12 22:01:22.513063 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:01:22.513043    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30\": container with ID starting with c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30 not found: ID does not exist" containerID="c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30"
Jul 12 22:01:22.513113 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.513073    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30"} err="failed to get container status \"c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30\": rpc error: code = NotFound desc = could not find container \"c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30\": container with ID starting with c1c85329dd35e2049d7b23296c9f1d59b94866f7600dd5a4756feecf264aae30 not found: ID does not exist"
Jul 12 22:01:22.528442 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.528418    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbzgv\" (UniqueName: \"kubernetes.io/projected/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-kube-api-access-wbzgv\") pod \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") "
Jul 12 22:01:22.528529 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.528450    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-config-file\") pod \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\" (UID: \"7a9bc174-7fbd-4866-9556-8abb1e63cfaa\") "
Jul 12 22:01:22.528801 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.528780    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-config-file" (OuterVolumeSpecName: "config-file") pod "7a9bc174-7fbd-4866-9556-8abb1e63cfaa" (UID: "7a9bc174-7fbd-4866-9556-8abb1e63cfaa"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:01:22.530609 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.530583    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-kube-api-access-wbzgv" (OuterVolumeSpecName: "kube-api-access-wbzgv") pod "7a9bc174-7fbd-4866-9556-8abb1e63cfaa" (UID: "7a9bc174-7fbd-4866-9556-8abb1e63cfaa"). InnerVolumeSpecName "kube-api-access-wbzgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:01:22.628966 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.628925    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbzgv\" (UniqueName: \"kubernetes.io/projected/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-kube-api-access-wbzgv\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:01:22.628966 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.628961    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a9bc174-7fbd-4866-9556-8abb1e63cfaa-config-file\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:01:22.826639 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.826606    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:22.831316 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.831291    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9d95p"]
Jul 12 22:01:22.938004 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:22.937975    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a9bc174-7fbd-4866-9556-8abb1e63cfaa" path="/var/lib/kubelet/pods/7a9bc174-7fbd-4866-9556-8abb1e63cfaa/volumes"
Jul 12 22:01:24.053158 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.053127    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"]
Jul 12 22:01:24.053524 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.053456    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a9bc174-7fbd-4866-9556-8abb1e63cfaa" containerName="limitador"
Jul 12 22:01:24.053524 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.053467    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a9bc174-7fbd-4866-9556-8abb1e63cfaa" containerName="limitador"
Jul 12 22:01:24.053524 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.053520    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a9bc174-7fbd-4866-9556-8abb1e63cfaa" containerName="limitador"
Jul 12 22:01:24.058056 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.058036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.060822 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.060795    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 12 22:01:24.060941 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.060838    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:01:24.060941 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.060839    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:01:24.060941 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.060848    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gzg9k\""
Jul 12 22:01:24.069597 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.069574    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"]
Jul 12 22:01:24.139941 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.139892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/511148c4-556b-4fed-b9b2-396b88c10d6a-data\") pod \"postgres-69fb4594cf-82nbb\" (UID: \"511148c4-556b-4fed-b9b2-396b88c10d6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.140157 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.139962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7pr\" (UniqueName: \"kubernetes.io/projected/511148c4-556b-4fed-b9b2-396b88c10d6a-kube-api-access-fr7pr\") pod \"postgres-69fb4594cf-82nbb\" (UID: \"511148c4-556b-4fed-b9b2-396b88c10d6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.240639 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.240599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7pr\" (UniqueName: \"kubernetes.io/projected/511148c4-556b-4fed-b9b2-396b88c10d6a-kube-api-access-fr7pr\") pod \"postgres-69fb4594cf-82nbb\" (UID: \"511148c4-556b-4fed-b9b2-396b88c10d6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.240854 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.240676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/511148c4-556b-4fed-b9b2-396b88c10d6a-data\") pod \"postgres-69fb4594cf-82nbb\" (UID: \"511148c4-556b-4fed-b9b2-396b88c10d6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.241080 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.241059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/511148c4-556b-4fed-b9b2-396b88c10d6a-data\") pod \"postgres-69fb4594cf-82nbb\" (UID: \"511148c4-556b-4fed-b9b2-396b88c10d6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.250538 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.250515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7pr\" (UniqueName: \"kubernetes.io/projected/511148c4-556b-4fed-b9b2-396b88c10d6a-kube-api-access-fr7pr\") pod \"postgres-69fb4594cf-82nbb\" (UID: \"511148c4-556b-4fed-b9b2-396b88c10d6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.368601 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.368488    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:24.508994 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:24.508859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"]
Jul 12 22:01:24.511291 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:01:24.511258    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511148c4_556b_4fed_b9b2_396b88c10d6a.slice/crio-a62e67e87d88ec99ca2618d87a580bda61a8de4f1c240284c85a54074ebaeff2 WatchSource:0}: Error finding container a62e67e87d88ec99ca2618d87a580bda61a8de4f1c240284c85a54074ebaeff2: Status 404 returned error can't find the container with id a62e67e87d88ec99ca2618d87a580bda61a8de4f1c240284c85a54074ebaeff2
Jul 12 22:01:25.524792 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:25.524744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb" event={"ID":"511148c4-556b-4fed-b9b2-396b88c10d6a","Type":"ContainerStarted","Data":"a62e67e87d88ec99ca2618d87a580bda61a8de4f1c240284c85a54074ebaeff2"}
Jul 12 22:01:30.560909 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:30.560868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb" event={"ID":"511148c4-556b-4fed-b9b2-396b88c10d6a","Type":"ContainerStarted","Data":"7eaf1d092dd52731eb11bd35d065ce31a803758ef7adba121b81d202bb67b0ac"}
Jul 12 22:01:30.561374 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:30.561063    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:30.579089 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:30.579043    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb" podStartSLOduration=1.592273233 podStartE2EDuration="6.579014779s" totalImagesPullingTime="4.986741546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:30.577199979 +0000 UTC m=+554.206031056" watchObservedRunningTime="2026-07-12 22:01:30.579014779 +0000 UTC m=+554.207845890"
Jul 12 22:01:36.596950 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:36.596923    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-82nbb"
Jul 12 22:01:37.167926 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.167893    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bl96w"]
Jul 12 22:01:37.170208 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.170190    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:37.184841 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.184817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bl96w"]
Jul 12 22:01:37.256956 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.256918    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2h65\" (UniqueName: \"kubernetes.io/projected/1bb13e39-7a49-4cba-9e58-e5a560b736f3-kube-api-access-d2h65\") pod \"authorino-5d4b67c446-bl96w\" (UID: \"1bb13e39-7a49-4cba-9e58-e5a560b736f3\") " pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:37.357944 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.357907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2h65\" (UniqueName: \"kubernetes.io/projected/1bb13e39-7a49-4cba-9e58-e5a560b736f3-kube-api-access-d2h65\") pod \"authorino-5d4b67c446-bl96w\" (UID: \"1bb13e39-7a49-4cba-9e58-e5a560b736f3\") " pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:37.371199 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.371163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2h65\" (UniqueName: \"kubernetes.io/projected/1bb13e39-7a49-4cba-9e58-e5a560b736f3-kube-api-access-d2h65\") pod \"authorino-5d4b67c446-bl96w\" (UID: \"1bb13e39-7a49-4cba-9e58-e5a560b736f3\") " pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:37.420953 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.420877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bl96w"]
Jul 12 22:01:37.421165 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.421152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:37.457973 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.457934    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78f8bd474b-hwddn"]
Jul 12 22:01:37.461491 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.461465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:37.472360 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.472335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78f8bd474b-hwddn"]
Jul 12 22:01:37.559416 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.559379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcq2g\" (UniqueName: \"kubernetes.io/projected/3f75b4ec-b180-4aa6-a8ed-83292b177403-kube-api-access-gcq2g\") pod \"authorino-78f8bd474b-hwddn\" (UID: \"3f75b4ec-b180-4aa6-a8ed-83292b177403\") " pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:37.577876 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.577852    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bl96w"]
Jul 12 22:01:37.579885 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:01:37.579857    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bb13e39_7a49_4cba_9e58_e5a560b736f3.slice/crio-58ea67fd2008c625cb0ae5ec537744a178e08db3483b7b27c1f4ebf100d1637b WatchSource:0}: Error finding container 58ea67fd2008c625cb0ae5ec537744a178e08db3483b7b27c1f4ebf100d1637b: Status 404 returned error can't find the container with id 58ea67fd2008c625cb0ae5ec537744a178e08db3483b7b27c1f4ebf100d1637b
Jul 12 22:01:37.596635 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.596602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bl96w" event={"ID":"1bb13e39-7a49-4cba-9e58-e5a560b736f3","Type":"ContainerStarted","Data":"58ea67fd2008c625cb0ae5ec537744a178e08db3483b7b27c1f4ebf100d1637b"}
Jul 12 22:01:37.660269 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.660226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcq2g\" (UniqueName: \"kubernetes.io/projected/3f75b4ec-b180-4aa6-a8ed-83292b177403-kube-api-access-gcq2g\") pod \"authorino-78f8bd474b-hwddn\" (UID: \"3f75b4ec-b180-4aa6-a8ed-83292b177403\") " pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:37.670255 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.670230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcq2g\" (UniqueName: \"kubernetes.io/projected/3f75b4ec-b180-4aa6-a8ed-83292b177403-kube-api-access-gcq2g\") pod \"authorino-78f8bd474b-hwddn\" (UID: \"3f75b4ec-b180-4aa6-a8ed-83292b177403\") " pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:37.772598 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.772509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:37.788355 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.788324    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f8bd474b-hwddn"]
Jul 12 22:01:37.829645 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.829611    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b68676bcd-w74tz"]
Jul 12 22:01:37.833213 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.833189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:37.836337 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.836312    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 12 22:01:37.843456 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.843423    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b68676bcd-w74tz"]
Jul 12 22:01:37.912711 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.912684    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f8bd474b-hwddn"]
Jul 12 22:01:37.915181 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:01:37.915154    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f75b4ec_b180_4aa6_a8ed_83292b177403.slice/crio-5ca0829fc2eb3ce6bad9615b5505be3d0c763c3e7e6172357fccd6ec8b6f7b47 WatchSource:0}: Error finding container 5ca0829fc2eb3ce6bad9615b5505be3d0c763c3e7e6172357fccd6ec8b6f7b47: Status 404 returned error can't find the container with id 5ca0829fc2eb3ce6bad9615b5505be3d0c763c3e7e6172357fccd6ec8b6f7b47
Jul 12 22:01:37.962615 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.962589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jblch\" (UniqueName: \"kubernetes.io/projected/bbf1fc86-72a4-4f46-86ba-ea9777e90179-kube-api-access-jblch\") pod \"authorino-b68676bcd-w74tz\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") " pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:37.962728 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:37.962698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbf1fc86-72a4-4f46-86ba-ea9777e90179-tls-cert\") pod \"authorino-b68676bcd-w74tz\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") " pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:38.063422 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.063386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbf1fc86-72a4-4f46-86ba-ea9777e90179-tls-cert\") pod \"authorino-b68676bcd-w74tz\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") " pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:38.063673 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.063455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jblch\" (UniqueName: \"kubernetes.io/projected/bbf1fc86-72a4-4f46-86ba-ea9777e90179-kube-api-access-jblch\") pod \"authorino-b68676bcd-w74tz\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") " pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:38.066100 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.066081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbf1fc86-72a4-4f46-86ba-ea9777e90179-tls-cert\") pod \"authorino-b68676bcd-w74tz\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") " pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:38.071878 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.071860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jblch\" (UniqueName: \"kubernetes.io/projected/bbf1fc86-72a4-4f46-86ba-ea9777e90179-kube-api-access-jblch\") pod \"authorino-b68676bcd-w74tz\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") " pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:38.144686 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.144651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:01:38.292639 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.292612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b68676bcd-w74tz"]
Jul 12 22:01:38.294258 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:01:38.294231    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbf1fc86_72a4_4f46_86ba_ea9777e90179.slice/crio-af3e51ac35f06b229f4d33881e100c1d358da63cc6a885599797b83dd6d83fe9 WatchSource:0}: Error finding container af3e51ac35f06b229f4d33881e100c1d358da63cc6a885599797b83dd6d83fe9: Status 404 returned error can't find the container with id af3e51ac35f06b229f4d33881e100c1d358da63cc6a885599797b83dd6d83fe9
Jul 12 22:01:38.603925 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.603896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f8bd474b-hwddn" event={"ID":"3f75b4ec-b180-4aa6-a8ed-83292b177403","Type":"ContainerStarted","Data":"401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a"}
Jul 12 22:01:38.603925 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.603914    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-78f8bd474b-hwddn" podUID="3f75b4ec-b180-4aa6-a8ed-83292b177403" containerName="authorino" containerID="cri-o://401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a" gracePeriod=30
Jul 12 22:01:38.604169 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.603938    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f8bd474b-hwddn" event={"ID":"3f75b4ec-b180-4aa6-a8ed-83292b177403","Type":"ContainerStarted","Data":"5ca0829fc2eb3ce6bad9615b5505be3d0c763c3e7e6172357fccd6ec8b6f7b47"}
Jul 12 22:01:38.606161 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.606009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bl96w" event={"ID":"1bb13e39-7a49-4cba-9e58-e5a560b736f3","Type":"ContainerStarted","Data":"2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d"}
Jul 12 22:01:38.606161 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.606037    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bl96w" podUID="1bb13e39-7a49-4cba-9e58-e5a560b736f3" containerName="authorino" containerID="cri-o://2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d" gracePeriod=30
Jul 12 22:01:38.608416 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.608389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b68676bcd-w74tz" event={"ID":"bbf1fc86-72a4-4f46-86ba-ea9777e90179","Type":"ContainerStarted","Data":"af3e51ac35f06b229f4d33881e100c1d358da63cc6a885599797b83dd6d83fe9"}
Jul 12 22:01:38.625984 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.625795    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78f8bd474b-hwddn" podStartSLOduration=1.335922152 podStartE2EDuration="1.625759971s" totalImagesPullingTime="289.837819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:38.623116615 +0000 UTC m=+562.251947688" watchObservedRunningTime="2026-07-12 22:01:38.625759971 +0000 UTC m=+562.254591051"
Jul 12 22:01:38.640594 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.640541    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bl96w" podStartSLOduration=1.316072602 podStartE2EDuration="1.640525533s" totalImagesPullingTime="324.452931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:38.639000931 +0000 UTC m=+562.267832004" watchObservedRunningTime="2026-07-12 22:01:38.640525533 +0000 UTC m=+562.269356607"
Jul 12 22:01:38.880553 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.880521    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:38.883518 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.883493    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:38.971964 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.971928    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcq2g\" (UniqueName: \"kubernetes.io/projected/3f75b4ec-b180-4aa6-a8ed-83292b177403-kube-api-access-gcq2g\") pod \"3f75b4ec-b180-4aa6-a8ed-83292b177403\" (UID: \"3f75b4ec-b180-4aa6-a8ed-83292b177403\") "
Jul 12 22:01:38.972144 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.971996    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2h65\" (UniqueName: \"kubernetes.io/projected/1bb13e39-7a49-4cba-9e58-e5a560b736f3-kube-api-access-d2h65\") pod \"1bb13e39-7a49-4cba-9e58-e5a560b736f3\" (UID: \"1bb13e39-7a49-4cba-9e58-e5a560b736f3\") "
Jul 12 22:01:38.974234 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.974201    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f75b4ec-b180-4aa6-a8ed-83292b177403-kube-api-access-gcq2g" (OuterVolumeSpecName: "kube-api-access-gcq2g") pod "3f75b4ec-b180-4aa6-a8ed-83292b177403" (UID: "3f75b4ec-b180-4aa6-a8ed-83292b177403"). InnerVolumeSpecName "kube-api-access-gcq2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:01:38.974351 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:38.974239    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb13e39-7a49-4cba-9e58-e5a560b736f3-kube-api-access-d2h65" (OuterVolumeSpecName: "kube-api-access-d2h65") pod "1bb13e39-7a49-4cba-9e58-e5a560b736f3" (UID: "1bb13e39-7a49-4cba-9e58-e5a560b736f3"). InnerVolumeSpecName "kube-api-access-d2h65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:01:39.073565 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.073533    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcq2g\" (UniqueName: \"kubernetes.io/projected/3f75b4ec-b180-4aa6-a8ed-83292b177403-kube-api-access-gcq2g\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:01:39.073565 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.073563    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2h65\" (UniqueName: \"kubernetes.io/projected/1bb13e39-7a49-4cba-9e58-e5a560b736f3-kube-api-access-d2h65\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:01:39.614782 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.614746    2579 generic.go:356] "Generic (PLEG): container finished" podID="3f75b4ec-b180-4aa6-a8ed-83292b177403" containerID="401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a" exitCode=0
Jul 12 22:01:39.614930 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.614793    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f8bd474b-hwddn"
Jul 12 22:01:39.614930 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.614836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f8bd474b-hwddn" event={"ID":"3f75b4ec-b180-4aa6-a8ed-83292b177403","Type":"ContainerDied","Data":"401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a"}
Jul 12 22:01:39.614930 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.614883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f8bd474b-hwddn" event={"ID":"3f75b4ec-b180-4aa6-a8ed-83292b177403","Type":"ContainerDied","Data":"5ca0829fc2eb3ce6bad9615b5505be3d0c763c3e7e6172357fccd6ec8b6f7b47"}
Jul 12 22:01:39.614930 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.614905    2579 scope.go:117] "RemoveContainer" containerID="401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a"
Jul 12 22:01:39.624183 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.623999    2579 generic.go:356] "Generic (PLEG): container finished" podID="1bb13e39-7a49-4cba-9e58-e5a560b736f3" containerID="2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d" exitCode=0
Jul 12 22:01:39.624183 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.624141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bl96w" event={"ID":"1bb13e39-7a49-4cba-9e58-e5a560b736f3","Type":"ContainerDied","Data":"2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d"}
Jul 12 22:01:39.624183 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.624159    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bl96w"
Jul 12 22:01:39.624417 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.624189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bl96w" event={"ID":"1bb13e39-7a49-4cba-9e58-e5a560b736f3","Type":"ContainerDied","Data":"58ea67fd2008c625cb0ae5ec537744a178e08db3483b7b27c1f4ebf100d1637b"}
Jul 12 22:01:39.626526 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.626395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b68676bcd-w74tz" event={"ID":"bbf1fc86-72a4-4f46-86ba-ea9777e90179","Type":"ContainerStarted","Data":"2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6"}
Jul 12 22:01:39.632616 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.632597    2579 scope.go:117] "RemoveContainer" containerID="401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a"
Jul 12 22:01:39.632919 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:01:39.632892    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a\": container with ID starting with 401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a not found: ID does not exist" containerID="401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a"
Jul 12 22:01:39.633012 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.632927    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a"} err="failed to get container status \"401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a\": rpc error: code = NotFound desc = could not find container \"401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a\": container with ID starting with 401da8d9b4540a7dc13b641f0e9eae58910b239f36d6248e7350632101b5769a not found: ID does not exist"
Jul 12 22:01:39.633012 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.632949    2579 scope.go:117] "RemoveContainer" containerID="2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d"
Jul 12 22:01:39.641910 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.641888    2579 scope.go:117] "RemoveContainer" containerID="2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d"
Jul 12 22:01:39.642213 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:01:39.642192    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d\": container with ID starting with 2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d not found: ID does not exist" containerID="2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d"
Jul 12 22:01:39.642272 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.642224    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d"} err="failed to get container status \"2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d\": rpc error: code = NotFound desc = could not find container \"2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d\": container with ID starting with 2ee19b3adc07cb8ff2f0041019eaabe9fb67df3262da3e09e9f90326a450e97d not found: ID does not exist"
Jul 12 22:01:39.645992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.645946    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b68676bcd-w74tz" podStartSLOduration=2.347546251 podStartE2EDuration="2.645931858s" totalImagesPullingTime="298.385607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:39.643780182 +0000 UTC m=+563.272611258" watchObservedRunningTime="2026-07-12 22:01:39.645931858 +0000 UTC m=+563.274762934"
Jul 12 22:01:39.663482 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.663448    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f8bd474b-hwddn"]
Jul 12 22:01:39.669757 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.669728    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78f8bd474b-hwddn"]
Jul 12 22:01:39.675752 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.675721    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-96v4v"]
Jul 12 22:01:39.675901 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.675884    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-96v4v" podUID="9df76a0f-6fdb-4e50-85f1-6cfc22776937" containerName="authorino" containerID="cri-o://7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84" gracePeriod=30
Jul 12 22:01:39.683225 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.682914    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bl96w"]
Jul 12 22:01:39.687382 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.687343    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bl96w"]
Jul 12 22:01:39.927273 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.927249    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:39.981116 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.981087    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grsd6\" (UniqueName: \"kubernetes.io/projected/9df76a0f-6fdb-4e50-85f1-6cfc22776937-kube-api-access-grsd6\") pod \"9df76a0f-6fdb-4e50-85f1-6cfc22776937\" (UID: \"9df76a0f-6fdb-4e50-85f1-6cfc22776937\") "
Jul 12 22:01:39.983319 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:39.983294    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df76a0f-6fdb-4e50-85f1-6cfc22776937-kube-api-access-grsd6" (OuterVolumeSpecName: "kube-api-access-grsd6") pod "9df76a0f-6fdb-4e50-85f1-6cfc22776937" (UID: "9df76a0f-6fdb-4e50-85f1-6cfc22776937"). InnerVolumeSpecName "kube-api-access-grsd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:01:40.081914 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.081863    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grsd6\" (UniqueName: \"kubernetes.io/projected/9df76a0f-6fdb-4e50-85f1-6cfc22776937-kube-api-access-grsd6\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:01:40.634466 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.634431    2579 generic.go:356] "Generic (PLEG): container finished" podID="9df76a0f-6fdb-4e50-85f1-6cfc22776937" containerID="7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84" exitCode=0
Jul 12 22:01:40.634672 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.634475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-96v4v"
Jul 12 22:01:40.634672 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.634521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-96v4v" event={"ID":"9df76a0f-6fdb-4e50-85f1-6cfc22776937","Type":"ContainerDied","Data":"7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84"}
Jul 12 22:01:40.634672 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.634563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-96v4v" event={"ID":"9df76a0f-6fdb-4e50-85f1-6cfc22776937","Type":"ContainerDied","Data":"4ed2ac94eee9c94039e8e64e921298620018f6ba49cafa32682f6bd0a17979be"}
Jul 12 22:01:40.634672 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.634585    2579 scope.go:117] "RemoveContainer" containerID="7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84"
Jul 12 22:01:40.643785 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.643768    2579 scope.go:117] "RemoveContainer" containerID="7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84"
Jul 12 22:01:40.644082 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:01:40.644062    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84\": container with ID starting with 7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84 not found: ID does not exist" containerID="7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84"
Jul 12 22:01:40.644153 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.644094    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84"} err="failed to get container status \"7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84\": rpc error: code = NotFound desc = could not find container \"7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84\": container with ID starting with 7701cd31467b831198b4f6827a3632ab14b17a926b269c0d88f61a6f2aacfd84 not found: ID does not exist"
Jul 12 22:01:40.657239 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.657216    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-96v4v"]
Jul 12 22:01:40.661461 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.661439    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-96v4v"]
Jul 12 22:01:40.937189 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.937107    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb13e39-7a49-4cba-9e58-e5a560b736f3" path="/var/lib/kubelet/pods/1bb13e39-7a49-4cba-9e58-e5a560b736f3/volumes"
Jul 12 22:01:40.937569 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.937428    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f75b4ec-b180-4aa6-a8ed-83292b177403" path="/var/lib/kubelet/pods/3f75b4ec-b180-4aa6-a8ed-83292b177403/volumes"
Jul 12 22:01:40.937699 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:01:40.937687    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df76a0f-6fdb-4e50-85f1-6cfc22776937" path="/var/lib/kubelet/pods/9df76a0f-6fdb-4e50-85f1-6cfc22776937/volumes"
Jul 12 22:02:16.828381 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:16.828354    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:02:16.832381 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:16.832359    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:02:16.833874 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:16.833859    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:02:16.838117 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:16.838096    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:02:54.327448 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327400    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"]
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327730    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb13e39-7a49-4cba-9e58-e5a560b736f3" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327741    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb13e39-7a49-4cba-9e58-e5a560b736f3" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327750    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f75b4ec-b180-4aa6-a8ed-83292b177403" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f75b4ec-b180-4aa6-a8ed-83292b177403" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327763    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df76a0f-6fdb-4e50-85f1-6cfc22776937" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327770    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df76a0f-6fdb-4e50-85f1-6cfc22776937" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327826    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df76a0f-6fdb-4e50-85f1-6cfc22776937" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327836    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb13e39-7a49-4cba-9e58-e5a560b736f3" containerName="authorino"
Jul 12 22:02:54.329992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.327842    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f75b4ec-b180-4aa6-a8ed-83292b177403" containerName="authorino"
Jul 12 22:02:54.330877 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.330861    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.333718 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.333696    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 22:02:54.334852 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.334827    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 12 22:02:54.334954 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.334863    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 22:02:54.335043 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.334984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z87st\""
Jul 12 22:02:54.344355 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.344333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"]
Jul 12 22:02:54.413002 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.412962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.413002 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.413008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfj66\" (UniqueName: \"kubernetes.io/projected/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-kube-api-access-kfj66\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.413257 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.413066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.413257 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.413162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.413257 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.413209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.413351 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.413261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514388 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514521 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514521 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514521 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfj66\" (UniqueName: \"kubernetes.io/projected/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-kube-api-access-kfj66\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514521 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514521 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514845 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514925 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.514974 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.514927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.516839 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.516816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.517098 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.517081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.523733 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.523705    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfj66\" (UniqueName: \"kubernetes.io/projected/6dc67064-c7a9-4e47-9dbe-b38131b2a2cb-kube-api-access-kfj66\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5vcq\" (UID: \"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.640951 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.640850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:02:54.783452 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.783404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"]
Jul 12 22:02:54.787394 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:02:54.787358    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc67064_c7a9_4e47_9dbe_b38131b2a2cb.slice/crio-f3fb10064b551f0ed690426ca087cccd4bd505f5db6f0fcf718b9a869e30bae4 WatchSource:0}: Error finding container f3fb10064b551f0ed690426ca087cccd4bd505f5db6f0fcf718b9a869e30bae4: Status 404 returned error can't find the container with id f3fb10064b551f0ed690426ca087cccd4bd505f5db6f0fcf718b9a869e30bae4
Jul 12 22:02:54.788624 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:54.788602    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:02:55.003898 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:55.003810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq" event={"ID":"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb","Type":"ContainerStarted","Data":"f3fb10064b551f0ed690426ca087cccd4bd505f5db6f0fcf718b9a869e30bae4"}
Jul 12 22:02:56.010999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:56.010966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq" event={"ID":"6dc67064-c7a9-4e47-9dbe-b38131b2a2cb","Type":"ContainerStarted","Data":"aac4a391e5df49afee878819fcd7a7d5413ffea97ce63aae31ccff0989964f27"}
Jul 12 22:02:56.031133 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:02:56.031069    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq" podStartSLOduration=0.917390316 podStartE2EDuration="2.031046103s" totalImagesPullingTime="1.113655787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:02:56.028720327 +0000 UTC m=+639.657551402" watchObservedRunningTime="2026-07-12 22:02:56.031046103 +0000 UTC m=+639.659877180"
Jul 12 22:03:00.846517 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.846481    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"]
Jul 12 22:03:00.849853 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.849833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:00.852951 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.852930    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 12 22:03:00.861075 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.861050    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"]
Jul 12 22:03:00.971483 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.971453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:00.971483 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.971494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j94t6\" (UniqueName: \"kubernetes.io/projected/73b56d92-26d1-4654-a809-8089486d16e4-kube-api-access-j94t6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:00.971707 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.971592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:00.971707 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.971618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:00.971707 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.971638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:00.971824 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:00.971704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b56d92-26d1-4654-a809-8089486d16e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.072524 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.072524 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.072739 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.072739 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b56d92-26d1-4654-a809-8089486d16e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.072739 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.072739 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j94t6\" (UniqueName: \"kubernetes.io/projected/73b56d92-26d1-4654-a809-8089486d16e4-kube-api-access-j94t6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.073015 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.072989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.073151 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.073130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.073243 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.073225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.075147 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.075128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73b56d92-26d1-4654-a809-8089486d16e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.075328 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.075312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b56d92-26d1-4654-a809-8089486d16e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.080896 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.080869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j94t6\" (UniqueName: \"kubernetes.io/projected/73b56d92-26d1-4654-a809-8089486d16e4-kube-api-access-j94t6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nknkh\" (UID: \"73b56d92-26d1-4654-a809-8089486d16e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.160582 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.160489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:01.298698 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:01.298667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"]
Jul 12 22:03:01.300475 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:03:01.300450    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b56d92_26d1_4654_a809_8089486d16e4.slice/crio-eb72897c961120c8f39749328d2e103eb96824ea82a2d9c56092606e5757575a WatchSource:0}: Error finding container eb72897c961120c8f39749328d2e103eb96824ea82a2d9c56092606e5757575a: Status 404 returned error can't find the container with id eb72897c961120c8f39749328d2e103eb96824ea82a2d9c56092606e5757575a
Jul 12 22:03:02.041936 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:02.041903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh" event={"ID":"73b56d92-26d1-4654-a809-8089486d16e4","Type":"ContainerStarted","Data":"6e8c4804d8bf8e6246dd4cec65937da22094786513a2696e22d7ae8b4357a9c7"}
Jul 12 22:03:02.042345 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:02.041954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh" event={"ID":"73b56d92-26d1-4654-a809-8089486d16e4","Type":"ContainerStarted","Data":"eb72897c961120c8f39749328d2e103eb96824ea82a2d9c56092606e5757575a"}
Jul 12 22:03:02.063420 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:02.063370    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh" podStartSLOduration=1.875994882 podStartE2EDuration="2.063350552s" totalImagesPullingTime="187.35567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:03:02.062841352 +0000 UTC m=+645.691672427" watchObservedRunningTime="2026-07-12 22:03:02.063350552 +0000 UTC m=+645.692181629"
Jul 12 22:03:04.641967 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:04.641929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:03:04.642413 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:04.641996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:03:04.654591 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:04.654560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:03:05.069556 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:05.069525    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5vcq"
Jul 12 22:03:11.160792 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:11.160755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:11.161207 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:11.160906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:11.173591 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:11.173566    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:12.104368 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:12.104338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nknkh"
Jul 12 22:03:44.247494 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.247457    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"]
Jul 12 22:03:44.251083 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.251058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.254139 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.254107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 12 22:03:44.266378 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.266352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"]
Jul 12 22:03:44.359780 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.359743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.359987 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.359813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.359987 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.359899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.359987 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.359928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.359987 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.359954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqwg4\" (UniqueName: \"kubernetes.io/projected/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-kube-api-access-jqwg4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.360183 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.360000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.460762 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.460722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqwg4\" (UniqueName: \"kubernetes.io/projected/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-kube-api-access-jqwg4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.460762 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.460769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461008 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.460955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461088 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.461063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461150 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.461130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461202 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.461150    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461202 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.461156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461329 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.461307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.461435 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.461417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.463612 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.463582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.463744 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.463729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.469526 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.469501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqwg4\" (UniqueName: \"kubernetes.io/projected/fb7ba6d9-603c-4101-b6b2-5058ed6f480a-kube-api-access-jqwg4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q\" (UID: \"fb7ba6d9-603c-4101-b6b2-5058ed6f480a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.560936 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.560889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:44.710136 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:44.707577    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"]
Jul 12 22:03:44.711594 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:03:44.711568    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb7ba6d9_603c_4101_b6b2_5058ed6f480a.slice/crio-9b51bd638db150d8b010670f5a2654016d6a7b8dd69598c26d702c2e4d157e9e WatchSource:0}: Error finding container 9b51bd638db150d8b010670f5a2654016d6a7b8dd69598c26d702c2e4d157e9e: Status 404 returned error can't find the container with id 9b51bd638db150d8b010670f5a2654016d6a7b8dd69598c26d702c2e4d157e9e
Jul 12 22:03:45.263317 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:45.263213    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q" event={"ID":"fb7ba6d9-603c-4101-b6b2-5058ed6f480a","Type":"ContainerStarted","Data":"152a7c2485fcb0b71938149404e8685038ac14f51a1bdb5b7a8ea6c8220dde87"}
Jul 12 22:03:45.263317 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:45.263262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q" event={"ID":"fb7ba6d9-603c-4101-b6b2-5058ed6f480a","Type":"ContainerStarted","Data":"9b51bd638db150d8b010670f5a2654016d6a7b8dd69598c26d702c2e4d157e9e"}
Jul 12 22:03:45.284040 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:45.283981    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q" podStartSLOduration=1.106960674 podStartE2EDuration="1.283965141s" totalImagesPullingTime="177.004467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:03:45.282879631 +0000 UTC m=+688.911710720" watchObservedRunningTime="2026-07-12 22:03:45.283965141 +0000 UTC m=+688.912796215"
Jul 12 22:03:54.561385 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:54.561347    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:54.561803 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:54.561398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:54.574240 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:54.574202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:03:55.326527 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:03:55.326491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q"
Jul 12 22:05:32.896361 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:32.896326    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b68676bcd-w74tz"]
Jul 12 22:05:32.897324 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:32.896513    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b68676bcd-w74tz" podUID="bbf1fc86-72a4-4f46-86ba-ea9777e90179" containerName="authorino" containerID="cri-o://2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6" gracePeriod=30
Jul 12 22:05:33.145304 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.145274    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:05:33.318341 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.318303    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jblch\" (UniqueName: \"kubernetes.io/projected/bbf1fc86-72a4-4f46-86ba-ea9777e90179-kube-api-access-jblch\") pod \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") "
Jul 12 22:05:33.318553 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.318362    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbf1fc86-72a4-4f46-86ba-ea9777e90179-tls-cert\") pod \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\" (UID: \"bbf1fc86-72a4-4f46-86ba-ea9777e90179\") "
Jul 12 22:05:33.320634 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.320604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf1fc86-72a4-4f46-86ba-ea9777e90179-kube-api-access-jblch" (OuterVolumeSpecName: "kube-api-access-jblch") pod "bbf1fc86-72a4-4f46-86ba-ea9777e90179" (UID: "bbf1fc86-72a4-4f46-86ba-ea9777e90179"). InnerVolumeSpecName "kube-api-access-jblch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:05:33.329316 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.329285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf1fc86-72a4-4f46-86ba-ea9777e90179-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bbf1fc86-72a4-4f46-86ba-ea9777e90179" (UID: "bbf1fc86-72a4-4f46-86ba-ea9777e90179"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:05:33.419706 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.419670    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jblch\" (UniqueName: \"kubernetes.io/projected/bbf1fc86-72a4-4f46-86ba-ea9777e90179-kube-api-access-jblch\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:05:33.419706 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.419700    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbf1fc86-72a4-4f46-86ba-ea9777e90179-tls-cert\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:05:33.836063 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.836006    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbf1fc86-72a4-4f46-86ba-ea9777e90179" containerID="2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6" exitCode=0
Jul 12 22:05:33.836236 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.836087    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b68676bcd-w74tz"
Jul 12 22:05:33.836236 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.836097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b68676bcd-w74tz" event={"ID":"bbf1fc86-72a4-4f46-86ba-ea9777e90179","Type":"ContainerDied","Data":"2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6"}
Jul 12 22:05:33.836236 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.836143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b68676bcd-w74tz" event={"ID":"bbf1fc86-72a4-4f46-86ba-ea9777e90179","Type":"ContainerDied","Data":"af3e51ac35f06b229f4d33881e100c1d358da63cc6a885599797b83dd6d83fe9"}
Jul 12 22:05:33.836236 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.836166    2579 scope.go:117] "RemoveContainer" containerID="2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6"
Jul 12 22:05:33.845465 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.845447    2579 scope.go:117] "RemoveContainer" containerID="2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6"
Jul 12 22:05:33.845787 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:05:33.845768    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6\": container with ID starting with 2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6 not found: ID does not exist" containerID="2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6"
Jul 12 22:05:33.845840 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.845797    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6"} err="failed to get container status \"2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6\": rpc error: code = NotFound desc = could not find container \"2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6\": container with ID starting with 2038b80dfad17734205155bfab2874a0b29fa9cec0d1098f921d5353e2fe5bd6 not found: ID does not exist"
Jul 12 22:05:33.863163 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.863122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b68676bcd-w74tz"]
Jul 12 22:05:33.869394 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:33.869371    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b68676bcd-w74tz"]
Jul 12 22:05:34.937696 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:05:34.937661    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf1fc86-72a4-4f46-86ba-ea9777e90179" path="/var/lib/kubelet/pods/bbf1fc86-72a4-4f46-86ba-ea9777e90179/volumes"
Jul 12 22:07:16.862740 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:07:16.862660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:07:16.863573 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:07:16.863547    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:07:16.868850 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:07:16.868824    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:07:16.869651 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:07:16.869623    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:12:16.894501 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:12:16.894472    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:12:16.895731 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:12:16.895711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:12:16.900325 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:12:16.900304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:12:16.901547 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:12:16.901531    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:17:16.935095 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:17:16.935062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:17:16.935932 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:17:16.935910    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:17:16.940955 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:17:16.940934    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:17:16.941643 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:17:16.941624    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:22:16.966045 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:22:16.965996    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:22:16.967842 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:22:16.967818    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:22:16.971470 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:22:16.971447    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:22:16.973692 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:22:16.973674    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:27:16.998362 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:16.998321    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:27:17.001106 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:17.001082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:27:17.004424 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:17.004405    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:27:17.006721 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:17.006695    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:27:31.759064 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.758999    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"]
Jul 12 22:27:31.759566 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.759530    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf1fc86-72a4-4f46-86ba-ea9777e90179" containerName="authorino"
Jul 12 22:27:31.759566 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.759556    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf1fc86-72a4-4f46-86ba-ea9777e90179" containerName="authorino"
Jul 12 22:27:31.759697 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.759667    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf1fc86-72a4-4f46-86ba-ea9777e90179" containerName="authorino"
Jul 12 22:27:31.762747 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.762724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:31.766189 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.766163    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d3e48a9a\"/\"default-dockercfg-297g4\""
Jul 12 22:27:31.766297 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.766275    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d3e48a9a\"/\"kube-root-ca.crt\""
Jul 12 22:27:31.767238 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.767219    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d3e48a9a\"/\"openshift-service-ca.crt\""
Jul 12 22:27:31.767309 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.767235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d3e48a9a\"/\"e2e-lifecycle-model-d3e48a9a-kserve-self-signed-certs\""
Jul 12 22:27:31.783772 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.783743    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"]
Jul 12 22:27:31.943782 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.943736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-home\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:31.943782 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.943781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-model-cache\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:31.944103 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.943802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsn7j\" (UniqueName: \"kubernetes.io/projected/6daa0866-5805-425d-90dc-de4b032ac535-kube-api-access-lsn7j\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:31.944103 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.943906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-tmp-dir\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:31.944103 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.943994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-dshm\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:31.944247 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:31.944109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa0866-5805-425d-90dc-de4b032ac535-tls-certs\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045192 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa0866-5805-425d-90dc-de4b032ac535-tls-certs\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045361 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-home\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045361 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-model-cache\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045361 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsn7j\" (UniqueName: \"kubernetes.io/projected/6daa0866-5805-425d-90dc-de4b032ac535-kube-api-access-lsn7j\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045361 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-tmp-dir\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045584 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-dshm\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045666 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-home\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045723 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-model-cache\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.045771 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.045736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-tmp-dir\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.047805 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.047783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-dshm\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.048007 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.047993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa0866-5805-425d-90dc-de4b032ac535-tls-certs\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.054700 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.054675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsn7j\" (UniqueName: \"kubernetes.io/projected/6daa0866-5805-425d-90dc-de4b032ac535-kube-api-access-lsn7j\") pod \"e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") " pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.072622 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.072588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:32.217723 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.217678    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"]
Jul 12 22:27:32.219956 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:27:32.219929    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6daa0866_5805_425d_90dc_de4b032ac535.slice/crio-f026aa91165f30379410f45149b5304ddceb405f682498cdc39398404403c334 WatchSource:0}: Error finding container f026aa91165f30379410f45149b5304ddceb405f682498cdc39398404403c334: Status 404 returned error can't find the container with id f026aa91165f30379410f45149b5304ddceb405f682498cdc39398404403c334
Jul 12 22:27:32.447301 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.447203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj" event={"ID":"6daa0866-5805-425d-90dc-de4b032ac535","Type":"ContainerStarted","Data":"d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64"}
Jul 12 22:27:32.447301 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.447252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj" event={"ID":"6daa0866-5805-425d-90dc-de4b032ac535","Type":"ContainerStarted","Data":"f026aa91165f30379410f45149b5304ddceb405f682498cdc39398404403c334"}
Jul 12 22:27:32.467514 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:32.467460    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj" podStartSLOduration=1.467441956 podStartE2EDuration="1.467441956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:27:32.465575288 +0000 UTC m=+2116.094406360" watchObservedRunningTime="2026-07-12 22:27:32.467441956 +0000 UTC m=+2116.096273030"
Jul 12 22:27:42.073493 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:42.073451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:42.073899 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:42.073545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:42.086131 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:42.086101    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:27:42.508111 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:27:42.508007    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:28:18.719818 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:18.719730    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"]
Jul 12 22:28:33.740629 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:33.740552    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj" podUID="6daa0866-5805-425d-90dc-de4b032ac535" containerName="main" containerID="cri-o://d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64" gracePeriod=45
Jul 12 22:28:34.000048 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:33.999961    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:28:34.184092 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-home\") pod \"6daa0866-5805-425d-90dc-de4b032ac535\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") "
Jul 12 22:28:34.184313 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-model-cache\") pod \"6daa0866-5805-425d-90dc-de4b032ac535\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") "
Jul 12 22:28:34.184313 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184170    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-dshm\") pod \"6daa0866-5805-425d-90dc-de4b032ac535\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") "
Jul 12 22:28:34.184313 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa0866-5805-425d-90dc-de4b032ac535-tls-certs\") pod \"6daa0866-5805-425d-90dc-de4b032ac535\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") "
Jul 12 22:28:34.184313 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184235    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsn7j\" (UniqueName: \"kubernetes.io/projected/6daa0866-5805-425d-90dc-de4b032ac535-kube-api-access-lsn7j\") pod \"6daa0866-5805-425d-90dc-de4b032ac535\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") "
Jul 12 22:28:34.184313 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184257    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-tmp-dir\") pod \"6daa0866-5805-425d-90dc-de4b032ac535\" (UID: \"6daa0866-5805-425d-90dc-de4b032ac535\") "
Jul 12 22:28:34.184559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184447    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-home" (OuterVolumeSpecName: "home") pod "6daa0866-5805-425d-90dc-de4b032ac535" (UID: "6daa0866-5805-425d-90dc-de4b032ac535"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:28:34.184559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184480    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-model-cache" (OuterVolumeSpecName: "model-cache") pod "6daa0866-5805-425d-90dc-de4b032ac535" (UID: "6daa0866-5805-425d-90dc-de4b032ac535"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:28:34.184652 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.184566    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6daa0866-5805-425d-90dc-de4b032ac535" (UID: "6daa0866-5805-425d-90dc-de4b032ac535"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:28:34.186692 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.186667    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-dshm" (OuterVolumeSpecName: "dshm") pod "6daa0866-5805-425d-90dc-de4b032ac535" (UID: "6daa0866-5805-425d-90dc-de4b032ac535"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:28:34.186794 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.186723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6daa0866-5805-425d-90dc-de4b032ac535-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6daa0866-5805-425d-90dc-de4b032ac535" (UID: "6daa0866-5805-425d-90dc-de4b032ac535"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:28:34.186794 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.186723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6daa0866-5805-425d-90dc-de4b032ac535-kube-api-access-lsn7j" (OuterVolumeSpecName: "kube-api-access-lsn7j") pod "6daa0866-5805-425d-90dc-de4b032ac535" (UID: "6daa0866-5805-425d-90dc-de4b032ac535"). InnerVolumeSpecName "kube-api-access-lsn7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:28:34.285129 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.285088    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa0866-5805-425d-90dc-de4b032ac535-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:28:34.285129 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.285123    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsn7j\" (UniqueName: \"kubernetes.io/projected/6daa0866-5805-425d-90dc-de4b032ac535-kube-api-access-lsn7j\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:28:34.285340 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.285155    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:28:34.285340 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.285164    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:28:34.285340 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.285172    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:28:34.285340 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.285180    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa0866-5805-425d-90dc-de4b032ac535-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:28:34.764759 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.764667    2579 generic.go:356] "Generic (PLEG): container finished" podID="6daa0866-5805-425d-90dc-de4b032ac535" containerID="d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64" exitCode=0
Jul 12 22:28:34.764759 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.764708    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"
Jul 12 22:28:34.765315 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.764757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj" event={"ID":"6daa0866-5805-425d-90dc-de4b032ac535","Type":"ContainerDied","Data":"d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64"}
Jul 12 22:28:34.765315 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.764801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj" event={"ID":"6daa0866-5805-425d-90dc-de4b032ac535","Type":"ContainerDied","Data":"f026aa91165f30379410f45149b5304ddceb405f682498cdc39398404403c334"}
Jul 12 22:28:34.765315 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.764819    2579 scope.go:117] "RemoveContainer" containerID="d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64"
Jul 12 22:28:34.776246 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.776227    2579 scope.go:117] "RemoveContainer" containerID="d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64"
Jul 12 22:28:34.776683 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:28:34.776661    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64\": container with ID starting with d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64 not found: ID does not exist" containerID="d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64"
Jul 12 22:28:34.776781 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.776690    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64"} err="failed to get container status \"d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64\": rpc error: code = NotFound desc = could not find container \"d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64\": container with ID starting with d36e2b72dcf6e03571d8f118e092c859d9e89a2739f0b0da275756b670148f64 not found: ID does not exist"
Jul 12 22:28:34.786930 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.786901    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"]
Jul 12 22:28:34.790389 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.790360    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d3e48a9a/e2e-lifecycle-model-d3e48a9a-kserve-6b986589f-nmnxj"]
Jul 12 22:28:34.938573 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:28:34.938540    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6daa0866-5805-425d-90dc-de4b032ac535" path="/var/lib/kubelet/pods/6daa0866-5805-425d-90dc-de4b032ac535/volumes"
Jul 12 22:30:08.464991 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.464952    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"]
Jul 12 22:30:08.465489 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.465308    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6daa0866-5805-425d-90dc-de4b032ac535" containerName="main"
Jul 12 22:30:08.465489 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.465320    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6daa0866-5805-425d-90dc-de4b032ac535" containerName="main"
Jul 12 22:30:08.465489 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.465388    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6daa0866-5805-425d-90dc-de4b032ac535" containerName="main"
Jul 12 22:30:08.468287 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.468271    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.472978 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.472954    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-65f13b\"/\"kube-root-ca.crt\""
Jul 12 22:30:08.474188 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.474164    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-65f13b\"/\"openshift-service-ca.crt\""
Jul 12 22:30:08.474288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.474202    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-65f13b\"/\"default-dockercfg-rwtx4\""
Jul 12 22:30:08.474288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.474277    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-65f13b\"/\"test-model-65f13b-kserve-self-signed-certs\""
Jul 12 22:30:08.490569 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.490539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"]
Jul 12 22:30:08.613204 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.613165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca15a69-00ac-4f14-944c-be409df0d848-tls-certs\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.613204 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.613207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-home\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.613442 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.613226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-tmp-dir\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.613442 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.613316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5xf\" (UniqueName: \"kubernetes.io/projected/fca15a69-00ac-4f14-944c-be409df0d848-kube-api-access-mh5xf\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.613442 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.613355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-dshm\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.613442 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.613382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-model-cache\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.714542 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.714499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5xf\" (UniqueName: \"kubernetes.io/projected/fca15a69-00ac-4f14-944c-be409df0d848-kube-api-access-mh5xf\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.714542 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.714547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-dshm\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.714786 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.714572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-model-cache\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.714786 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.714621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca15a69-00ac-4f14-944c-be409df0d848-tls-certs\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.714786 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.714652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-home\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.714786 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.714668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-tmp-dir\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.715120 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.715058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-model-cache\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.715196 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.715124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-home\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.715196 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.715150    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-tmp-dir\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.717084 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.717066    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-dshm\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.717349 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.717332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca15a69-00ac-4f14-944c-be409df0d848-tls-certs\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.724132 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.724113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5xf\" (UniqueName: \"kubernetes.io/projected/fca15a69-00ac-4f14-944c-be409df0d848-kube-api-access-mh5xf\") pod \"test-model-65f13b-kserve-86d96956cf-9lxn9\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") " pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.778092 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.778054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:08.925723 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:08.920191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"]
Jul 12 22:30:09.252317 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:09.252225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9" event={"ID":"fca15a69-00ac-4f14-944c-be409df0d848","Type":"ContainerStarted","Data":"37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f"}
Jul 12 22:30:09.252317 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:09.252269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9" event={"ID":"fca15a69-00ac-4f14-944c-be409df0d848","Type":"ContainerStarted","Data":"0881508f24263a14960d7c516a75e87ade99526e4c1754d0923a4c76c901510c"}
Jul 12 22:30:09.271541 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:09.271492    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9" podStartSLOduration=1.271475865 podStartE2EDuration="1.271475865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:30:09.269344405 +0000 UTC m=+2272.898175478" watchObservedRunningTime="2026-07-12 22:30:09.271475865 +0000 UTC m=+2272.900306938"
Jul 12 22:30:18.778528 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:18.778487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:18.779058 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:18.778547    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:18.790954 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:18.790927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:19.318629 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:19.318597    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:30:50.840386 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.840347    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"]
Jul 12 22:30:50.843724 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.843703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:50.846814 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.846789    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6976fc\"/\"openshift-service-ca.crt\""
Jul 12 22:30:50.847819 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.847802    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6976fc\"/\"kube-root-ca.crt\""
Jul 12 22:30:50.847877 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.847840    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6976fc\"/\"default-dockercfg-km7r5\""
Jul 12 22:30:50.848119 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.848104    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6976fc\"/\"test-model-6976fc-kserve-self-signed-certs\""
Jul 12 22:30:50.853397 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.853375    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"]
Jul 12 22:30:50.944537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.944499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188be27b-a406-4aa5-bf9c-4254d94e5d83-tls-certs\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:50.944537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.944541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-tmp-dir\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:50.944773 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.944621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-dshm\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:50.944773 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.944710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr5kw\" (UniqueName: \"kubernetes.io/projected/188be27b-a406-4aa5-bf9c-4254d94e5d83-kube-api-access-wr5kw\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:50.944773 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.944752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-home\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:50.944773 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:50.944771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-model-cache\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045467 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-dshm\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045670 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr5kw\" (UniqueName: \"kubernetes.io/projected/188be27b-a406-4aa5-bf9c-4254d94e5d83-kube-api-access-wr5kw\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045670 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-home\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045670 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-model-cache\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045670 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188be27b-a406-4aa5-bf9c-4254d94e5d83-tls-certs\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045670 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-tmp-dir\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.045940 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-home\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.046017 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.045961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-tmp-dir\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.046111 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.046056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-model-cache\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.047926 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.047898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-dshm\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.048172 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.048154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188be27b-a406-4aa5-bf9c-4254d94e5d83-tls-certs\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.054979 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.054956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr5kw\" (UniqueName: \"kubernetes.io/projected/188be27b-a406-4aa5-bf9c-4254d94e5d83-kube-api-access-wr5kw\") pod \"test-model-6976fc-kserve-7cb7f775d7-nngw4\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") " pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.154244 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.154157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:30:51.296420 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.296380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"]
Jul 12 22:30:51.482174 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.482066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4" event={"ID":"188be27b-a406-4aa5-bf9c-4254d94e5d83","Type":"ContainerStarted","Data":"b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0"}
Jul 12 22:30:51.482174 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.482121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4" event={"ID":"188be27b-a406-4aa5-bf9c-4254d94e5d83","Type":"ContainerStarted","Data":"84bbba6ba1fc51799a9b5c057c18fdaafe08f2374ef012a22f3ab330300069b4"}
Jul 12 22:30:51.500687 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:30:51.500632    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4" podStartSLOduration=1.500616098 podStartE2EDuration="1.500616098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:30:51.499761088 +0000 UTC m=+2315.128592162" watchObservedRunningTime="2026-07-12 22:30:51.500616098 +0000 UTC m=+2315.129447171"
Jul 12 22:31:01.154967 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:01.154928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:31:01.155401 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:01.154983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:31:01.167630 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:01.167602    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:31:01.544786 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:01.544756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:31:08.992786 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:08.992700    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"]
Jul 12 22:31:10.016797 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:10.016753    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"]
Jul 12 22:31:24.013266 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.013219    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9" podUID="fca15a69-00ac-4f14-944c-be409df0d848" containerName="main" containerID="cri-o://37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f" gracePeriod=45
Jul 12 22:31:24.271143 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.271075    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:31:24.350006 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.349970    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-tmp-dir\") pod \"fca15a69-00ac-4f14-944c-be409df0d848\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") "
Jul 12 22:31:24.350226 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350057    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca15a69-00ac-4f14-944c-be409df0d848-tls-certs\") pod \"fca15a69-00ac-4f14-944c-be409df0d848\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") "
Jul 12 22:31:24.350226 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh5xf\" (UniqueName: \"kubernetes.io/projected/fca15a69-00ac-4f14-944c-be409df0d848-kube-api-access-mh5xf\") pod \"fca15a69-00ac-4f14-944c-be409df0d848\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") "
Jul 12 22:31:24.350226 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350163    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-dshm\") pod \"fca15a69-00ac-4f14-944c-be409df0d848\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") "
Jul 12 22:31:24.350226 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350190    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-model-cache\") pod \"fca15a69-00ac-4f14-944c-be409df0d848\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") "
Jul 12 22:31:24.350226 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350208    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-home\") pod \"fca15a69-00ac-4f14-944c-be409df0d848\" (UID: \"fca15a69-00ac-4f14-944c-be409df0d848\") "
Jul 12 22:31:24.350494 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fca15a69-00ac-4f14-944c-be409df0d848" (UID: "fca15a69-00ac-4f14-944c-be409df0d848"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:24.350494 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350466    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-model-cache" (OuterVolumeSpecName: "model-cache") pod "fca15a69-00ac-4f14-944c-be409df0d848" (UID: "fca15a69-00ac-4f14-944c-be409df0d848"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:24.350587 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350517    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:24.350628 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.350560    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-home" (OuterVolumeSpecName: "home") pod "fca15a69-00ac-4f14-944c-be409df0d848" (UID: "fca15a69-00ac-4f14-944c-be409df0d848"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:24.352502 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.352471    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca15a69-00ac-4f14-944c-be409df0d848-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fca15a69-00ac-4f14-944c-be409df0d848" (UID: "fca15a69-00ac-4f14-944c-be409df0d848"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:31:24.352623 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.352521    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca15a69-00ac-4f14-944c-be409df0d848-kube-api-access-mh5xf" (OuterVolumeSpecName: "kube-api-access-mh5xf") pod "fca15a69-00ac-4f14-944c-be409df0d848" (UID: "fca15a69-00ac-4f14-944c-be409df0d848"). InnerVolumeSpecName "kube-api-access-mh5xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:31:24.352623 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.352554    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-dshm" (OuterVolumeSpecName: "dshm") pod "fca15a69-00ac-4f14-944c-be409df0d848" (UID: "fca15a69-00ac-4f14-944c-be409df0d848"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:24.451682 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.451643    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca15a69-00ac-4f14-944c-be409df0d848-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:24.451682 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.451675    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh5xf\" (UniqueName: \"kubernetes.io/projected/fca15a69-00ac-4f14-944c-be409df0d848-kube-api-access-mh5xf\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:24.451682 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.451684    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:24.451682 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.451693    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:24.451999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.451701    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca15a69-00ac-4f14-944c-be409df0d848-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:24.653176 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.653143    2579 generic.go:356] "Generic (PLEG): container finished" podID="fca15a69-00ac-4f14-944c-be409df0d848" containerID="37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f" exitCode=0
Jul 12 22:31:24.653349 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.653192    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"
Jul 12 22:31:24.653349 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.653224    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9" event={"ID":"fca15a69-00ac-4f14-944c-be409df0d848","Type":"ContainerDied","Data":"37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f"}
Jul 12 22:31:24.653349 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.653266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9" event={"ID":"fca15a69-00ac-4f14-944c-be409df0d848","Type":"ContainerDied","Data":"0881508f24263a14960d7c516a75e87ade99526e4c1754d0923a4c76c901510c"}
Jul 12 22:31:24.653349 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.653287    2579 scope.go:117] "RemoveContainer" containerID="37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f"
Jul 12 22:31:24.663241 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.663223    2579 scope.go:117] "RemoveContainer" containerID="37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f"
Jul 12 22:31:24.663561 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:31:24.663542    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f\": container with ID starting with 37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f not found: ID does not exist" containerID="37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f"
Jul 12 22:31:24.663613 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.663582    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f"} err="failed to get container status \"37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f\": rpc error: code = NotFound desc = could not find container \"37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f\": container with ID starting with 37e82c83ef7f543aea69d6248498c7ea65423c23c14b19e93371e464fb20e37f not found: ID does not exist"
Jul 12 22:31:24.675530 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.675501    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"]
Jul 12 22:31:24.679591 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.679570    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-65f13b/test-model-65f13b-kserve-86d96956cf-9lxn9"]
Jul 12 22:31:24.938311 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:24.938232    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca15a69-00ac-4f14-944c-be409df0d848" path="/var/lib/kubelet/pods/fca15a69-00ac-4f14-944c-be409df0d848/volumes"
Jul 12 22:31:25.037605 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.037541    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4" podUID="188be27b-a406-4aa5-bf9c-4254d94e5d83" containerName="main" containerID="cri-o://b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0" gracePeriod=45
Jul 12 22:31:25.291151 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.291122    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:31:25.359681 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359647    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-home\") pod \"188be27b-a406-4aa5-bf9c-4254d94e5d83\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") "
Jul 12 22:31:25.359681 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188be27b-a406-4aa5-bf9c-4254d94e5d83-tls-certs\") pod \"188be27b-a406-4aa5-bf9c-4254d94e5d83\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") "
Jul 12 22:31:25.359931 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-tmp-dir\") pod \"188be27b-a406-4aa5-bf9c-4254d94e5d83\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") "
Jul 12 22:31:25.359931 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359739    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-dshm\") pod \"188be27b-a406-4aa5-bf9c-4254d94e5d83\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") "
Jul 12 22:31:25.359931 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359796    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-model-cache\") pod \"188be27b-a406-4aa5-bf9c-4254d94e5d83\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") "
Jul 12 22:31:25.359931 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr5kw\" (UniqueName: \"kubernetes.io/projected/188be27b-a406-4aa5-bf9c-4254d94e5d83-kube-api-access-wr5kw\") pod \"188be27b-a406-4aa5-bf9c-4254d94e5d83\" (UID: \"188be27b-a406-4aa5-bf9c-4254d94e5d83\") "
Jul 12 22:31:25.360245 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.359959    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-home" (OuterVolumeSpecName: "home") pod "188be27b-a406-4aa5-bf9c-4254d94e5d83" (UID: "188be27b-a406-4aa5-bf9c-4254d94e5d83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:25.360245 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.360060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "188be27b-a406-4aa5-bf9c-4254d94e5d83" (UID: "188be27b-a406-4aa5-bf9c-4254d94e5d83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:25.360245 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.360074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-model-cache" (OuterVolumeSpecName: "model-cache") pod "188be27b-a406-4aa5-bf9c-4254d94e5d83" (UID: "188be27b-a406-4aa5-bf9c-4254d94e5d83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:25.360245 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.360178    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:25.360245 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.360197    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:25.360245 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.360209    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:25.362176 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.362150    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-dshm" (OuterVolumeSpecName: "dshm") pod "188be27b-a406-4aa5-bf9c-4254d94e5d83" (UID: "188be27b-a406-4aa5-bf9c-4254d94e5d83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:31:25.362271 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.362215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/188be27b-a406-4aa5-bf9c-4254d94e5d83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "188be27b-a406-4aa5-bf9c-4254d94e5d83" (UID: "188be27b-a406-4aa5-bf9c-4254d94e5d83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:31:25.362271 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.362226    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188be27b-a406-4aa5-bf9c-4254d94e5d83-kube-api-access-wr5kw" (OuterVolumeSpecName: "kube-api-access-wr5kw") pod "188be27b-a406-4aa5-bf9c-4254d94e5d83" (UID: "188be27b-a406-4aa5-bf9c-4254d94e5d83"). InnerVolumeSpecName "kube-api-access-wr5kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:31:25.461579 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.461489    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr5kw\" (UniqueName: \"kubernetes.io/projected/188be27b-a406-4aa5-bf9c-4254d94e5d83-kube-api-access-wr5kw\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:25.461579 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.461523    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188be27b-a406-4aa5-bf9c-4254d94e5d83-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:25.461579 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.461534    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188be27b-a406-4aa5-bf9c-4254d94e5d83-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:31:25.661470 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.661435    2579 generic.go:356] "Generic (PLEG): container finished" podID="188be27b-a406-4aa5-bf9c-4254d94e5d83" containerID="b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0" exitCode=0
Jul 12 22:31:25.661638 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.661479    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"
Jul 12 22:31:25.661638 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.661499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4" event={"ID":"188be27b-a406-4aa5-bf9c-4254d94e5d83","Type":"ContainerDied","Data":"b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0"}
Jul 12 22:31:25.661638 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.661529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4" event={"ID":"188be27b-a406-4aa5-bf9c-4254d94e5d83","Type":"ContainerDied","Data":"84bbba6ba1fc51799a9b5c057c18fdaafe08f2374ef012a22f3ab330300069b4"}
Jul 12 22:31:25.661638 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.661546    2579 scope.go:117] "RemoveContainer" containerID="b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0"
Jul 12 22:31:25.671078 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.671053    2579 scope.go:117] "RemoveContainer" containerID="b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0"
Jul 12 22:31:25.671327 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:31:25.671308    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0\": container with ID starting with b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0 not found: ID does not exist" containerID="b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0"
Jul 12 22:31:25.671379 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.671336    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0"} err="failed to get container status \"b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0\": rpc error: code = NotFound desc = could not find container \"b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0\": container with ID starting with b9956bfbc5086674ba8d93bcbc95a0c69b3e61731371f32f0f5d275bd72edaa0 not found: ID does not exist"
Jul 12 22:31:25.683558 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.683529    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"]
Jul 12 22:31:25.689243 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:25.689215    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6976fc/test-model-6976fc-kserve-7cb7f775d7-nngw4"]
Jul 12 22:31:26.937638 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:31:26.937606    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="188be27b-a406-4aa5-bf9c-4254d94e5d83" path="/var/lib/kubelet/pods/188be27b-a406-4aa5-bf9c-4254d94e5d83/volumes"
Jul 12 22:32:17.032467 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:17.032438    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:32:17.037764 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:17.037740    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:32:17.039268 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:17.039245    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:32:17.044891 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:17.044874    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:32:29.043929 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.043888    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"]
Jul 12 22:32:29.044376 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.044258    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca15a69-00ac-4f14-944c-be409df0d848" containerName="main"
Jul 12 22:32:29.044376 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.044271    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca15a69-00ac-4f14-944c-be409df0d848" containerName="main"
Jul 12 22:32:29.044376 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.044279    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188be27b-a406-4aa5-bf9c-4254d94e5d83" containerName="main"
Jul 12 22:32:29.044376 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.044287    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="188be27b-a406-4aa5-bf9c-4254d94e5d83" containerName="main"
Jul 12 22:32:29.044376 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.044356    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca15a69-00ac-4f14-944c-be409df0d848" containerName="main"
Jul 12 22:32:29.044376 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.044371    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="188be27b-a406-4aa5-bf9c-4254d94e5d83" containerName="main"
Jul 12 22:32:29.047426 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.047409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:29.050014 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.049991    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:32:29.056280 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.056258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"]
Jul 12 22:32:29.125053 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.124987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp\" (UID: \"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:29.226293 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.226256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp\" (UID: \"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:29.226959 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.226937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp\" (UID: \"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:29.359073 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.358946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:29.502788 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.502759    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"]
Jul 12 22:32:29.504958 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:32:29.504934    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36dfaac_bc7f_4d0a_9f18_b6f7fe51806a.slice/crio-c0f028fd53c6a2ee42bbe4a1eea8d8bebfa5c4d56826ed3aa97835380e9bfdfa WatchSource:0}: Error finding container c0f028fd53c6a2ee42bbe4a1eea8d8bebfa5c4d56826ed3aa97835380e9bfdfa: Status 404 returned error can't find the container with id c0f028fd53c6a2ee42bbe4a1eea8d8bebfa5c4d56826ed3aa97835380e9bfdfa
Jul 12 22:32:29.507371 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.507354    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:32:29.994624 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:29.994589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp" event={"ID":"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a","Type":"ContainerStarted","Data":"c0f028fd53c6a2ee42bbe4a1eea8d8bebfa5c4d56826ed3aa97835380e9bfdfa"}
Jul 12 22:32:33.015482 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:33.015444    2579 generic.go:356] "Generic (PLEG): container finished" podID="e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a" containerID="f1a94a189dcd4f30dd19b5ae6dba40ede0230964fa78fb3dbb2277fd4ff3873b" exitCode=0
Jul 12 22:32:33.015919 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:33.015543    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp" event={"ID":"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a","Type":"ContainerDied","Data":"f1a94a189dcd4f30dd19b5ae6dba40ede0230964fa78fb3dbb2277fd4ff3873b"}
Jul 12 22:32:34.158338 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:34.158305    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:34.273355 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:34.273258    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a-maas-api-service-ca\") pod \"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a\" (UID: \"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a\") "
Jul 12 22:32:34.273608 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:34.273583    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a" (UID: "e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:32:34.374339 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:34.374293    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a-maas-api-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:32:35.027040 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:35.026995    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp"
Jul 12 22:32:35.027209 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:35.027038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp" event={"ID":"e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a","Type":"ContainerDied","Data":"c0f028fd53c6a2ee42bbe4a1eea8d8bebfa5c4d56826ed3aa97835380e9bfdfa"}
Jul 12 22:32:35.027209 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:32:35.027084    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0f028fd53c6a2ee42bbe4a1eea8d8bebfa5c4d56826ed3aa97835380e9bfdfa"
Jul 12 22:34:11.345526 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.345431    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"]
Jul 12 22:34:11.346117 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.345753    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a" containerName="revoke-keys"
Jul 12 22:34:11.346117 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.345764    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a" containerName="revoke-keys"
Jul 12 22:34:11.346117 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.345836    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a" containerName="revoke-keys"
Jul 12 22:34:11.348683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.348663    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.352559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.352530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"default-dockercfg-c4gbw\""
Jul 12 22:34:11.352559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.352546    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"auth-test-model-66fe58-kserve-self-signed-certs\""
Jul 12 22:34:11.352714 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.352580    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"kube-root-ca.crt\""
Jul 12 22:34:11.352714 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.352542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"openshift-service-ca.crt\""
Jul 12 22:34:11.357420 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.357400    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"]
Jul 12 22:34:11.455594 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.455539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-dshm\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.455779 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.455625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-tmp-dir\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.455779 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.455649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdhzw\" (UniqueName: \"kubernetes.io/projected/4a4f186a-0852-475c-8263-0b2a51934a9e-kube-api-access-vdhzw\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.455779 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.455673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-home\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.455779 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.455696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-model-cache\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.455779 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.455757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4f186a-0852-475c-8263-0b2a51934a9e-tls-certs\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556419 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4f186a-0852-475c-8263-0b2a51934a9e-tls-certs\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556419 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-dshm\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556704 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-tmp-dir\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556704 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdhzw\" (UniqueName: \"kubernetes.io/projected/4a4f186a-0852-475c-8263-0b2a51934a9e-kube-api-access-vdhzw\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556704 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-home\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556704 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-model-cache\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.556999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.556979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-home\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.557112 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.557056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-tmp-dir\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.557112 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.557081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-model-cache\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.558965 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.558943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-dshm\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.559227 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.559213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4f186a-0852-475c-8263-0b2a51934a9e-tls-certs\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.565543 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.565515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdhzw\" (UniqueName: \"kubernetes.io/projected/4a4f186a-0852-475c-8263-0b2a51934a9e-kube-api-access-vdhzw\") pod \"auth-test-model-66fe58-kserve-95f5fc9cf-2dvps\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") " pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.659165 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.659074    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:11.803348 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:11.803321    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"]
Jul 12 22:34:11.806103 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:34:11.806072    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a4f186a_0852_475c_8263_0b2a51934a9e.slice/crio-6598289d23899bd2cb4ae910802eb198921671ab18c3e0cf002718cc6eff80c2 WatchSource:0}: Error finding container 6598289d23899bd2cb4ae910802eb198921671ab18c3e0cf002718cc6eff80c2: Status 404 returned error can't find the container with id 6598289d23899bd2cb4ae910802eb198921671ab18c3e0cf002718cc6eff80c2
Jul 12 22:34:12.531496 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:12.531455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps" event={"ID":"4a4f186a-0852-475c-8263-0b2a51934a9e","Type":"ContainerStarted","Data":"5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116"}
Jul 12 22:34:12.531496 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:12.531499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps" event={"ID":"4a4f186a-0852-475c-8263-0b2a51934a9e","Type":"ContainerStarted","Data":"6598289d23899bd2cb4ae910802eb198921671ab18c3e0cf002718cc6eff80c2"}
Jul 12 22:34:12.548858 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:12.548803    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps" podStartSLOduration=1.548788428 podStartE2EDuration="1.548788428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:34:12.547384169 +0000 UTC m=+2516.176215279" watchObservedRunningTime="2026-07-12 22:34:12.548788428 +0000 UTC m=+2516.177619529"
Jul 12 22:34:21.659921 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:21.659876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:21.660363 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:21.659941    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:21.672847 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:21.672816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:22.593167 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:22.593136    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:34:50.247000 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.246962    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"]
Jul 12 22:34:50.250279 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.250263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.254236 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.254210    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"kube-root-ca.crt\""
Jul 12 22:34:50.254384 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.254250    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"openshift-service-ca.crt\""
Jul 12 22:34:50.254384 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.254261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"default-dockercfg-w2dkh\""
Jul 12 22:34:50.254384 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.254287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"auth-test-model-7a7f11-kserve-self-signed-certs\""
Jul 12 22:34:50.259393 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.259372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"]
Jul 12 22:34:50.303794 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.303760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-home\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.303959 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.303805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvwn\" (UniqueName: \"kubernetes.io/projected/8eebda3b-9acf-47b6-9949-e434e48f463d-kube-api-access-cxvwn\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.303959 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.303903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-dshm\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.303959 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.303933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-tmp-dir\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.304136 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.303966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eebda3b-9acf-47b6-9949-e434e48f463d-tls-certs\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.304136 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.304089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-model-cache\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.404828 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.404784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-home\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.404828 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.404828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvwn\" (UniqueName: \"kubernetes.io/projected/8eebda3b-9acf-47b6-9949-e434e48f463d-kube-api-access-cxvwn\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405091 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.404958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-dshm\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405091 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.404992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-tmp-dir\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405091 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.405057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eebda3b-9acf-47b6-9949-e434e48f463d-tls-certs\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405240 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.405133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-model-cache\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405299 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.405251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-home\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405400 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.405377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-tmp-dir\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.405473 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.405445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-model-cache\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.407372 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.407349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-dshm\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.407664 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.407644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eebda3b-9acf-47b6-9949-e434e48f463d-tls-certs\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.413206 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.413182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvwn\" (UniqueName: \"kubernetes.io/projected/8eebda3b-9acf-47b6-9949-e434e48f463d-kube-api-access-cxvwn\") pod \"auth-test-model-7a7f11-kserve-558d959d8c-pqxgb\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") " pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.560669 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.560631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:34:50.700392 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.700360    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"]
Jul 12 22:34:50.701854 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:34:50.701829    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eebda3b_9acf_47b6_9949_e434e48f463d.slice/crio-cf862b89e656ce7cc3715e83f6fca8c7325f3ee30bb95215e4f2c0d97a907ff1 WatchSource:0}: Error finding container cf862b89e656ce7cc3715e83f6fca8c7325f3ee30bb95215e4f2c0d97a907ff1: Status 404 returned error can't find the container with id cf862b89e656ce7cc3715e83f6fca8c7325f3ee30bb95215e4f2c0d97a907ff1
Jul 12 22:34:50.733271 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:50.733238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb" event={"ID":"8eebda3b-9acf-47b6-9949-e434e48f463d","Type":"ContainerStarted","Data":"cf862b89e656ce7cc3715e83f6fca8c7325f3ee30bb95215e4f2c0d97a907ff1"}
Jul 12 22:34:51.740314 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:51.740272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb" event={"ID":"8eebda3b-9acf-47b6-9949-e434e48f463d","Type":"ContainerStarted","Data":"0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9"}
Jul 12 22:34:51.760295 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:34:51.760244    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb" podStartSLOduration=1.7602282420000002 podStartE2EDuration="1.760228242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:34:51.758623596 +0000 UTC m=+2555.387454680" watchObservedRunningTime="2026-07-12 22:34:51.760228242 +0000 UTC m=+2555.389059366"
Jul 12 22:35:00.561448 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:35:00.561408    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:35:00.561921 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:35:00.561464    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:35:00.574134 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:35:00.574104    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:35:00.798423 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:35:00.798390    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:37:15.538918 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:15.538830    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"]
Jul 12 22:37:16.431416 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:16.431375    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"]
Jul 12 22:37:17.072309 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:17.072270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:37:17.076960 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:17.076931    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:37:17.078648 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:17.078618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:37:17.082740 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:17.082721    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:37:30.559616 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.559575    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps" podUID="4a4f186a-0852-475c-8263-0b2a51934a9e" containerName="main" containerID="cri-o://5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116" gracePeriod=45
Jul 12 22:37:30.808512 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.808486    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:37:30.930352 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdhzw\" (UniqueName: \"kubernetes.io/projected/4a4f186a-0852-475c-8263-0b2a51934a9e-kube-api-access-vdhzw\") pod \"4a4f186a-0852-475c-8263-0b2a51934a9e\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") "
Jul 12 22:37:30.930352 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930321    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-dshm\") pod \"4a4f186a-0852-475c-8263-0b2a51934a9e\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") "
Jul 12 22:37:30.930599 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-model-cache\") pod \"4a4f186a-0852-475c-8263-0b2a51934a9e\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") "
Jul 12 22:37:30.930599 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-home\") pod \"4a4f186a-0852-475c-8263-0b2a51934a9e\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") "
Jul 12 22:37:30.930599 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930435    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4f186a-0852-475c-8263-0b2a51934a9e-tls-certs\") pod \"4a4f186a-0852-475c-8263-0b2a51934a9e\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") "
Jul 12 22:37:30.930599 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930456    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-tmp-dir\") pod \"4a4f186a-0852-475c-8263-0b2a51934a9e\" (UID: \"4a4f186a-0852-475c-8263-0b2a51934a9e\") "
Jul 12 22:37:30.930810 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-home" (OuterVolumeSpecName: "home") pod "4a4f186a-0852-475c-8263-0b2a51934a9e" (UID: "4a4f186a-0852-475c-8263-0b2a51934a9e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:30.930810 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930712    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a4f186a-0852-475c-8263-0b2a51934a9e" (UID: "4a4f186a-0852-475c-8263-0b2a51934a9e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:30.930920 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.930820    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a4f186a-0852-475c-8263-0b2a51934a9e" (UID: "4a4f186a-0852-475c-8263-0b2a51934a9e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:30.932751 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.932719    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a4f186a-0852-475c-8263-0b2a51934a9e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a4f186a-0852-475c-8263-0b2a51934a9e" (UID: "4a4f186a-0852-475c-8263-0b2a51934a9e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:37:30.932863 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.932769    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-dshm" (OuterVolumeSpecName: "dshm") pod "4a4f186a-0852-475c-8263-0b2a51934a9e" (UID: "4a4f186a-0852-475c-8263-0b2a51934a9e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:30.932912 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:30.932889    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a4f186a-0852-475c-8263-0b2a51934a9e-kube-api-access-vdhzw" (OuterVolumeSpecName: "kube-api-access-vdhzw") pod "4a4f186a-0852-475c-8263-0b2a51934a9e" (UID: "4a4f186a-0852-475c-8263-0b2a51934a9e"). InnerVolumeSpecName "kube-api-access-vdhzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:37:31.031534 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.031497    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4f186a-0852-475c-8263-0b2a51934a9e-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.031534 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.031527    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.031534 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.031539    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdhzw\" (UniqueName: \"kubernetes.io/projected/4a4f186a-0852-475c-8263-0b2a51934a9e-kube-api-access-vdhzw\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.031775 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.031547    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.031775 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.031556    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.031775 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.031563    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4f186a-0852-475c-8263-0b2a51934a9e-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.452440 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.452380    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb" podUID="8eebda3b-9acf-47b6-9949-e434e48f463d" containerName="main" containerID="cri-o://0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9" gracePeriod=45
Jul 12 22:37:31.553119 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.553087    2579 generic.go:356] "Generic (PLEG): container finished" podID="4a4f186a-0852-475c-8263-0b2a51934a9e" containerID="5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116" exitCode=0
Jul 12 22:37:31.553290 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.553137    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"
Jul 12 22:37:31.553290 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.553166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps" event={"ID":"4a4f186a-0852-475c-8263-0b2a51934a9e","Type":"ContainerDied","Data":"5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116"}
Jul 12 22:37:31.553290 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.553199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps" event={"ID":"4a4f186a-0852-475c-8263-0b2a51934a9e","Type":"ContainerDied","Data":"6598289d23899bd2cb4ae910802eb198921671ab18c3e0cf002718cc6eff80c2"}
Jul 12 22:37:31.553290 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.553216    2579 scope.go:117] "RemoveContainer" containerID="5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116"
Jul 12 22:37:31.564944 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.564738    2579 scope.go:117] "RemoveContainer" containerID="5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116"
Jul 12 22:37:31.565216 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:37:31.565074    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116\": container with ID starting with 5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116 not found: ID does not exist" containerID="5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116"
Jul 12 22:37:31.565216 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.565104    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116"} err="failed to get container status \"5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116\": rpc error: code = NotFound desc = could not find container \"5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116\": container with ID starting with 5f161c2e733603131119db1990503335217dde2d9775dbde533db231a8e18116 not found: ID does not exist"
Jul 12 22:37:31.572619 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.572580    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"]
Jul 12 22:37:31.575523 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.575345    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/auth-test-model-66fe58-kserve-95f5fc9cf-2dvps"]
Jul 12 22:37:31.713688 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.713621    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:37:31.840231 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-home\") pod \"8eebda3b-9acf-47b6-9949-e434e48f463d\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") "
Jul 12 22:37:31.840231 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840240    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-model-cache\") pod \"8eebda3b-9acf-47b6-9949-e434e48f463d\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") "
Jul 12 22:37:31.840499 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840303    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-dshm\") pod \"8eebda3b-9acf-47b6-9949-e434e48f463d\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") "
Jul 12 22:37:31.840499 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840322    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-tmp-dir\") pod \"8eebda3b-9acf-47b6-9949-e434e48f463d\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") "
Jul 12 22:37:31.840499 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840351    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eebda3b-9acf-47b6-9949-e434e48f463d-tls-certs\") pod \"8eebda3b-9acf-47b6-9949-e434e48f463d\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") "
Jul 12 22:37:31.840499 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxvwn\" (UniqueName: \"kubernetes.io/projected/8eebda3b-9acf-47b6-9949-e434e48f463d-kube-api-access-cxvwn\") pod \"8eebda3b-9acf-47b6-9949-e434e48f463d\" (UID: \"8eebda3b-9acf-47b6-9949-e434e48f463d\") "
Jul 12 22:37:31.840692 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840525    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-home" (OuterVolumeSpecName: "home") pod "8eebda3b-9acf-47b6-9949-e434e48f463d" (UID: "8eebda3b-9acf-47b6-9949-e434e48f463d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:31.840692 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840611    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-model-cache" (OuterVolumeSpecName: "model-cache") pod "8eebda3b-9acf-47b6-9949-e434e48f463d" (UID: "8eebda3b-9acf-47b6-9949-e434e48f463d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:31.840692 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.840634    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8eebda3b-9acf-47b6-9949-e434e48f463d" (UID: "8eebda3b-9acf-47b6-9949-e434e48f463d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:31.842755 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.842732    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eebda3b-9acf-47b6-9949-e434e48f463d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8eebda3b-9acf-47b6-9949-e434e48f463d" (UID: "8eebda3b-9acf-47b6-9949-e434e48f463d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:37:31.842755 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.842726    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-dshm" (OuterVolumeSpecName: "dshm") pod "8eebda3b-9acf-47b6-9949-e434e48f463d" (UID: "8eebda3b-9acf-47b6-9949-e434e48f463d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:37:31.842852 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.842743    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eebda3b-9acf-47b6-9949-e434e48f463d-kube-api-access-cxvwn" (OuterVolumeSpecName: "kube-api-access-cxvwn") pod "8eebda3b-9acf-47b6-9949-e434e48f463d" (UID: "8eebda3b-9acf-47b6-9949-e434e48f463d"). InnerVolumeSpecName "kube-api-access-cxvwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:37:31.941126 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.941088    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.941126 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.941117    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.941126 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.941127    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.941126 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.941134    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eebda3b-9acf-47b6-9949-e434e48f463d-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.941390 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.941142    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eebda3b-9acf-47b6-9949-e434e48f463d-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:31.941390 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:31.941152    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxvwn\" (UniqueName: \"kubernetes.io/projected/8eebda3b-9acf-47b6-9949-e434e48f463d-kube-api-access-cxvwn\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:37:32.561573 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.561541    2579 generic.go:356] "Generic (PLEG): container finished" podID="8eebda3b-9acf-47b6-9949-e434e48f463d" containerID="0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9" exitCode=0
Jul 12 22:37:32.561766 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.561582    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"
Jul 12 22:37:32.561766 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.561598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb" event={"ID":"8eebda3b-9acf-47b6-9949-e434e48f463d","Type":"ContainerDied","Data":"0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9"}
Jul 12 22:37:32.561766 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.561631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb" event={"ID":"8eebda3b-9acf-47b6-9949-e434e48f463d","Type":"ContainerDied","Data":"cf862b89e656ce7cc3715e83f6fca8c7325f3ee30bb95215e4f2c0d97a907ff1"}
Jul 12 22:37:32.561766 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.561647    2579 scope.go:117] "RemoveContainer" containerID="0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9"
Jul 12 22:37:32.571478 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.571272    2579 scope.go:117] "RemoveContainer" containerID="0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9"
Jul 12 22:37:32.571705 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:37:32.571545    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9\": container with ID starting with 0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9 not found: ID does not exist" containerID="0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9"
Jul 12 22:37:32.571705 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.571570    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9"} err="failed to get container status \"0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9\": rpc error: code = NotFound desc = could not find container \"0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9\": container with ID starting with 0c76474f862ea4787addd8c249caecd4087fe43f76645834d2ae6deaca9de8f9 not found: ID does not exist"
Jul 12 22:37:32.582915 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.582892    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"]
Jul 12 22:37:32.586270 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.586249    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/auth-test-model-7a7f11-kserve-558d959d8c-pqxgb"]
Jul 12 22:37:32.937703 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.937623    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a4f186a-0852-475c-8263-0b2a51934a9e" path="/var/lib/kubelet/pods/4a4f186a-0852-475c-8263-0b2a51934a9e/volumes"
Jul 12 22:37:32.938037 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:37:32.938010    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eebda3b-9acf-47b6-9949-e434e48f463d" path="/var/lib/kubelet/pods/8eebda3b-9acf-47b6-9949-e434e48f463d/volumes"
Jul 12 22:38:10.543067 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543017    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"]
Jul 12 22:38:10.543537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543347    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eebda3b-9acf-47b6-9949-e434e48f463d" containerName="main"
Jul 12 22:38:10.543537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543359    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eebda3b-9acf-47b6-9949-e434e48f463d" containerName="main"
Jul 12 22:38:10.543537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543377    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a4f186a-0852-475c-8263-0b2a51934a9e" containerName="main"
Jul 12 22:38:10.543537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543383    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a4f186a-0852-475c-8263-0b2a51934a9e" containerName="main"
Jul 12 22:38:10.543537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543442    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eebda3b-9acf-47b6-9949-e434e48f463d" containerName="main"
Jul 12 22:38:10.543537 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.543452    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a4f186a-0852-475c-8263-0b2a51934a9e" containerName="main"
Jul 12 22:38:10.546489 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.546472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.549515 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.549488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"kube-root-ca.crt\""
Jul 12 22:38:10.550586 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.550561    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"openshift-service-ca.crt\""
Jul 12 22:38:10.550864 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.550841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"default-dockercfg-w2dkh\""
Jul 12 22:38:10.550939 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.550841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"sub-test-model-7a7f11-kserve-self-signed-certs\""
Jul 12 22:38:10.556315 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.556291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"]
Jul 12 22:38:10.650844 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.650805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-home\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.651077 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.650855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tmp-dir\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.651077 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.650871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tls-certs\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.651077 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.650947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-model-cache\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.651077 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.650998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-dshm\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.651077 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.651071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k6vc\" (UniqueName: \"kubernetes.io/projected/bad9e7fd-7c28-4833-9d9d-18a2fd035596-kube-api-access-9k6vc\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.751513 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-home\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.751711 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tmp-dir\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.751711 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tls-certs\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.751711 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-model-cache\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.751893 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-dshm\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.751893 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k6vc\" (UniqueName: \"kubernetes.io/projected/bad9e7fd-7c28-4833-9d9d-18a2fd035596-kube-api-access-9k6vc\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.752001 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tmp-dir\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.752001 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.751987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-home\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.752246 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.752229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-model-cache\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.754330 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.754303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-dshm\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.754752 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.754736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tls-certs\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.760297 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.760275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k6vc\" (UniqueName: \"kubernetes.io/projected/bad9e7fd-7c28-4833-9d9d-18a2fd035596-kube-api-access-9k6vc\") pod \"sub-test-model-7a7f11-kserve-676fd7df77-96vv9\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") " pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.857091 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.856975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:10.992856 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:10.992831    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"]
Jul 12 22:38:10.994236 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:38:10.994206    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbad9e7fd_7c28_4833_9d9d_18a2fd035596.slice/crio-82590505d2278c73d51e531e2b6d4477e4a63d0df8e753e57d94f2ed64c82b9e WatchSource:0}: Error finding container 82590505d2278c73d51e531e2b6d4477e4a63d0df8e753e57d94f2ed64c82b9e: Status 404 returned error can't find the container with id 82590505d2278c73d51e531e2b6d4477e4a63d0df8e753e57d94f2ed64c82b9e
Jul 12 22:38:11.761424 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:11.761382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9" event={"ID":"bad9e7fd-7c28-4833-9d9d-18a2fd035596","Type":"ContainerStarted","Data":"e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692"}
Jul 12 22:38:11.761915 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:11.761438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9" event={"ID":"bad9e7fd-7c28-4833-9d9d-18a2fd035596","Type":"ContainerStarted","Data":"82590505d2278c73d51e531e2b6d4477e4a63d0df8e753e57d94f2ed64c82b9e"}
Jul 12 22:38:11.778595 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:11.778539    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9" podStartSLOduration=1.778522879 podStartE2EDuration="1.778522879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:38:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:38:11.778110525 +0000 UTC m=+2755.406941599" watchObservedRunningTime="2026-07-12 22:38:11.778522879 +0000 UTC m=+2755.407354004"
Jul 12 22:38:20.857654 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:20.857616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:20.858176 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:20.857749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:20.870364 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:20.870343    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:38:21.823091 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:38:21.823058    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:39:03.967679 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:03.967641    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"]
Jul 12 22:39:06.947999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.947967    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"]
Jul 12 22:39:06.951255 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.951229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:06.955040 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.954993    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"rate-test-model-66fe58-kserve-self-signed-certs\""
Jul 12 22:39:06.955192 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.955048    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"default-dockercfg-c4gbw\""
Jul 12 22:39:06.955192 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.955147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"openshift-service-ca.crt\""
Jul 12 22:39:06.955314 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.955292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-66fe58\"/\"kube-root-ca.crt\""
Jul 12 22:39:06.961293 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:06.961265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"]
Jul 12 22:39:07.050385 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.050348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-model-cache\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.050594 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.050393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68de1cdf-300f-4c06-96df-0b446b302ee8-tls-certs\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.050594 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.050475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-dshm\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.050594 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.050536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-home\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.050594 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.050581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-tmp-dir\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.050775 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.050637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv4s5\" (UniqueName: \"kubernetes.io/projected/68de1cdf-300f-4c06-96df-0b446b302ee8-kube-api-access-pv4s5\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.151842 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.151802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv4s5\" (UniqueName: \"kubernetes.io/projected/68de1cdf-300f-4c06-96df-0b446b302ee8-kube-api-access-pv4s5\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152014 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.151855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-model-cache\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152014 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.151883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68de1cdf-300f-4c06-96df-0b446b302ee8-tls-certs\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152149 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.152059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-dshm\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152149 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.152116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-home\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152273 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.152171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-tmp-dir\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152367 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.152340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-model-cache\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152497 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.152473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-home\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.152497 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.152486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-tmp-dir\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.154484 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.154461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-dshm\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.154685 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.154666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68de1cdf-300f-4c06-96df-0b446b302ee8-tls-certs\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.160718 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.160692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv4s5\" (UniqueName: \"kubernetes.io/projected/68de1cdf-300f-4c06-96df-0b446b302ee8-kube-api-access-pv4s5\") pod \"rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") " pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.262443 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.262333    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:07.401915 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:07.401889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"]
Jul 12 22:39:07.403710 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:39:07.403684    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68de1cdf_300f_4c06_96df_0b446b302ee8.slice/crio-dfaef863714314d749e102aacd50907b77aaed3ff6c46969ee4c78c7c8199c52 WatchSource:0}: Error finding container dfaef863714314d749e102aacd50907b77aaed3ff6c46969ee4c78c7c8199c52: Status 404 returned error can't find the container with id dfaef863714314d749e102aacd50907b77aaed3ff6c46969ee4c78c7c8199c52
Jul 12 22:39:08.043931 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:08.043897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz" event={"ID":"68de1cdf-300f-4c06-96df-0b446b302ee8","Type":"ContainerStarted","Data":"fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466"}
Jul 12 22:39:08.044351 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:08.043941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz" event={"ID":"68de1cdf-300f-4c06-96df-0b446b302ee8","Type":"ContainerStarted","Data":"dfaef863714314d749e102aacd50907b77aaed3ff6c46969ee4c78c7c8199c52"}
Jul 12 22:39:08.062544 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:08.062494    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz" podStartSLOduration=2.062478022 podStartE2EDuration="2.062478022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:39:08.060171453 +0000 UTC m=+2811.689002528" watchObservedRunningTime="2026-07-12 22:39:08.062478022 +0000 UTC m=+2811.691309095"
Jul 12 22:39:17.262968 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:17.262923    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:17.262968 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:17.262978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:17.275888 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:17.275866    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:18.105402 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:18.105375    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:39:18.988483 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:18.988440    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9" podUID="bad9e7fd-7c28-4833-9d9d-18a2fd035596" containerName="main" containerID="cri-o://e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692" gracePeriod=45
Jul 12 22:39:19.240955 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.240888    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:39:19.359879 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.359843    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tmp-dir\") pod \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") "
Jul 12 22:39:19.359879 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.359886    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-dshm\") pod \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") "
Jul 12 22:39:19.360124 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.359943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k6vc\" (UniqueName: \"kubernetes.io/projected/bad9e7fd-7c28-4833-9d9d-18a2fd035596-kube-api-access-9k6vc\") pod \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") "
Jul 12 22:39:19.360124 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.359977    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-model-cache\") pod \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") "
Jul 12 22:39:19.360233 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360201    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-home\") pod \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") "
Jul 12 22:39:19.360288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360230    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bad9e7fd-7c28-4833-9d9d-18a2fd035596" (UID: "bad9e7fd-7c28-4833-9d9d-18a2fd035596"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:39:19.360288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360263    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-model-cache" (OuterVolumeSpecName: "model-cache") pod "bad9e7fd-7c28-4833-9d9d-18a2fd035596" (UID: "bad9e7fd-7c28-4833-9d9d-18a2fd035596"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:39:19.360288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tls-certs\") pod \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\" (UID: \"bad9e7fd-7c28-4833-9d9d-18a2fd035596\") "
Jul 12 22:39:19.360447 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360423    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-home" (OuterVolumeSpecName: "home") pod "bad9e7fd-7c28-4833-9d9d-18a2fd035596" (UID: "bad9e7fd-7c28-4833-9d9d-18a2fd035596"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:39:19.360601 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360569    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:39:19.360601 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360586    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:39:19.360601 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.360600    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:39:19.362373 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.362352    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-dshm" (OuterVolumeSpecName: "dshm") pod "bad9e7fd-7c28-4833-9d9d-18a2fd035596" (UID: "bad9e7fd-7c28-4833-9d9d-18a2fd035596"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:39:19.362450 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.362369    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad9e7fd-7c28-4833-9d9d-18a2fd035596-kube-api-access-9k6vc" (OuterVolumeSpecName: "kube-api-access-9k6vc") pod "bad9e7fd-7c28-4833-9d9d-18a2fd035596" (UID: "bad9e7fd-7c28-4833-9d9d-18a2fd035596"). InnerVolumeSpecName "kube-api-access-9k6vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:39:19.362450 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.362410    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bad9e7fd-7c28-4833-9d9d-18a2fd035596" (UID: "bad9e7fd-7c28-4833-9d9d-18a2fd035596"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:39:19.460999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.460958    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad9e7fd-7c28-4833-9d9d-18a2fd035596-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:39:19.460999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.460992    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad9e7fd-7c28-4833-9d9d-18a2fd035596-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:39:19.460999 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:19.461002    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k6vc\" (UniqueName: \"kubernetes.io/projected/bad9e7fd-7c28-4833-9d9d-18a2fd035596-kube-api-access-9k6vc\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:39:20.105283 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.105246    2579 generic.go:356] "Generic (PLEG): container finished" podID="bad9e7fd-7c28-4833-9d9d-18a2fd035596" containerID="e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692" exitCode=0
Jul 12 22:39:20.105756 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.105293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"
Jul 12 22:39:20.105756 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.105305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9" event={"ID":"bad9e7fd-7c28-4833-9d9d-18a2fd035596","Type":"ContainerDied","Data":"e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692"}
Jul 12 22:39:20.105756 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.105337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9" event={"ID":"bad9e7fd-7c28-4833-9d9d-18a2fd035596","Type":"ContainerDied","Data":"82590505d2278c73d51e531e2b6d4477e4a63d0df8e753e57d94f2ed64c82b9e"}
Jul 12 22:39:20.105756 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.105354    2579 scope.go:117] "RemoveContainer" containerID="e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692"
Jul 12 22:39:20.117117 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.117094    2579 scope.go:117] "RemoveContainer" containerID="e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692"
Jul 12 22:39:20.117795 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:39:20.117756    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692\": container with ID starting with e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692 not found: ID does not exist" containerID="e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692"
Jul 12 22:39:20.117893 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.117804    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692"} err="failed to get container status \"e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692\": rpc error: code = NotFound desc = could not find container \"e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692\": container with ID starting with e102e71311ef439c8ddab3a83975abb610df6ac66b3c61a5d40d1f3391af8692 not found: ID does not exist"
Jul 12 22:39:20.128050 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.128008    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"]
Jul 12 22:39:20.131540 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.131516    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/sub-test-model-7a7f11-kserve-676fd7df77-96vv9"]
Jul 12 22:39:20.937499 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:20.937467    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad9e7fd-7c28-4833-9d9d-18a2fd035596" path="/var/lib/kubelet/pods/bad9e7fd-7c28-4833-9d9d-18a2fd035596/volumes"
Jul 12 22:39:31.235577 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.235536    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"]
Jul 12 22:39:31.235954 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.235898    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad9e7fd-7c28-4833-9d9d-18a2fd035596" containerName="main"
Jul 12 22:39:31.235954 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.235910    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad9e7fd-7c28-4833-9d9d-18a2fd035596" containerName="main"
Jul 12 22:39:31.236048 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.235992    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad9e7fd-7c28-4833-9d9d-18a2fd035596" containerName="main"
Jul 12 22:39:31.238935 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.238915    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.241711 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.241686    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"openshift-service-ca.crt\""
Jul 12 22:39:31.241840 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.241686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"rate-test-model-7a7f11-kserve-self-signed-certs\""
Jul 12 22:39:31.242683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.242667    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"default-dockercfg-w2dkh\""
Jul 12 22:39:31.242765 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.242703    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7a7f11\"/\"kube-root-ca.crt\""
Jul 12 22:39:31.249422 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.249396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"]
Jul 12 22:39:31.367987 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.367952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdhzm\" (UniqueName: \"kubernetes.io/projected/602c5f86-bbe0-4483-8eed-8418e4de138e-kube-api-access-pdhzm\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.368216 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.368047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-dshm\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.368216 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.368086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-model-cache\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.368216 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.368182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-home\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.368216 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.368212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-tmp-dir\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.368377 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.368229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602c5f86-bbe0-4483-8eed-8418e4de138e-tls-certs\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.468850 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.468814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdhzm\" (UniqueName: \"kubernetes.io/projected/602c5f86-bbe0-4483-8eed-8418e4de138e-kube-api-access-pdhzm\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469070 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.468866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-dshm\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469070 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.468892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-model-cache\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469070 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.468938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-home\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469070 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.468955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-tmp-dir\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469070 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.468969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602c5f86-bbe0-4483-8eed-8418e4de138e-tls-certs\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469438 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.469406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-model-cache\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469438 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.469424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-tmp-dir\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.469611 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.469485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-home\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.471526 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.471502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-dshm\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.471804 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.471780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602c5f86-bbe0-4483-8eed-8418e4de138e-tls-certs\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.477611 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.477585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdhzm\" (UniqueName: \"kubernetes.io/projected/602c5f86-bbe0-4483-8eed-8418e4de138e-kube-api-access-pdhzm\") pod \"rate-test-model-7a7f11-kserve-6865d69575-nq9gv\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") " pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.549366 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.549336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:31.692926 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:31.692899    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"]
Jul 12 22:39:31.694070 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:39:31.694045    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod602c5f86_bbe0_4483_8eed_8418e4de138e.slice/crio-0f6f3400adbed95dacaee24da9e02d3fde7cef498506bc71f8a413a33d2764d9 WatchSource:0}: Error finding container 0f6f3400adbed95dacaee24da9e02d3fde7cef498506bc71f8a413a33d2764d9: Status 404 returned error can't find the container with id 0f6f3400adbed95dacaee24da9e02d3fde7cef498506bc71f8a413a33d2764d9
Jul 12 22:39:32.170677 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:32.170639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv" event={"ID":"602c5f86-bbe0-4483-8eed-8418e4de138e","Type":"ContainerStarted","Data":"2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6"}
Jul 12 22:39:32.170840 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:32.170689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv" event={"ID":"602c5f86-bbe0-4483-8eed-8418e4de138e","Type":"ContainerStarted","Data":"0f6f3400adbed95dacaee24da9e02d3fde7cef498506bc71f8a413a33d2764d9"}
Jul 12 22:39:32.189518 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:32.189463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv" podStartSLOduration=1.189446017 podStartE2EDuration="1.189446017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:39:32.186994159 +0000 UTC m=+2835.815825235" watchObservedRunningTime="2026-07-12 22:39:32.189446017 +0000 UTC m=+2835.818277091"
Jul 12 22:39:41.550363 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:41.550308    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:41.550363 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:41.550376    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:41.563128 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:41.563100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:39:42.233566 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:39:42.233538    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:40:18.814584 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:18.814551    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"]
Jul 12 22:40:19.724718 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:19.724685    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"]
Jul 12 22:40:20.654154 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.654121    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7553-140033591044144"]
Jul 12 22:40:20.658658 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.658640    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:20.661888 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.661865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-bs2xj\""
Jul 12 22:40:20.664525 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.664502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044144"]
Jul 12 22:40:20.817785 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.817737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qgg9\" (UniqueName: \"kubernetes.io/projected/90c05ecc-c3a1-4dba-870f-c241b9c45fa0-kube-api-access-4qgg9\") pod \"test-curl-7553-140033591044144\" (UID: \"90c05ecc-c3a1-4dba-870f-c241b9c45fa0\") " pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:20.919129 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.919005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qgg9\" (UniqueName: \"kubernetes.io/projected/90c05ecc-c3a1-4dba-870f-c241b9c45fa0-kube-api-access-4qgg9\") pod \"test-curl-7553-140033591044144\" (UID: \"90c05ecc-c3a1-4dba-870f-c241b9c45fa0\") " pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:20.927844 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.927813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qgg9\" (UniqueName: \"kubernetes.io/projected/90c05ecc-c3a1-4dba-870f-c241b9c45fa0-kube-api-access-4qgg9\") pod \"test-curl-7553-140033591044144\" (UID: \"90c05ecc-c3a1-4dba-870f-c241b9c45fa0\") " pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:20.969520 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:20.969487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:21.111606 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:21.111581    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044144"]
Jul 12 22:40:21.114186 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:40:21.114154    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90c05ecc_c3a1_4dba_870f_c241b9c45fa0.slice/crio-651a2e9399765bb64ab30c076cb4c25cdbc0ec06f751b4191793a5ff9214163b WatchSource:0}: Error finding container 651a2e9399765bb64ab30c076cb4c25cdbc0ec06f751b4191793a5ff9214163b: Status 404 returned error can't find the container with id 651a2e9399765bb64ab30c076cb4c25cdbc0ec06f751b4191793a5ff9214163b
Jul 12 22:40:21.115843 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:21.115826    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:40:21.434774 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:21.434734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033591044144" event={"ID":"90c05ecc-c3a1-4dba-870f-c241b9c45fa0","Type":"ContainerStarted","Data":"651a2e9399765bb64ab30c076cb4c25cdbc0ec06f751b4191793a5ff9214163b"}
Jul 12 22:40:22.440900 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:22.440856    2579 generic.go:356] "Generic (PLEG): container finished" podID="90c05ecc-c3a1-4dba-870f-c241b9c45fa0" containerID="c58a2b3b20fba1b0f603afa2a3f67ba744ce0ac9474569926ddfb8557abdce1a" exitCode=0
Jul 12 22:40:22.441377 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:22.440947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033591044144" event={"ID":"90c05ecc-c3a1-4dba-870f-c241b9c45fa0","Type":"ContainerDied","Data":"c58a2b3b20fba1b0f603afa2a3f67ba744ce0ac9474569926ddfb8557abdce1a"}
Jul 12 22:40:23.579261 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.579237    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:23.619114 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.619082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7553-140033591044144_90c05ecc-c3a1-4dba-870f-c241b9c45fa0/test-curl-7553-140033591044144/0.log"
Jul 12 22:40:23.642534 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.642502    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044144"]
Jul 12 22:40:23.646559 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.646535    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044144"]
Jul 12 22:40:23.747650 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.747553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qgg9\" (UniqueName: \"kubernetes.io/projected/90c05ecc-c3a1-4dba-870f-c241b9c45fa0-kube-api-access-4qgg9\") pod \"90c05ecc-c3a1-4dba-870f-c241b9c45fa0\" (UID: \"90c05ecc-c3a1-4dba-870f-c241b9c45fa0\") "
Jul 12 22:40:23.749976 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.749951    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c05ecc-c3a1-4dba-870f-c241b9c45fa0-kube-api-access-4qgg9" (OuterVolumeSpecName: "kube-api-access-4qgg9") pod "90c05ecc-c3a1-4dba-870f-c241b9c45fa0" (UID: "90c05ecc-c3a1-4dba-870f-c241b9c45fa0"). InnerVolumeSpecName "kube-api-access-4qgg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:23.760393 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.760366    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7553-140033591044400"]
Jul 12 22:40:23.760707 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.760696    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c05ecc-c3a1-4dba-870f-c241b9c45fa0" containerName="test-curl-7553-140033591044144"
Jul 12 22:40:23.760759 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.760709    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c05ecc-c3a1-4dba-870f-c241b9c45fa0" containerName="test-curl-7553-140033591044144"
Jul 12 22:40:23.760794 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.760764    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c05ecc-c3a1-4dba-870f-c241b9c45fa0" containerName="test-curl-7553-140033591044144"
Jul 12 22:40:23.763687 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.763672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:23.770659 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.770636    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044400"]
Jul 12 22:40:23.848555 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.848517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh68h\" (UniqueName: \"kubernetes.io/projected/11669c54-a0af-4aca-a9f4-8e66dbae5f7a-kube-api-access-lh68h\") pod \"test-curl-7553-140033591044400\" (UID: \"11669c54-a0af-4aca-a9f4-8e66dbae5f7a\") " pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:23.848725 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.848578    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qgg9\" (UniqueName: \"kubernetes.io/projected/90c05ecc-c3a1-4dba-870f-c241b9c45fa0-kube-api-access-4qgg9\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:23.949166 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.949136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh68h\" (UniqueName: \"kubernetes.io/projected/11669c54-a0af-4aca-a9f4-8e66dbae5f7a-kube-api-access-lh68h\") pod \"test-curl-7553-140033591044400\" (UID: \"11669c54-a0af-4aca-a9f4-8e66dbae5f7a\") " pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:23.957574 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:23.957543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh68h\" (UniqueName: \"kubernetes.io/projected/11669c54-a0af-4aca-a9f4-8e66dbae5f7a-kube-api-access-lh68h\") pod \"test-curl-7553-140033591044400\" (UID: \"11669c54-a0af-4aca-a9f4-8e66dbae5f7a\") " pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:24.073360 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:24.073328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:24.207113 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:24.207085    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044400"]
Jul 12 22:40:24.208934 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:40:24.208909    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11669c54_a0af_4aca_a9f4_8e66dbae5f7a.slice/crio-38e4e911c6959e8a5c00a05d9b9701669f9f3fc5fc632e715688e8ec9ee6ed15 WatchSource:0}: Error finding container 38e4e911c6959e8a5c00a05d9b9701669f9f3fc5fc632e715688e8ec9ee6ed15: Status 404 returned error can't find the container with id 38e4e911c6959e8a5c00a05d9b9701669f9f3fc5fc632e715688e8ec9ee6ed15
Jul 12 22:40:24.452228 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:24.452135    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:24.452228 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:24.452159    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="651a2e9399765bb64ab30c076cb4c25cdbc0ec06f751b4191793a5ff9214163b"
Jul 12 22:40:24.453294 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:24.453245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033591044400" event={"ID":"11669c54-a0af-4aca-a9f4-8e66dbae5f7a","Type":"ContainerStarted","Data":"38e4e911c6959e8a5c00a05d9b9701669f9f3fc5fc632e715688e8ec9ee6ed15"}
Jul 12 22:40:24.462988 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:40:24.462961    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7553-140033591044144\" is forbidden: User \"system:node:ip-10-0-141-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-23.ec2.internal' and this object" podUID="90c05ecc-c3a1-4dba-870f-c241b9c45fa0" pod="openshift-ingress/test-curl-7553-140033591044144"
Jul 12 22:40:24.944095 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:24.944059    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c05ecc-c3a1-4dba-870f-c241b9c45fa0" path="/var/lib/kubelet/pods/90c05ecc-c3a1-4dba-870f-c241b9c45fa0/volumes"
Jul 12 22:40:25.460303 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:25.460269    2579 generic.go:356] "Generic (PLEG): container finished" podID="11669c54-a0af-4aca-a9f4-8e66dbae5f7a" containerID="83ecc227086f96028a13b958410a714621e3ec001767dc8a1ca40877da075472" exitCode=0
Jul 12 22:40:25.460472 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:25.460370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033591044400" event={"ID":"11669c54-a0af-4aca-a9f4-8e66dbae5f7a","Type":"ContainerDied","Data":"83ecc227086f96028a13b958410a714621e3ec001767dc8a1ca40877da075472"}
Jul 12 22:40:26.617633 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.617604    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:26.637425 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.637394    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7553-140033591044400_11669c54-a0af-4aca-a9f4-8e66dbae5f7a/test-curl-7553-140033591044400/0.log"
Jul 12 22:40:26.658084 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.658049    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044400"]
Jul 12 22:40:26.660177 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.660150    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7553-140033591044400"]
Jul 12 22:40:26.775063 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.774919    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh68h\" (UniqueName: \"kubernetes.io/projected/11669c54-a0af-4aca-a9f4-8e66dbae5f7a-kube-api-access-lh68h\") pod \"11669c54-a0af-4aca-a9f4-8e66dbae5f7a\" (UID: \"11669c54-a0af-4aca-a9f4-8e66dbae5f7a\") "
Jul 12 22:40:26.777199 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.777166    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11669c54-a0af-4aca-a9f4-8e66dbae5f7a-kube-api-access-lh68h" (OuterVolumeSpecName: "kube-api-access-lh68h") pod "11669c54-a0af-4aca-a9f4-8e66dbae5f7a" (UID: "11669c54-a0af-4aca-a9f4-8e66dbae5f7a"). InnerVolumeSpecName "kube-api-access-lh68h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:26.819985 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.819948    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:26.820353 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.820338    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11669c54-a0af-4aca-a9f4-8e66dbae5f7a" containerName="test-curl-7553-140033591044400"
Jul 12 22:40:26.820398 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.820355    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11669c54-a0af-4aca-a9f4-8e66dbae5f7a" containerName="test-curl-7553-140033591044400"
Jul 12 22:40:26.820433 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.820423    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11669c54-a0af-4aca-a9f4-8e66dbae5f7a" containerName="test-curl-7553-140033591044400"
Jul 12 22:40:26.823341 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.823324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:26.827989 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.827963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:26.876450 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.876408    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh68h\" (UniqueName: \"kubernetes.io/projected/11669c54-a0af-4aca-a9f4-8e66dbae5f7a-kube-api-access-lh68h\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:26.937919 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.937877    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11669c54-a0af-4aca-a9f4-8e66dbae5f7a" path="/var/lib/kubelet/pods/11669c54-a0af-4aca-a9f4-8e66dbae5f7a/volumes"
Jul 12 22:40:26.977700 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:26.977660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vjnw\" (UniqueName: \"kubernetes.io/projected/e792b9b7-a184-460e-9326-f9fcc6cdb3f8-kube-api-access-2vjnw\") pod \"test-curl-7553-140033590960176\" (UID: \"e792b9b7-a184-460e-9326-f9fcc6cdb3f8\") " pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:27.079103 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.079050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjnw\" (UniqueName: \"kubernetes.io/projected/e792b9b7-a184-460e-9326-f9fcc6cdb3f8-kube-api-access-2vjnw\") pod \"test-curl-7553-140033590960176\" (UID: \"e792b9b7-a184-460e-9326-f9fcc6cdb3f8\") " pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:27.087872 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.087842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vjnw\" (UniqueName: \"kubernetes.io/projected/e792b9b7-a184-460e-9326-f9fcc6cdb3f8-kube-api-access-2vjnw\") pod \"test-curl-7553-140033590960176\" (UID: \"e792b9b7-a184-460e-9326-f9fcc6cdb3f8\") " pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:27.133508 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.133472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:27.270051 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.270002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:27.271571 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:40:27.271545    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode792b9b7_a184_460e_9326_f9fcc6cdb3f8.slice/crio-201f6fac2f8c236301f88832e50a82b9a8af14a1386700d10edc8035d019605b WatchSource:0}: Error finding container 201f6fac2f8c236301f88832e50a82b9a8af14a1386700d10edc8035d019605b: Status 404 returned error can't find the container with id 201f6fac2f8c236301f88832e50a82b9a8af14a1386700d10edc8035d019605b
Jul 12 22:40:27.473181 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.473087    2579 scope.go:117] "RemoveContainer" containerID="83ecc227086f96028a13b958410a714621e3ec001767dc8a1ca40877da075472"
Jul 12 22:40:27.473355 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.473089    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033591044400"
Jul 12 22:40:27.474609 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:27.474410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033590960176" event={"ID":"e792b9b7-a184-460e-9326-f9fcc6cdb3f8","Type":"ContainerStarted","Data":"201f6fac2f8c236301f88832e50a82b9a8af14a1386700d10edc8035d019605b"}
Jul 12 22:40:28.481822 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:28.481782    2579 generic.go:356] "Generic (PLEG): container finished" podID="e792b9b7-a184-460e-9326-f9fcc6cdb3f8" containerID="1897871570bfa605acd9537d321a142f0847067033e59dd7f21dd8ce489b4df2" exitCode=0
Jul 12 22:40:28.482325 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:28.481873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033590960176" event={"ID":"e792b9b7-a184-460e-9326-f9fcc6cdb3f8","Type":"ContainerDied","Data":"1897871570bfa605acd9537d321a142f0847067033e59dd7f21dd8ce489b4df2"}
Jul 12 22:40:29.624683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.624658    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:29.647373 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.647343    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7553-140033590960176_e792b9b7-a184-460e-9326-f9fcc6cdb3f8/test-curl-7553-140033590960176/0.log"
Jul 12 22:40:29.672237 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.672205    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:29.674252 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.674233    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:29.788106 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.788071    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:29.788411 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.788399    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e792b9b7-a184-460e-9326-f9fcc6cdb3f8" containerName="test-curl-7553-140033590960176"
Jul 12 22:40:29.788455 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.788413    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e792b9b7-a184-460e-9326-f9fcc6cdb3f8" containerName="test-curl-7553-140033590960176"
Jul 12 22:40:29.788490 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.788477    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e792b9b7-a184-460e-9326-f9fcc6cdb3f8" containerName="test-curl-7553-140033590960176"
Jul 12 22:40:29.791368 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.791353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:29.798836 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.798814    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:29.804877 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.804856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vjnw\" (UniqueName: \"kubernetes.io/projected/e792b9b7-a184-460e-9326-f9fcc6cdb3f8-kube-api-access-2vjnw\") pod \"e792b9b7-a184-460e-9326-f9fcc6cdb3f8\" (UID: \"e792b9b7-a184-460e-9326-f9fcc6cdb3f8\") "
Jul 12 22:40:29.807214 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.807180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e792b9b7-a184-460e-9326-f9fcc6cdb3f8-kube-api-access-2vjnw" (OuterVolumeSpecName: "kube-api-access-2vjnw") pod "e792b9b7-a184-460e-9326-f9fcc6cdb3f8" (UID: "e792b9b7-a184-460e-9326-f9fcc6cdb3f8"). InnerVolumeSpecName "kube-api-access-2vjnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:29.906256 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.906218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xgd\" (UniqueName: \"kubernetes.io/projected/eb177a88-561b-4279-a1c6-7f816dffe148-kube-api-access-j4xgd\") pod \"test-curl-7553-140033590960176\" (UID: \"eb177a88-561b-4279-a1c6-7f816dffe148\") " pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:29.906256 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:29.906262    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vjnw\" (UniqueName: \"kubernetes.io/projected/e792b9b7-a184-460e-9326-f9fcc6cdb3f8-kube-api-access-2vjnw\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:30.007361 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.007319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xgd\" (UniqueName: \"kubernetes.io/projected/eb177a88-561b-4279-a1c6-7f816dffe148-kube-api-access-j4xgd\") pod \"test-curl-7553-140033590960176\" (UID: \"eb177a88-561b-4279-a1c6-7f816dffe148\") " pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:30.015503 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.015469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xgd\" (UniqueName: \"kubernetes.io/projected/eb177a88-561b-4279-a1c6-7f816dffe148-kube-api-access-j4xgd\") pod \"test-curl-7553-140033590960176\" (UID: \"eb177a88-561b-4279-a1c6-7f816dffe148\") " pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:30.101731 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.101629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:30.242075 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.242042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:30.243492 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:40:30.243463    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb177a88_561b_4279_a1c6_7f816dffe148.slice/crio-18664aaa5cb0e4520ae47a5b26f65df9228274ec8ce14eb177bf5f016f852067 WatchSource:0}: Error finding container 18664aaa5cb0e4520ae47a5b26f65df9228274ec8ce14eb177bf5f016f852067: Status 404 returned error can't find the container with id 18664aaa5cb0e4520ae47a5b26f65df9228274ec8ce14eb177bf5f016f852067
Jul 12 22:40:30.494939 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.494870    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:30.495109 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.494871    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="201f6fac2f8c236301f88832e50a82b9a8af14a1386700d10edc8035d019605b"
Jul 12 22:40:30.496205 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.496181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033590960176" event={"ID":"eb177a88-561b-4279-a1c6-7f816dffe148","Type":"ContainerStarted","Data":"18664aaa5cb0e4520ae47a5b26f65df9228274ec8ce14eb177bf5f016f852067"}
Jul 12 22:40:30.506920 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.506892    2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7553-140033590960176" oldPodUID="e792b9b7-a184-460e-9326-f9fcc6cdb3f8" podUID="eb177a88-561b-4279-a1c6-7f816dffe148"
Jul 12 22:40:30.938526 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:30.938494    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e792b9b7-a184-460e-9326-f9fcc6cdb3f8" path="/var/lib/kubelet/pods/e792b9b7-a184-460e-9326-f9fcc6cdb3f8/volumes"
Jul 12 22:40:31.503122 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:31.503084    2579 generic.go:356] "Generic (PLEG): container finished" podID="eb177a88-561b-4279-a1c6-7f816dffe148" containerID="8c2635d1dc442cdaa5ac0646d82abc09b4bc2ca8e1c646ad3422d5accdccedf7" exitCode=0
Jul 12 22:40:31.503322 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:31.503172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033590960176" event={"ID":"eb177a88-561b-4279-a1c6-7f816dffe148","Type":"ContainerDied","Data":"8c2635d1dc442cdaa5ac0646d82abc09b4bc2ca8e1c646ad3422d5accdccedf7"}
Jul 12 22:40:32.642223 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.642199    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:32.663167 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.663134    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7553-140033590960176_eb177a88-561b-4279-a1c6-7f816dffe148/test-curl-7553-140033590960176/0.log"
Jul 12 22:40:32.685452 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.685422    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:32.689349 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.689316    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7553-140033590960176"]
Jul 12 22:40:32.726365 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.726334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4xgd\" (UniqueName: \"kubernetes.io/projected/eb177a88-561b-4279-a1c6-7f816dffe148-kube-api-access-j4xgd\") pod \"eb177a88-561b-4279-a1c6-7f816dffe148\" (UID: \"eb177a88-561b-4279-a1c6-7f816dffe148\") "
Jul 12 22:40:32.728598 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.728574    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb177a88-561b-4279-a1c6-7f816dffe148-kube-api-access-j4xgd" (OuterVolumeSpecName: "kube-api-access-j4xgd") pod "eb177a88-561b-4279-a1c6-7f816dffe148" (UID: "eb177a88-561b-4279-a1c6-7f816dffe148"). InnerVolumeSpecName "kube-api-access-j4xgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:32.827052 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.827009    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4xgd\" (UniqueName: \"kubernetes.io/projected/eb177a88-561b-4279-a1c6-7f816dffe148-kube-api-access-j4xgd\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:32.937637 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:32.937602    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb177a88-561b-4279-a1c6-7f816dffe148" path="/var/lib/kubelet/pods/eb177a88-561b-4279-a1c6-7f816dffe148/volumes"
Jul 12 22:40:33.515684 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:33.515644    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590960176"
Jul 12 22:40:33.515684 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:33.515685    2579 scope.go:117] "RemoveContainer" containerID="8c2635d1dc442cdaa5ac0646d82abc09b4bc2ca8e1c646ad3422d5accdccedf7"
Jul 12 22:40:33.836132 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:33.836064    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz" podUID="68de1cdf-300f-4c06-96df-0b446b302ee8" containerName="main" containerID="cri-o://fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466" gracePeriod=45
Jul 12 22:40:34.100911 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.100851    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:40:34.137323 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137282    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-dshm\") pod \"68de1cdf-300f-4c06-96df-0b446b302ee8\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") "
Jul 12 22:40:34.137323 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv4s5\" (UniqueName: \"kubernetes.io/projected/68de1cdf-300f-4c06-96df-0b446b302ee8-kube-api-access-pv4s5\") pod \"68de1cdf-300f-4c06-96df-0b446b302ee8\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") "
Jul 12 22:40:34.137587 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137378    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-tmp-dir\") pod \"68de1cdf-300f-4c06-96df-0b446b302ee8\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") "
Jul 12 22:40:34.137587 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137400    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68de1cdf-300f-4c06-96df-0b446b302ee8-tls-certs\") pod \"68de1cdf-300f-4c06-96df-0b446b302ee8\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") "
Jul 12 22:40:34.137587 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137448    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-home\") pod \"68de1cdf-300f-4c06-96df-0b446b302ee8\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") "
Jul 12 22:40:34.137587 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137482    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-model-cache\") pod \"68de1cdf-300f-4c06-96df-0b446b302ee8\" (UID: \"68de1cdf-300f-4c06-96df-0b446b302ee8\") "
Jul 12 22:40:34.137816 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68de1cdf-300f-4c06-96df-0b446b302ee8" (UID: "68de1cdf-300f-4c06-96df-0b446b302ee8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:34.137816 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137760    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-home" (OuterVolumeSpecName: "home") pod "68de1cdf-300f-4c06-96df-0b446b302ee8" (UID: "68de1cdf-300f-4c06-96df-0b446b302ee8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:34.137935 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.137889    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-model-cache" (OuterVolumeSpecName: "model-cache") pod "68de1cdf-300f-4c06-96df-0b446b302ee8" (UID: "68de1cdf-300f-4c06-96df-0b446b302ee8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:34.139643 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.139610    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-dshm" (OuterVolumeSpecName: "dshm") pod "68de1cdf-300f-4c06-96df-0b446b302ee8" (UID: "68de1cdf-300f-4c06-96df-0b446b302ee8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:34.139765 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.139641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68de1cdf-300f-4c06-96df-0b446b302ee8-kube-api-access-pv4s5" (OuterVolumeSpecName: "kube-api-access-pv4s5") pod "68de1cdf-300f-4c06-96df-0b446b302ee8" (UID: "68de1cdf-300f-4c06-96df-0b446b302ee8"). InnerVolumeSpecName "kube-api-access-pv4s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:34.139765 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.139692    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68de1cdf-300f-4c06-96df-0b446b302ee8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68de1cdf-300f-4c06-96df-0b446b302ee8" (UID: "68de1cdf-300f-4c06-96df-0b446b302ee8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:40:34.238297 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.238254    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:34.238297 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.238289    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv4s5\" (UniqueName: \"kubernetes.io/projected/68de1cdf-300f-4c06-96df-0b446b302ee8-kube-api-access-pv4s5\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:34.238297 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.238302    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:34.238542 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.238314    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68de1cdf-300f-4c06-96df-0b446b302ee8-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:34.238542 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.238326    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:34.238542 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.238336    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68de1cdf-300f-4c06-96df-0b446b302ee8-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:34.523560 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.523468    2579 generic.go:356] "Generic (PLEG): container finished" podID="68de1cdf-300f-4c06-96df-0b446b302ee8" containerID="fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466" exitCode=0
Jul 12 22:40:34.523560 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.523521    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"
Jul 12 22:40:34.523560 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.523538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz" event={"ID":"68de1cdf-300f-4c06-96df-0b446b302ee8","Type":"ContainerDied","Data":"fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466"}
Jul 12 22:40:34.523839 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.523579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz" event={"ID":"68de1cdf-300f-4c06-96df-0b446b302ee8","Type":"ContainerDied","Data":"dfaef863714314d749e102aacd50907b77aaed3ff6c46969ee4c78c7c8199c52"}
Jul 12 22:40:34.523839 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.523596    2579 scope.go:117] "RemoveContainer" containerID="fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466"
Jul 12 22:40:34.535580 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.535563    2579 scope.go:117] "RemoveContainer" containerID="fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466"
Jul 12 22:40:34.536136 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:40:34.536096    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466\": container with ID starting with fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466 not found: ID does not exist" containerID="fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466"
Jul 12 22:40:34.536241 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.536146    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466"} err="failed to get container status \"fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466\": rpc error: code = NotFound desc = could not find container \"fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466\": container with ID starting with fc00fd881eeb878e7ecb8bcf3f2528d857b82e9304001caaa6e88557b523c466 not found: ID does not exist"
Jul 12 22:40:34.546226 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.546196    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"]
Jul 12 22:40:34.548244 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.548220    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-66fe58/rate-test-model-66fe58-kserve-6dc77fc6f9-kvlbz"]
Jul 12 22:40:34.745563 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.745520    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv" podUID="602c5f86-bbe0-4483-8eed-8418e4de138e" containerName="main" containerID="cri-o://2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6" gracePeriod=45
Jul 12 22:40:34.941243 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:34.941205    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68de1cdf-300f-4c06-96df-0b446b302ee8" path="/var/lib/kubelet/pods/68de1cdf-300f-4c06-96df-0b446b302ee8/volumes"
Jul 12 22:40:35.001444 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.001416    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:40:35.042115 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042072    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-home\") pod \"602c5f86-bbe0-4483-8eed-8418e4de138e\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") "
Jul 12 22:40:35.042295 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042131    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-model-cache\") pod \"602c5f86-bbe0-4483-8eed-8418e4de138e\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") "
Jul 12 22:40:35.042295 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-dshm\") pod \"602c5f86-bbe0-4483-8eed-8418e4de138e\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") "
Jul 12 22:40:35.042295 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042212    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-tmp-dir\") pod \"602c5f86-bbe0-4483-8eed-8418e4de138e\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") "
Jul 12 22:40:35.042295 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602c5f86-bbe0-4483-8eed-8418e4de138e-tls-certs\") pod \"602c5f86-bbe0-4483-8eed-8418e4de138e\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") "
Jul 12 22:40:35.042510 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdhzm\" (UniqueName: \"kubernetes.io/projected/602c5f86-bbe0-4483-8eed-8418e4de138e-kube-api-access-pdhzm\") pod \"602c5f86-bbe0-4483-8eed-8418e4de138e\" (UID: \"602c5f86-bbe0-4483-8eed-8418e4de138e\") "
Jul 12 22:40:35.042510 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042396    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-home" (OuterVolumeSpecName: "home") pod "602c5f86-bbe0-4483-8eed-8418e4de138e" (UID: "602c5f86-bbe0-4483-8eed-8418e4de138e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:35.042510 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042403    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-model-cache" (OuterVolumeSpecName: "model-cache") pod "602c5f86-bbe0-4483-8eed-8418e4de138e" (UID: "602c5f86-bbe0-4483-8eed-8418e4de138e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:35.042676 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042566    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-home\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:35.042676 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042570    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "602c5f86-bbe0-4483-8eed-8418e4de138e" (UID: "602c5f86-bbe0-4483-8eed-8418e4de138e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:35.042676 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.042585    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-model-cache\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:35.044471 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.044439    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-dshm" (OuterVolumeSpecName: "dshm") pod "602c5f86-bbe0-4483-8eed-8418e4de138e" (UID: "602c5f86-bbe0-4483-8eed-8418e4de138e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:40:35.044613 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.044591    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/602c5f86-bbe0-4483-8eed-8418e4de138e-kube-api-access-pdhzm" (OuterVolumeSpecName: "kube-api-access-pdhzm") pod "602c5f86-bbe0-4483-8eed-8418e4de138e" (UID: "602c5f86-bbe0-4483-8eed-8418e4de138e"). InnerVolumeSpecName "kube-api-access-pdhzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:35.044916 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.044897    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/602c5f86-bbe0-4483-8eed-8418e4de138e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "602c5f86-bbe0-4483-8eed-8418e4de138e" (UID: "602c5f86-bbe0-4483-8eed-8418e4de138e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:40:35.143683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.143589    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-dshm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:35.143683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.143624    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602c5f86-bbe0-4483-8eed-8418e4de138e-tmp-dir\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:35.143683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.143633    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602c5f86-bbe0-4483-8eed-8418e4de138e-tls-certs\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:35.143683 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.143643    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdhzm\" (UniqueName: \"kubernetes.io/projected/602c5f86-bbe0-4483-8eed-8418e4de138e-kube-api-access-pdhzm\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:35.530243 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.530188    2579 generic.go:356] "Generic (PLEG): container finished" podID="602c5f86-bbe0-4483-8eed-8418e4de138e" containerID="2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6" exitCode=0
Jul 12 22:40:35.530243 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.530232    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"
Jul 12 22:40:35.530457 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.530280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv" event={"ID":"602c5f86-bbe0-4483-8eed-8418e4de138e","Type":"ContainerDied","Data":"2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6"}
Jul 12 22:40:35.530457 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.530341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv" event={"ID":"602c5f86-bbe0-4483-8eed-8418e4de138e","Type":"ContainerDied","Data":"0f6f3400adbed95dacaee24da9e02d3fde7cef498506bc71f8a413a33d2764d9"}
Jul 12 22:40:35.530457 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.530361    2579 scope.go:117] "RemoveContainer" containerID="2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6"
Jul 12 22:40:35.539794 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.539772    2579 scope.go:117] "RemoveContainer" containerID="2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6"
Jul 12 22:40:35.540071 ip-10-0-141-23 kubenswrapper[2579]: E0712 22:40:35.540048    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6\": container with ID starting with 2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6 not found: ID does not exist" containerID="2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6"
Jul 12 22:40:35.540199 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.540083    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6"} err="failed to get container status \"2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6\": rpc error: code = NotFound desc = could not find container \"2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6\": container with ID starting with 2da7aa014861ba1f35c94800abdfa55670c8b747d76607d4c9b64c9c357097e6 not found: ID does not exist"
Jul 12 22:40:35.552484 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.552452    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"]
Jul 12 22:40:35.557966 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.557943    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7a7f11/rate-test-model-7a7f11-kserve-6865d69575-nq9gv"]
Jul 12 22:40:35.904227 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904144    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7553-140033590961184"]
Jul 12 22:40:35.904477 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904465    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb177a88-561b-4279-a1c6-7f816dffe148" containerName="test-curl-7553-140033590960176"
Jul 12 22:40:35.904525 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904479    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb177a88-561b-4279-a1c6-7f816dffe148" containerName="test-curl-7553-140033590960176"
Jul 12 22:40:35.904525 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904492    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602c5f86-bbe0-4483-8eed-8418e4de138e" containerName="main"
Jul 12 22:40:35.904525 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904498    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="602c5f86-bbe0-4483-8eed-8418e4de138e" containerName="main"
Jul 12 22:40:35.904525 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904510    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68de1cdf-300f-4c06-96df-0b446b302ee8" containerName="main"
Jul 12 22:40:35.904525 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904515    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="68de1cdf-300f-4c06-96df-0b446b302ee8" containerName="main"
Jul 12 22:40:35.904667 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904573    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="68de1cdf-300f-4c06-96df-0b446b302ee8" containerName="main"
Jul 12 22:40:35.904667 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904581    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="602c5f86-bbe0-4483-8eed-8418e4de138e" containerName="main"
Jul 12 22:40:35.904667 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.904587    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb177a88-561b-4279-a1c6-7f816dffe148" containerName="test-curl-7553-140033590960176"
Jul 12 22:40:35.908914 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.908895    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:35.911945 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.911919    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-bs2xj\""
Jul 12 22:40:35.915052 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.915009    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033590961184"]
Jul 12 22:40:35.949922 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:35.949883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjns\" (UniqueName: \"kubernetes.io/projected/704ad734-1522-4ae1-88fb-150c6c1df5d4-kube-api-access-kpjns\") pod \"test-curl-7553-140033590961184\" (UID: \"704ad734-1522-4ae1-88fb-150c6c1df5d4\") " pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:36.050992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:36.050957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjns\" (UniqueName: \"kubernetes.io/projected/704ad734-1522-4ae1-88fb-150c6c1df5d4-kube-api-access-kpjns\") pod \"test-curl-7553-140033590961184\" (UID: \"704ad734-1522-4ae1-88fb-150c6c1df5d4\") " pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:36.061307 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:36.061274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjns\" (UniqueName: \"kubernetes.io/projected/704ad734-1522-4ae1-88fb-150c6c1df5d4-kube-api-access-kpjns\") pod \"test-curl-7553-140033590961184\" (UID: \"704ad734-1522-4ae1-88fb-150c6c1df5d4\") " pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:36.219841 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:36.219754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:36.356038 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:36.355995    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7553-140033590961184"]
Jul 12 22:40:36.357855 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:40:36.357827    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod704ad734_1522_4ae1_88fb_150c6c1df5d4.slice/crio-2aa473b8606f1d798dca28fd217fddd955361c44a1317efef4f8db9782d20e12 WatchSource:0}: Error finding container 2aa473b8606f1d798dca28fd217fddd955361c44a1317efef4f8db9782d20e12: Status 404 returned error can't find the container with id 2aa473b8606f1d798dca28fd217fddd955361c44a1317efef4f8db9782d20e12
Jul 12 22:40:36.538760 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:36.538727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033590961184" event={"ID":"704ad734-1522-4ae1-88fb-150c6c1df5d4","Type":"ContainerStarted","Data":"2aa473b8606f1d798dca28fd217fddd955361c44a1317efef4f8db9782d20e12"}
Jul 12 22:40:36.938440 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:36.938361    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602c5f86-bbe0-4483-8eed-8418e4de138e" path="/var/lib/kubelet/pods/602c5f86-bbe0-4483-8eed-8418e4de138e/volumes"
Jul 12 22:40:37.546760 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:37.546720    2579 generic.go:356] "Generic (PLEG): container finished" podID="704ad734-1522-4ae1-88fb-150c6c1df5d4" containerID="0de6daef282ffed0f6fb4d90f0840a8003518d72b2bba9aa184737af69246282" exitCode=0
Jul 12 22:40:37.547167 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:37.546765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7553-140033590961184" event={"ID":"704ad734-1522-4ae1-88fb-150c6c1df5d4","Type":"ContainerDied","Data":"0de6daef282ffed0f6fb4d90f0840a8003518d72b2bba9aa184737af69246282"}
Jul 12 22:40:38.689291 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.689264    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:38.709178 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.709154    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7553-140033590961184_704ad734-1522-4ae1-88fb-150c6c1df5d4/test-curl-7553-140033590961184/0.log"
Jul 12 22:40:38.734037 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.733999    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7553-140033590961184"]
Jul 12 22:40:38.738240 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.738215    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7553-140033590961184"]
Jul 12 22:40:38.774381 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.774351    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpjns\" (UniqueName: \"kubernetes.io/projected/704ad734-1522-4ae1-88fb-150c6c1df5d4-kube-api-access-kpjns\") pod \"704ad734-1522-4ae1-88fb-150c6c1df5d4\" (UID: \"704ad734-1522-4ae1-88fb-150c6c1df5d4\") "
Jul 12 22:40:38.776688 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.776649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/704ad734-1522-4ae1-88fb-150c6c1df5d4-kube-api-access-kpjns" (OuterVolumeSpecName: "kube-api-access-kpjns") pod "704ad734-1522-4ae1-88fb-150c6c1df5d4" (UID: "704ad734-1522-4ae1-88fb-150c6c1df5d4"). InnerVolumeSpecName "kube-api-access-kpjns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:38.875164 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.875069    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpjns\" (UniqueName: \"kubernetes.io/projected/704ad734-1522-4ae1-88fb-150c6c1df5d4-kube-api-access-kpjns\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:38.914127 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.914093    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"]
Jul 12 22:40:38.914437 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.914425    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="704ad734-1522-4ae1-88fb-150c6c1df5d4" containerName="test-curl-7553-140033590961184"
Jul 12 22:40:38.914481 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.914439    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="704ad734-1522-4ae1-88fb-150c6c1df5d4" containerName="test-curl-7553-140033590961184"
Jul 12 22:40:38.914520 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.914510    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="704ad734-1522-4ae1-88fb-150c6c1df5d4" containerName="test-curl-7553-140033590961184"
Jul 12 22:40:38.920613 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.917800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:40:38.921712 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.921482    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:40:38.927453 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.927420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"]
Jul 12 22:40:38.937804 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.937775    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="704ad734-1522-4ae1-88fb-150c6c1df5d4" path="/var/lib/kubelet/pods/704ad734-1522-4ae1-88fb-150c6c1df5d4/volumes"
Jul 12 22:40:38.975886 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:38.975847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a801aa9-4a92-4131-aaec-c15005c04c9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n\" (UID: \"6a801aa9-4a92-4131-aaec-c15005c04c9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:40:39.077193 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.077151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a801aa9-4a92-4131-aaec-c15005c04c9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n\" (UID: \"6a801aa9-4a92-4131-aaec-c15005c04c9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:40:39.077808 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.077789    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a801aa9-4a92-4131-aaec-c15005c04c9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n\" (UID: \"6a801aa9-4a92-4131-aaec-c15005c04c9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:40:39.237238 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.237140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:40:39.377229 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.377129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"]
Jul 12 22:40:39.379515 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:40:39.379485    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a801aa9_4a92_4131_aaec_c15005c04c9a.slice/crio-76c8e3613908ef4b11dd4314d2d835703c76d2fd94ad1346c750114a7e605370 WatchSource:0}: Error finding container 76c8e3613908ef4b11dd4314d2d835703c76d2fd94ad1346c750114a7e605370: Status 404 returned error can't find the container with id 76c8e3613908ef4b11dd4314d2d835703c76d2fd94ad1346c750114a7e605370
Jul 12 22:40:39.559339 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.559300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n" event={"ID":"6a801aa9-4a92-4131-aaec-c15005c04c9a","Type":"ContainerStarted","Data":"76c8e3613908ef4b11dd4314d2d835703c76d2fd94ad1346c750114a7e605370"}
Jul 12 22:40:39.560497 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.560477    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7553-140033590961184"
Jul 12 22:40:39.560597 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:39.560475    2579 scope.go:117] "RemoveContainer" containerID="0de6daef282ffed0f6fb4d90f0840a8003518d72b2bba9aa184737af69246282"
Jul 12 22:40:40.568441 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:40.568408    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a801aa9-4a92-4131-aaec-c15005c04c9a" containerID="3e00b534250db0231717341cc7ed8e683afbbd50fc6f168b378a544946c05e04" exitCode=0
Jul 12 22:40:40.568817 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:40.568456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n" event={"ID":"6a801aa9-4a92-4131-aaec-c15005c04c9a","Type":"ContainerDied","Data":"3e00b534250db0231717341cc7ed8e683afbbd50fc6f168b378a544946c05e04"}
Jul 12 22:40:41.710100 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:41.710073    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:40:41.801144 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:41.801108    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a801aa9-4a92-4131-aaec-c15005c04c9a-maas-api-service-ca\") pod \"6a801aa9-4a92-4131-aaec-c15005c04c9a\" (UID: \"6a801aa9-4a92-4131-aaec-c15005c04c9a\") "
Jul 12 22:40:41.801501 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:41.801476    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a801aa9-4a92-4131-aaec-c15005c04c9a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a801aa9-4a92-4131-aaec-c15005c04c9a" (UID: "6a801aa9-4a92-4131-aaec-c15005c04c9a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:40:41.902443 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:41.902349    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a801aa9-4a92-4131-aaec-c15005c04c9a-maas-api-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:40:42.580120 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:42.580082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n" event={"ID":"6a801aa9-4a92-4131-aaec-c15005c04c9a","Type":"ContainerDied","Data":"76c8e3613908ef4b11dd4314d2d835703c76d2fd94ad1346c750114a7e605370"}
Jul 12 22:40:42.580280 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:42.580141    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76c8e3613908ef4b11dd4314d2d835703c76d2fd94ad1346c750114a7e605370"
Jul 12 22:40:42.580280 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:40:42.580094    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n"
Jul 12 22:41:05.002710 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.002671    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"]
Jul 12 22:41:05.003259 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.003007    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a801aa9-4a92-4131-aaec-c15005c04c9a" containerName="revoke-keys"
Jul 12 22:41:05.003259 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.003034    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a801aa9-4a92-4131-aaec-c15005c04c9a" containerName="revoke-keys"
Jul 12 22:41:05.003259 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.003117    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a801aa9-4a92-4131-aaec-c15005c04c9a" containerName="revoke-keys"
Jul 12 22:41:05.006259 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.006242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:05.009357 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.009331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:41:05.014206 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.014180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"]
Jul 12 22:41:05.107992 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.107950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8858b63a-1489-4b43-8ebd-c52bc49ac906-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq\" (UID: \"8858b63a-1489-4b43-8ebd-c52bc49ac906\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:05.209436 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.209395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8858b63a-1489-4b43-8ebd-c52bc49ac906-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq\" (UID: \"8858b63a-1489-4b43-8ebd-c52bc49ac906\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:05.210087 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.210065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8858b63a-1489-4b43-8ebd-c52bc49ac906-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq\" (UID: \"8858b63a-1489-4b43-8ebd-c52bc49ac906\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:05.318644 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.318618    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:05.458639 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.458604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"]
Jul 12 22:41:05.459850 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:41:05.459827    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8858b63a_1489_4b43_8ebd_c52bc49ac906.slice/crio-59d38b080685ef259c2f5dc94ab130dc0e4107cb4ceb4946ccd972318e87d8ed WatchSource:0}: Error finding container 59d38b080685ef259c2f5dc94ab130dc0e4107cb4ceb4946ccd972318e87d8ed: Status 404 returned error can't find the container with id 59d38b080685ef259c2f5dc94ab130dc0e4107cb4ceb4946ccd972318e87d8ed
Jul 12 22:41:05.702547 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:05.702512    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq" event={"ID":"8858b63a-1489-4b43-8ebd-c52bc49ac906","Type":"ContainerStarted","Data":"59d38b080685ef259c2f5dc94ab130dc0e4107cb4ceb4946ccd972318e87d8ed"}
Jul 12 22:41:06.709299 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:06.709265    2579 generic.go:356] "Generic (PLEG): container finished" podID="8858b63a-1489-4b43-8ebd-c52bc49ac906" containerID="1415b1a8d71dd66601ff5c1fe5e3f5304bcf4e9acdf0dbc8b4d1cad1624e6afe" exitCode=0
Jul 12 22:41:06.709686 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:06.709355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq" event={"ID":"8858b63a-1489-4b43-8ebd-c52bc49ac906","Type":"ContainerDied","Data":"1415b1a8d71dd66601ff5c1fe5e3f5304bcf4e9acdf0dbc8b4d1cad1624e6afe"}
Jul 12 22:41:07.847583 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:07.847556    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:07.932570 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:07.932537    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8858b63a-1489-4b43-8ebd-c52bc49ac906-maas-api-service-ca\") pod \"8858b63a-1489-4b43-8ebd-c52bc49ac906\" (UID: \"8858b63a-1489-4b43-8ebd-c52bc49ac906\") "
Jul 12 22:41:07.932939 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:07.932912    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8858b63a-1489-4b43-8ebd-c52bc49ac906-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8858b63a-1489-4b43-8ebd-c52bc49ac906" (UID: "8858b63a-1489-4b43-8ebd-c52bc49ac906"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:41:08.034059 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:08.033997    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8858b63a-1489-4b43-8ebd-c52bc49ac906-maas-api-service-ca\") on node \"ip-10-0-141-23.ec2.internal\" DevicePath \"\""
Jul 12 22:41:08.721459 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:08.721429    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq"
Jul 12 22:41:08.721644 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:08.721460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq" event={"ID":"8858b63a-1489-4b43-8ebd-c52bc49ac906","Type":"ContainerDied","Data":"59d38b080685ef259c2f5dc94ab130dc0e4107cb4ceb4946ccd972318e87d8ed"}
Jul 12 22:41:08.721644 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:08.721511    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59d38b080685ef259c2f5dc94ab130dc0e4107cb4ceb4946ccd972318e87d8ed"
Jul 12 22:41:36.684648 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:36.684617    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ctvl7_e214b820-2e1d-459b-a5c1-e481354233f7/copy-manifests/0.log"
Jul 12 22:41:36.690534 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:36.690509    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ctvl7_e214b820-2e1d-459b-a5c1-e481354233f7/manager/0.log"
Jul 12 22:41:37.848680 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:37.848595    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-23b6cb-w5qmp_e36dfaac-bc7f-4d0a-9f18-b6f7fe51806a/revoke-keys/0.log"
Jul 12 22:41:38.714208 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:38.714181    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-66fe58-tt66n_6a801aa9-4a92-4131-aaec-c15005c04c9a/revoke-keys/0.log"
Jul 12 22:41:38.824835 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:38.824801    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-7a7f11-r87hq_8858b63a-1489-4b43-8ebd-c52bc49ac906/revoke-keys/0.log"
Jul 12 22:41:38.933392 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:38.933362    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-82nbb_511148c4-556b-4fed-b9b2-396b88c10d6a/postgres/0.log"
Jul 12 22:41:39.676301 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.676276    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j_1d115f5f-6669-45ce-8aa3-e69385843c7c/util/0.log"
Jul 12 22:41:39.682888 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.682866    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j_1d115f5f-6669-45ce-8aa3-e69385843c7c/pull/0.log"
Jul 12 22:41:39.689097 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.689081    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j_1d115f5f-6669-45ce-8aa3-e69385843c7c/extract/0.log"
Jul 12 22:41:39.796364 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.796333    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52_806f9222-796a-4424-82e6-7bed056aecae/extract/0.log"
Jul 12 22:41:39.802546 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.802519    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52_806f9222-796a-4424-82e6-7bed056aecae/util/0.log"
Jul 12 22:41:39.811403 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.811378    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52_806f9222-796a-4424-82e6-7bed056aecae/pull/0.log"
Jul 12 22:41:39.924135 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.924109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx_0e29ccc1-c200-40d0-a186-99b3f41207ea/util/0.log"
Jul 12 22:41:39.930465 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.930393    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx_0e29ccc1-c200-40d0-a186-99b3f41207ea/pull/0.log"
Jul 12 22:41:39.936347 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:39.936325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx_0e29ccc1-c200-40d0-a186-99b3f41207ea/extract/0.log"
Jul 12 22:41:40.043299 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:40.043267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k_cab8fa3a-151b-4ecd-aea1-163729527ccf/util/0.log"
Jul 12 22:41:40.049108 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:40.049082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k_cab8fa3a-151b-4ecd-aea1-163729527ccf/pull/0.log"
Jul 12 22:41:40.054586 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:40.054566    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k_cab8fa3a-151b-4ecd-aea1-163729527ccf/extract/0.log"
Jul 12 22:41:40.508718 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:40.508691    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z6st2_da9f695b-3977-4e15-9077-f76036c56aa1/kuadrant-console-plugin/0.log"
Jul 12 22:41:41.650092 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:41.650062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66b84d88d8-tk4pz_4e4c4cfa-f9b5-457d-ad52-d596903b2f17/kube-auth-proxy/0.log"
Jul 12 22:41:42.572095 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:42.572064    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-p5vcq_6dc67064-c7a9-4e47-9dbe-b38131b2a2cb/main/0.log"
Jul 12 22:41:42.687062 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:42.687036    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nknkh_73b56d92-26d1-4654-a809-8089486d16e4/main/0.log"
Jul 12 22:41:43.039585 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:43.039559    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bqg8q_fb7ba6d9-603c-4101-b6b2-5058ed6f480a/main/0.log"
Jul 12 22:41:47.296741 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.296708    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-grwlh/must-gather-ctj2z"]
Jul 12 22:41:47.297142 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.297043    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8858b63a-1489-4b43-8ebd-c52bc49ac906" containerName="revoke-keys"
Jul 12 22:41:47.297142 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.297055    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8858b63a-1489-4b43-8ebd-c52bc49ac906" containerName="revoke-keys"
Jul 12 22:41:47.297142 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.297114    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8858b63a-1489-4b43-8ebd-c52bc49ac906" containerName="revoke-keys"
Jul 12 22:41:47.300288 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.300269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.303441 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.303414    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-grwlh\"/\"openshift-service-ca.crt\""
Jul 12 22:41:47.303441 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.303431    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-grwlh\"/\"kube-root-ca.crt\""
Jul 12 22:41:47.303637 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.303484    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-grwlh\"/\"default-dockercfg-zbdsv\""
Jul 12 22:41:47.313890 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.313860    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grwlh/must-gather-ctj2z"]
Jul 12 22:41:47.348307 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.348267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hn85\" (UniqueName: \"kubernetes.io/projected/c0b30109-7118-44bb-8f3d-4ae563364a1c-kube-api-access-6hn85\") pod \"must-gather-ctj2z\" (UID: \"c0b30109-7118-44bb-8f3d-4ae563364a1c\") " pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.348491 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.348368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0b30109-7118-44bb-8f3d-4ae563364a1c-must-gather-output\") pod \"must-gather-ctj2z\" (UID: \"c0b30109-7118-44bb-8f3d-4ae563364a1c\") " pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.448808 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.448770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hn85\" (UniqueName: \"kubernetes.io/projected/c0b30109-7118-44bb-8f3d-4ae563364a1c-kube-api-access-6hn85\") pod \"must-gather-ctj2z\" (UID: \"c0b30109-7118-44bb-8f3d-4ae563364a1c\") " pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.449075 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.448856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0b30109-7118-44bb-8f3d-4ae563364a1c-must-gather-output\") pod \"must-gather-ctj2z\" (UID: \"c0b30109-7118-44bb-8f3d-4ae563364a1c\") " pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.449251 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.449232    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0b30109-7118-44bb-8f3d-4ae563364a1c-must-gather-output\") pod \"must-gather-ctj2z\" (UID: \"c0b30109-7118-44bb-8f3d-4ae563364a1c\") " pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.456745 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.456724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hn85\" (UniqueName: \"kubernetes.io/projected/c0b30109-7118-44bb-8f3d-4ae563364a1c-kube-api-access-6hn85\") pod \"must-gather-ctj2z\" (UID: \"c0b30109-7118-44bb-8f3d-4ae563364a1c\") " pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.609762 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.609660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grwlh/must-gather-ctj2z"
Jul 12 22:41:47.749359 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.749330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grwlh/must-gather-ctj2z"]
Jul 12 22:41:47.751118 ip-10-0-141-23 kubenswrapper[2579]: W0712 22:41:47.751078    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0b30109_7118_44bb_8f3d_4ae563364a1c.slice/crio-8a3735be5c59c8fb3f9cefe24bebdbb7841a7dec7e9cfb2cab09d5ec0a8fad5e WatchSource:0}: Error finding container 8a3735be5c59c8fb3f9cefe24bebdbb7841a7dec7e9cfb2cab09d5ec0a8fad5e: Status 404 returned error can't find the container with id 8a3735be5c59c8fb3f9cefe24bebdbb7841a7dec7e9cfb2cab09d5ec0a8fad5e
Jul 12 22:41:47.934318 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:47.934231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/must-gather-ctj2z" event={"ID":"c0b30109-7118-44bb-8f3d-4ae563364a1c","Type":"ContainerStarted","Data":"8a3735be5c59c8fb3f9cefe24bebdbb7841a7dec7e9cfb2cab09d5ec0a8fad5e"}
Jul 12 22:41:48.941711 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:48.941666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/must-gather-ctj2z" event={"ID":"c0b30109-7118-44bb-8f3d-4ae563364a1c","Type":"ContainerStarted","Data":"2921446e6a2f9be57ef381efe77b3c99f2d5d0af6bea8cb49a116d668d78d5f6"}
Jul 12 22:41:48.942184 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:48.941726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/must-gather-ctj2z" event={"ID":"c0b30109-7118-44bb-8f3d-4ae563364a1c","Type":"ContainerStarted","Data":"c2efe1648c7124613c9b5f0588a8c94fafb0b63583eafde8b803654e58900bca"}
Jul 12 22:41:48.958416 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:48.958355    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-grwlh/must-gather-ctj2z" podStartSLOduration=1.27399842 podStartE2EDuration="1.958333791s" totalImagesPullingTime="684.335371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:41:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:41:48.956975133 +0000 UTC m=+2972.585806208" watchObservedRunningTime="2026-07-12 22:41:48.958333791 +0000 UTC m=+2972.587164868"
Jul 12 22:41:49.973904 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:49.973875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-58565_5ca2f5b3-4c05-41b3-bab7-b173c7483852/global-pull-secret-syncer/0.log"
Jul 12 22:41:50.124731 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:50.124695    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gnflx_fbafc029-4615-42c0-8762-b5a488225f05/konnectivity-agent/0.log"
Jul 12 22:41:50.209372 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:50.209339    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-23.ec2.internal_4740d71f911f75a9ff886271e50b3f9a/haproxy/0.log"
Jul 12 22:41:55.224264 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.224230    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j_1d115f5f-6669-45ce-8aa3-e69385843c7c/extract/0.log"
Jul 12 22:41:55.246375 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.246331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j_1d115f5f-6669-45ce-8aa3-e69385843c7c/util/0.log"
Jul 12 22:41:55.276008 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.275971    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m9c4j_1d115f5f-6669-45ce-8aa3-e69385843c7c/pull/0.log"
Jul 12 22:41:55.313175 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.313140    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52_806f9222-796a-4424-82e6-7bed056aecae/extract/0.log"
Jul 12 22:41:55.348813 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.348755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52_806f9222-796a-4424-82e6-7bed056aecae/util/0.log"
Jul 12 22:41:55.387431 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.387401    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kkn52_806f9222-796a-4424-82e6-7bed056aecae/pull/0.log"
Jul 12 22:41:55.452202 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.452167    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx_0e29ccc1-c200-40d0-a186-99b3f41207ea/extract/0.log"
Jul 12 22:41:55.489714 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.489631    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx_0e29ccc1-c200-40d0-a186-99b3f41207ea/util/0.log"
Jul 12 22:41:55.531696 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.531630    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vjgfx_0e29ccc1-c200-40d0-a186-99b3f41207ea/pull/0.log"
Jul 12 22:41:55.586220 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.586161    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k_cab8fa3a-151b-4ecd-aea1-163729527ccf/extract/0.log"
Jul 12 22:41:55.623748 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.623703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k_cab8fa3a-151b-4ecd-aea1-163729527ccf/util/0.log"
Jul 12 22:41:55.668597 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:55.668567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18bz4k_cab8fa3a-151b-4ecd-aea1-163729527ccf/pull/0.log"
Jul 12 22:41:56.258174 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:56.258143    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z6st2_da9f695b-3977-4e15-9077-f76036c56aa1/kuadrant-console-plugin/0.log"
Jul 12 22:41:58.565644 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:58.565615    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85b77b975b-nr46f_7c33d530-3052-4e33-8f7d-51ec67d604e0/metrics-server/0.log"
Jul 12 22:41:58.685734 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:58.685685    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jd8cv_ca765b83-e579-433f-8f2d-19ae69ac6c16/node-exporter/0.log"
Jul 12 22:41:58.704884 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:58.704854    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jd8cv_ca765b83-e579-433f-8f2d-19ae69ac6c16/kube-rbac-proxy/0.log"
Jul 12 22:41:58.725817 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:58.725785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jd8cv_ca765b83-e579-433f-8f2d-19ae69ac6c16/init-textfile/0.log"
Jul 12 22:41:59.045131 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.045077    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-95khp_232dc930-a0bb-4b00-a010-fcb4dbf1062c/prometheus-operator/0.log"
Jul 12 22:41:59.061793 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.061738    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-95khp_232dc930-a0bb-4b00-a010-fcb4dbf1062c/kube-rbac-proxy/0.log"
Jul 12 22:41:59.910200 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.910170    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"]
Jul 12 22:41:59.914865 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.914836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:41:59.925210 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.925176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"]
Jul 12 22:41:59.998966 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.998919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-lib-modules\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:41:59.999834 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:41:59.999808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-sys\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.000297 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.000276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8pd7\" (UniqueName: \"kubernetes.io/projected/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-kube-api-access-f8pd7\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.000516 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.000498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-proc\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.000662 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.000647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-podres\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.101797 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.101761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-lib-modules\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.101982 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.101886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-sys\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.101982 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.101919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8pd7\" (UniqueName: \"kubernetes.io/projected/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-kube-api-access-f8pd7\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.101982 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.101965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-proc\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.102200 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.101989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-podres\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.102200 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.101999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-sys\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.102200 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.102012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-lib-modules\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.102200 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.102097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-proc\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.102200 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.102138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-podres\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.111330 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.111288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8pd7\" (UniqueName: \"kubernetes.io/projected/84fba7bd-4b0b-47fa-9117-d4ece3d945ab-kube-api-access-f8pd7\") pod \"perf-node-gather-daemonset-mrxlm\" (UID: \"84fba7bd-4b0b-47fa-9117-d4ece3d945ab\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.229439 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.229095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:00.429045 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.428956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"]
Jul 12 22:42:00.580632 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:00.580605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-9lcg5_00961634-d346-4f7a-8cfd-11c84abbd005/networking-console-plugin/0.log"
Jul 12 22:42:01.054051 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.053976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm" event={"ID":"84fba7bd-4b0b-47fa-9117-d4ece3d945ab","Type":"ContainerStarted","Data":"c3f8d6d3707c332e40fb1627810bd2acb62fab34a9d18893e6481b67366337ff"}
Jul 12 22:42:01.054515 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.054068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm" event={"ID":"84fba7bd-4b0b-47fa-9117-d4ece3d945ab","Type":"ContainerStarted","Data":"88f1692a4899b5b1dd29863db4adf2374ba610d50c6f53f5f679e47364051a63"}
Jul 12 22:42:01.054515 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.054095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:01.071760 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.071697    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm" podStartSLOduration=2.071671177 podStartE2EDuration="2.071671177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 22:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:42:01.068878592 +0000 UTC m=+2984.697709668" watchObservedRunningTime="2026-07-12 22:42:01.071671177 +0000 UTC m=+2984.700502252"
Jul 12 22:42:01.072861 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.072830    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:42:01.079570 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.079535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/2.log"
Jul 12 22:42:01.537877 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:01.537849    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7fd8b4b8-xxbtw_c0ee66af-1545-46dd-acfb-972945540650/console/0.log"
Jul 12 22:42:02.126003 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:02.125969    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-5fkvz_7ab3d4a9-bf31-4e07-9b02-8be3263fc554/volume-data-source-validator/0.log"
Jul 12 22:42:03.187782 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:03.187741    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b69bm_cf6dc6fc-df9e-4b92-92cf-902dc183e1c2/dns/0.log"
Jul 12 22:42:03.210287 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:03.210261    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b69bm_cf6dc6fc-df9e-4b92-92cf-902dc183e1c2/kube-rbac-proxy/0.log"
Jul 12 22:42:03.309539 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:03.309501    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jxj5m_5e72d54d-f9a5-4461-aa9e-ce5215d65399/dns-node-resolver/0.log"
Jul 12 22:42:03.904170 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:03.904141    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2srjq_3cb452b9-a8f6-43b6-bcb3-63602e6ae1b5/node-ca/0.log"
Jul 12 22:42:05.001311 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:05.001260    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66b84d88d8-tk4pz_4e4c4cfa-f9b5-457d-ad52-d596903b2f17/kube-auth-proxy/0.log"
Jul 12 22:42:05.921165 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:05.921139    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmpjn_1c71fae0-a8c3-4c04-a49f-0b4a421b3956/serve-healthcheck-canary/0.log"
Jul 12 22:42:06.576651 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:06.576581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w2t94_85aea58e-c10b-4c62-b5c6-db20eab459d5/kube-rbac-proxy/0.log"
Jul 12 22:42:06.599344 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:06.599317    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w2t94_85aea58e-c10b-4c62-b5c6-db20eab459d5/exporter/0.log"
Jul 12 22:42:06.620987 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:06.620943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w2t94_85aea58e-c10b-4c62-b5c6-db20eab459d5/extractor/0.log"
Jul 12 22:42:07.076118 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:07.076085    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-mrxlm"
Jul 12 22:42:09.435824 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:09.435792    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ctvl7_e214b820-2e1d-459b-a5c1-e481354233f7/manager/0.log"
Jul 12 22:42:09.456412 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:09.456379    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ctvl7_e214b820-2e1d-459b-a5c1-e481354233f7/copy-manifests/0.log"
Jul 12 22:42:10.795568 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:10.795520    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-db9cf56f-rkq6n_e034fdf5-9fa0-4802-9d44-27a34b083018/manager/0.log"
Jul 12 22:42:10.814888 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:10.814864    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66b84d88d8-tk4pz_4e4c4cfa-f9b5-457d-ad52-d596903b2f17/kube-auth-proxy/0.log"
Jul 12 22:42:10.844216 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:10.844150    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rqttr_213e38e0-9c7a-471c-b48e-f87522281a0f/openshift-lws-operator/0.log"
Jul 12 22:42:12.392779 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:12.392737    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66b84d88d8-tk4pz_4e4c4cfa-f9b5-457d-ad52-d596903b2f17/kube-auth-proxy/0.log"
Jul 12 22:42:16.019350 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:16.019311    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xtkmz_2b6566c4-7598-444a-a807-65dda7e9d361/kube-storage-version-migrator-operator/1.log"
Jul 12 22:42:16.020234 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:16.020208    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xtkmz_2b6566c4-7598-444a-a807-65dda7e9d361/kube-storage-version-migrator-operator/0.log"
Jul 12 22:42:17.006554 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.006520    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2qhv8_e50c15a7-7bc7-431d-90f0-fd16208762bc/kube-multus/0.log"
Jul 12 22:42:17.110234 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.110207    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:42:17.115473 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.115447    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hj95z_d707e5bb-844b-4e0d-bde0-83f3bb6a003d/console-operator/1.log"
Jul 12 22:42:17.116502 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.116469    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:42:17.120938 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.120918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lsjgt_1452c838-4673-4e09-9059-528a72b07cf0/ovn-acl-logging/0.log"
Jul 12 22:42:17.412383 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.412355    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/kube-multus-additional-cni-plugins/0.log"
Jul 12 22:42:17.433852 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.433795    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/egress-router-binary-copy/0.log"
Jul 12 22:42:17.455604 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.455575    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/cni-plugins/0.log"
Jul 12 22:42:17.477428 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.477400    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/bond-cni-plugin/0.log"
Jul 12 22:42:17.499423 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.499384    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/routeoverride-cni/0.log"
Jul 12 22:42:17.519872 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.519844    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/whereabouts-cni-bincopy/0.log"
Jul 12 22:42:17.539644 ip-10-0-141-23 kubenswrapper[2579]: I0712 22:42:17.539615    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qc7h2_05b59596-e593-4834-a61d-a79e87f1aa80/whereabouts-cni/0.log"