Jul 31 01:35:10.036930 ip-10-0-140-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 01:35:10.036946 ip-10-0-140-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 01:35:10.036956 ip-10-0-140-87 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 01:35:10.037289 ip-10-0-140-87 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 01:35:20.069028 ip-10-0-140-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 01:35:20.069046 ip-10-0-140-87 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a20a0885c58040dd8fac7748324142a0 --
Jul 31 01:36:58.758087 ip-10-0-140-87 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 01:36:59.196391 ip-10-0-140-87 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 01:36:59.196391 ip-10-0-140-87 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 01:36:59.196391 ip-10-0-140-87 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 01:36:59.196391 ip-10-0-140-87 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 01:36:59.196391 ip-10-0-140-87 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 01:36:59.197504 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.197399    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 01:36:59.202194 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202179    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:36:59.202194 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202194    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202198    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202201    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202204    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202207    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202210    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202212    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202215    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202218    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202220    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202223    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202226    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202229    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202237    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202239    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202242    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202245    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202248    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202250    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202253    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:36:59.202256 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202256    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202258    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202263    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202267    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202270    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202273    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202275    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202278    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202280    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202284    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202286    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202288    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202291    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202293    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202296    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202298    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202300    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202304    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202308    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:36:59.202770 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202310    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202313    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202316    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202319    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202321    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202327    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202330    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202333    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202336    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202339    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202341    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202344    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202346    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202349    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202351    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202354    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202357    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202359    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202362    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202364    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:36:59.203241 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202367    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202369    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202372    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202374    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202377    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202379    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202382    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202384    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202387    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202389    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202393    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202395    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202398    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202400    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202403    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202405    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202407    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202410    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202414    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202416    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:36:59.203760 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202419    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202421    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202424    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202426    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202429    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202431    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202434    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202437    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202440    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202442    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202445    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202447    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202450    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202452    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202455    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202457    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202460    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202462    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.202465    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204133    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:36:59.204260 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204141    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204144    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204147    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204150    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204153    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204157    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204161    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204164    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204167    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204170    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204172    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204175    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204178    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204180    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204183    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204185    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204188    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204190    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204193    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204197    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:36:59.204739 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204199    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204202    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204204    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204207    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204209    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204212    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204215    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204218    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204220    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204223    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204225    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204228    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204230    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204233    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204236    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204238    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204241    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204243    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204246    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:36:59.205236 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204248    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204250    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204253    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204255    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204258    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204260    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204263    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204266    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204269    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204272    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204274    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204278    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204281    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204283    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204286    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204288    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204290    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204293    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204295    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204297    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:36:59.205698 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204300    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204302    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204305    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204307    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204309    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204312    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204314    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204316    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204319    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204321    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204323    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204325    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204328    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204330    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204333    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204336    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204338    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204340    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204343    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:36:59.206240 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204346    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204349    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204353    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204355    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204358    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204361    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204364    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204366    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204369    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204371    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204374    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204378    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204381    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204384    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204387    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204389    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204392    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204394    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204397    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:36:59.206703 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204400    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204763    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204767    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204770    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204773    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204775    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204778    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204781    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204783    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204786    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204804    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204807    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204810    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204813    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204816    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204819    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204821    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204826    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204830    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204832    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:36:59.207171 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204835    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204838    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204840    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204843    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204845    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204848    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204850    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204853    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204855    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204858    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204861    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204863    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204866    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204868    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204871    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204873    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204876    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204878    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204882    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204885    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204887    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:36:59.207667 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204890    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204892    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204895    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204897    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204900    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204903    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204906    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204908    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204910    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204914    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204916    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204918    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204921    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204923    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204926    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204929    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204931    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204935    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204937    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:36:59.208206 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204940    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204942    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204945    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204947    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204950    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204952    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204954    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204957    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204959    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204962    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204967    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204970    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204972    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204975    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204977    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204980    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204982    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204985    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204988    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204990    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:36:59.208663 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204994    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.204997    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205000    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205003    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205006    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205008    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205011    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205014    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205018    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205021    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205024    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205027    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205030    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205032    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205035    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205037    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205040    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205043    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205045    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:36:59.209169 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205048    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205116    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205122    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205129    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205132    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205136    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205139    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205143    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205147    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205150    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205153    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205157    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205160    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205163    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205166    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205169    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205172    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205175    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205178    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205182    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205185    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205188    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205191    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205194    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 01:36:59.209635 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205197    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205200    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205203    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205207    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205209    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205212    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205215    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205218    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205221    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205225    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205227    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205232    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205234    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205237    2555 flags.go:64] FLAG: --enable-server="true"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205240    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205244    2555 flags.go:64] FLAG: --event-burst="100"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205247    2555 flags.go:64] FLAG: --event-qps="50"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205250    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205253    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205256    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205260    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205263    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205266    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205269    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205272    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 01:36:59.210247 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205274    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205277    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205280    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205283    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205285    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205288    2555 flags.go:64] FLAG: --feature-gates=""
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205292    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205295    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205297    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205300    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205303    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205306    2555 flags.go:64] FLAG: --help="false"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205309    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205312    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205314    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205317    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205320    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205324    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205328    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205331    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205333    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205336    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205339    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205342    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 01:36:59.210886 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205345    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205348    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205351    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205354    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205357    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205360    2555 flags.go:64] FLAG: --lock-file=""
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205364    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205367    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205370    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205375    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205378    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205380    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205383    2555 flags.go:64] FLAG: --logging-format="text"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205386    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205389    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205392    2555 flags.go:64] FLAG: --manifest-url=""
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205395    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205399    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205401    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205405    2555 flags.go:64] FLAG: --max-pods="110"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205408    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205411    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205414    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205416    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205420    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 01:36:59.211499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205422    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205427    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205433    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205436    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205439    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205442    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205445    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205450    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205453    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205456    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205459    2555 flags.go:64] FLAG: --port="10250"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205462    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205465    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05b284d80930c1fda"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205470    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205473    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205476    2555 flags.go:64] FLAG: --register-node="true"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205479    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205483    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205485    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205488    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205491    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205494    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205497    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205500    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205503    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 01:36:59.212169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205506    2555 flags.go:64] FLAG: --runonce="false"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205509    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205512    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205514    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205517    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205520    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205523    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205526    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205529    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205532    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205535    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205538    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205540    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205543    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205546    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205549    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205554    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205556    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205559    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205563    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205567    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205570    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205572    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205576    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205579    2555 flags.go:64] FLAG: --v="2"
Jul 31 01:36:59.212846 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205582    2555 flags.go:64] FLAG: --version="false"
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205586    2555 flags.go:64] FLAG: --vmodule=""
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205590    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205593    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205701    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205705    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205708    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205711    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205714    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205716    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205719    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205721    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205723    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205726    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205729    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205731    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205735    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205737    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205739    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205742    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:36:59.213613 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205745    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205747    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205750    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205752    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205755    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205759    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205762    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205768    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205771    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205775    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205777    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205780    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205783    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205785    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205805    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205807    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205811    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205814    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205818    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:36:59.214416 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205821    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205823    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205826    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205828    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205831    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205833    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205836    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205838    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205841    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205845    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205847    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205850    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205852    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205855    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205857    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205861    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205864    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205867    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205869    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:36:59.214931 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205871    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205875    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205877    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205880    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205883    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205886    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205888    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205891    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205894    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205896    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205898    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205901    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205903    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205906    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205908    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205910    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205913    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205915    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205918    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205921    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:36:59.215395 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205923    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205925    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205929    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205931    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205934    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205936    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205939    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205941    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205944    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205947    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205949    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205951    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205954    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205957    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205960    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205962    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205965    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205967    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205970    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205972    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:36:59.216024 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205975    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205977    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205979    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205982    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.205985    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.205990    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.214882    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.214897    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.214917    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.214923    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.214980    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.214985    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.214988    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.214992    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:36:59.216581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.214995    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.214998    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215001    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215004    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215006    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215009    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215011    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215014    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215016    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215019    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215021    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215024    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215027    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215029    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215032    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215034    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215037    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215039    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215043    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215045    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:36:59.216945 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215048    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215050    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215053    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215056    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215058    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215062    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215064    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215067    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215069    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215072    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215075    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215078    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215080    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215083    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215086    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215088    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215090    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215093    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215095    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215098    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:36:59.217426 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215100    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215103    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215105    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215107    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215111    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215116    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215118    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215121    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215123    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215126    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215128    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215131    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215133    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215136    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215138    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215141    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215144    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215149    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215152    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:36:59.217940 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215156    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215159    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215162    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215165    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215167    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215170    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215173    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215176    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215179    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215181    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215184    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215187    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215189    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215192    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215194    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215197    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215200    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215202    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215205    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:36:59.218410 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215207    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215210    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215212    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215215    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215217    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215219    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215222    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215224    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215226    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215230    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215233    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215236    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215240    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215243    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215245    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215248    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:36:59.218879 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215251    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.215256    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215386    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215392    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215395    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215398    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215401    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215403    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215406    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215409    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215411    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215414    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215416    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215419    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215422    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:36:59.219291 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215425    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215427    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215430    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215432    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215434    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215437    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215439    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215441    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215444    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215446    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215449    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215451    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215455    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215458    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215460    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215463    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215465    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215468    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215470    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215472    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:36:59.219655 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215475    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215477    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215480    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215482    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215485    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215487    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215490    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215492    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215494    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215497    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215499    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215501    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215505    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215507    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215509    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215512    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215514    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215516    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215520    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:36:59.220156 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215523    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215526    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215529    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215532    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215534    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215537    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215540    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215543    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215545    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215549    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215551    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215553    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215556    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215558    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215561    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215563    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215566    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215568    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215571    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215573    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:36:59.220625 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215576    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215578    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215580    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215582    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215585    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215587    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215590    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215592    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215595    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215598    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215601    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215604    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215607    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215610    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215612    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215615    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215618    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215621    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215623    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215626    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:36:59.221228 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215629    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215631    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215634    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215637    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215639    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215642    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:36:59.215645    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.215650    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.215757    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 01:36:59.221697 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.220261    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 01:36:59.221990 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.221978    2555 server.go:1019] "Starting client certificate rotation"
Jul 31 01:36:59.222102 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.222087    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 01:36:59.222133 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.222119    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 01:36:59.224990 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.224977    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 01:36:59.226394 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.226378    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 01:36:59.240674 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.240655    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 31 01:36:59.243134 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.243119    2555 log.go:25] "Validated CRI v1 image API"
Jul 31 01:36:59.244869 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.244845    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 01:36:59.247519 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.247499    2555 fs.go:135] Filesystem UUIDs: map[104b6e7b-5d5f-4d82-ae5e-e75b1e016269:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 966b1405-3d30-4c39-9c28-4869861f4077:/dev/nvme0n1p4]
Jul 31 01:36:59.247597 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.247518    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 01:36:59.251324 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.251307    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 01:36:59.253041 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.252909    2555 manager.go:216] Machine: {Timestamp:2026-07-31 01:36:59.252426015 +0000 UTC m=+0.370174669 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095664 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29b9f6fcd278637751d9aa98eccbe8 SystemUUID:ec29b9f6-fcd2-7863-7751-d9aa98eccbe8 BootID:a20a0885-c580-40dd-8fac-7748324142a0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:46:0a:66:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:46:0a:66:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:8c:a9:3a:20:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 01:36:59.253041 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.253035    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 01:36:59.253157 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.253146    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 01:36:59.255747 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.255724    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 01:36:59.255906 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.255750    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 01:36:59.257329 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.257318    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 01:36:59.257363 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.257332    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 01:36:59.257363 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.257340    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 01:36:59.258157 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.258146    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 01:36:59.259965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.259956    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 01:36:59.264239 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264228    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 01:36:59.264530 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264503    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 01:36:59.264605 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264595    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 01:36:59.264651 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264614    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 01:36:59.264651 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264642    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 01:36:59.264732 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264658    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 31 01:36:59.264732 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.264671    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 01:36:59.265154 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.265133    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 01:36:59.265236 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.265161    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 01:36:59.268540 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.268512    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 01:36:59.270385 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.270371    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 01:36:59.270447 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.270401    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 01:36:59.271161 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271149    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 01:36:59.271221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271165    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 01:36:59.271221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271171    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 01:36:59.271221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271176    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 01:36:59.271221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271185    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 01:36:59.271221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271191    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 01:36:59.271351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271265    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 01:36:59.271351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271270    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 01:36:59.271351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271277    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 01:36:59.271351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271283    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 01:36:59.271351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271291    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 01:36:59.271351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.271298    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 01:36:59.272208 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.272198    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 01:36:59.272208 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.272207    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 01:36:59.275242 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.275221    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 01:36:59.275307 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.275235    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 01:36:59.275307 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.275235    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 01:36:59.275457 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.275446    2555 server.go:1268] "Started kubelet"
Jul 31 01:36:59.275584 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.275541    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 01:36:59.275633 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.275619    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 01:36:59.276221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.276180    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 01:36:59.276368 ip-10-0-140-87 systemd[1]: Started Kubernetes Kubelet.
Jul 31 01:36:59.277961 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.277947    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 01:36:59.278039 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.278022    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 01:36:59.281909 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.281872    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 01:36:59.283096 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.281992    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-87.ec2.internal.18c73c1099ef14c1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-87.ec2.internal,UID:ip-10-0-140-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-87.ec2.internal,},FirstTimestamp:2026-07-31 01:36:59.275416769 +0000 UTC m=+0.393165412,LastTimestamp:2026-07-31 01:36:59.275416769 +0000 UTC m=+0.393165412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-87.ec2.internal,}"
Jul 31 01:36:59.286560 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.286542    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 01:36:59.286560 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.286550    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 01:36:59.286720 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.286702    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.287287 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287269    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 01:36:59.287287 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287268    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 01:36:59.287432 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287297    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 01:36:59.287432 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287415    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 01:36:59.287432 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287426    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 01:36:59.287719 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287696    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 01:36:59.287719 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287716    2555 factory.go:55] Registering systemd factory
Jul 31 01:36:59.287719 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287724    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 31 01:36:59.287974 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287961    2555 factory.go:153] Registering CRI-O factory
Jul 31 01:36:59.288033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.287977    2555 factory.go:223] Registration of the crio container factory successfully
Jul 31 01:36:59.288033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.288001    2555 factory.go:103] Registering Raw factory
Jul 31 01:36:59.288033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.288015    2555 manager.go:1196] Started watching for new ooms in manager
Jul 31 01:36:59.288437 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.288423    2555 manager.go:349] Starting recovery of all containers
Jul 31 01:36:59.289117 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.289093    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 01:36:59.289117 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.289080    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 01:36:59.297238 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.297211    2555 manager.go:354] Recovery completed
Jul 31 01:36:59.299677 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.299645    2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 31 01:36:59.300301 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.300283    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wm5zm"
Jul 31 01:36:59.303077 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.303064    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.305008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.304901    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.305008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.304938    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.305008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.304954    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.305612 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.305598    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 01:36:59.305612 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.305611    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 01:36:59.305728 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.305629    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 01:36:59.305728 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.305637    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.306323 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.306300    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.306383 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.306336    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.306383 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.306350    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.306760 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.306700    2555 policy_none.go:49] "None policy: Start"
Jul 31 01:36:59.306760 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.306714    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 01:36:59.306760 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.306724    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 01:36:59.307640 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.307626    2555 policy_none.go:47] "Start"
Jul 31 01:36:59.307697 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.307682    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wm5zm"
Jul 31 01:36:59.313740 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.313554    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-87.ec2.internal.18c73c109bb13ed8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-87.ec2.internal,UID:ip-10-0-140-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-87.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-87.ec2.internal,},FirstTimestamp:2026-07-31 01:36:59.304918744 +0000 UTC m=+0.422667390,LastTimestamp:2026-07-31 01:36:59.304918744 +0000 UTC m=+0.422667390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-87.ec2.internal,}"
Jul 31 01:36:59.339396 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339377    2555 manager.go:337] "Starting Device Plugin manager"
Jul 31 01:36:59.339488 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.339413    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 01:36:59.339488 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339426    2555 server.go:87] "Starting device plugin registration server"
Jul 31 01:36:59.339639 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339628    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 01:36:59.339724 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339639    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 01:36:59.339785 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339772    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 01:36:59.339872 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339860    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 01:36:59.339872 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.339872    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 01:36:59.340331 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.340313    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 01:36:59.340394 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.340367    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.437180 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.437149    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 01:36:59.438434 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.438418    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 01:36:59.438527 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.438455    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 01:36:59.438527 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.438475    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 01:36:59.438527 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.438506    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 01:36:59.439973 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.439952    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.440782 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.440764    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.440934 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.440819    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.440934 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.440836    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.440934 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.440867    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.441082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.440982    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:36:59.455620 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.455571    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.455620 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.455596    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-87.ec2.internal\": node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.477922 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.477907    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.539609 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.539585    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"]
Jul 31 01:36:59.539684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.539643    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.542653 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.542639    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.542709 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.542666    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.542709 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.542676    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.543762 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.543751    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.543901 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.543886    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.543936 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.543918    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.544480 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.544466    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.544536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.544492    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.544536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.544507    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.544536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.544512    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.544536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.544531    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.544666 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.544543    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.545608 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.545581    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.545608 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.545605    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:36:59.547375 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.547357    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:36:59.547439 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.547400    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:36:59.547439 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.547415    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:36:59.571433 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.571408    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-87.ec2.internal\" not found" node="ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.575262 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.575249    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-87.ec2.internal\" not found" node="ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.578310 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.578296    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.589071 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.588852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d10851091c63cdffce3d56c3115c661b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-87.ec2.internal\" (UID: \"d10851091c63cdffce3d56c3115c661b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.589071 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.588875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b212c10c50d0615758db5d5bd95aa01c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal\" (UID: \"b212c10c50d0615758db5d5bd95aa01c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.589071 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.588892    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b212c10c50d0615758db5d5bd95aa01c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal\" (UID: \"b212c10c50d0615758db5d5bd95aa01c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.679062 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.679015    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.689416 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.689388    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d10851091c63cdffce3d56c3115c661b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-87.ec2.internal\" (UID: \"d10851091c63cdffce3d56c3115c661b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.689520 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.689423    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b212c10c50d0615758db5d5bd95aa01c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal\" (UID: \"b212c10c50d0615758db5d5bd95aa01c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.689520 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.689450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b212c10c50d0615758db5d5bd95aa01c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal\" (UID: \"b212c10c50d0615758db5d5bd95aa01c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.689520 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.689476    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d10851091c63cdffce3d56c3115c661b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-87.ec2.internal\" (UID: \"d10851091c63cdffce3d56c3115c661b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.689520 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.689486    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b212c10c50d0615758db5d5bd95aa01c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal\" (UID: \"b212c10c50d0615758db5d5bd95aa01c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.689520 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.689489    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b212c10c50d0615758db5d5bd95aa01c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal\" (UID: \"b212c10c50d0615758db5d5bd95aa01c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.779899 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.779820    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.873434 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.873401    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.878861 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:36:59.877939    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"
Jul 31 01:36:59.880078 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.880057    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:36:59.980696 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:36:59.980649    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:37:00.081278 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:00.081235    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:37:00.175160 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.175135    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:00.182216 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:00.182189    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:37:00.221633 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.221609    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 01:37:00.222028 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.221760    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 01:37:00.222028 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.221768    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 01:37:00.282883 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:00.282861    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:37:00.312874 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.312829    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 01:32:00 +0000 UTC" deadline="2028-04-05 00:29:53.525485771 +0000 UTC"
Jul 31 01:37:00.312874 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.312870    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14734h52m53.212618917s"
Jul 31 01:37:00.383216 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:00.383139    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-87.ec2.internal\" not found"
Jul 31 01:37:00.463580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.463556    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:00.465512 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.465489    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:00.465630 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.465521    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:00.465630 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.465532    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:00.482313 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.482293    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:00.487726 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.487710    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal"
Jul 31 01:37:00.494647 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.494629    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 01:37:00.495376 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.495357    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal"
Jul 31 01:37:00.510956 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.510933    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 01:37:00.596424 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.596397    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:00.607397 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:00.607362    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb212c10c50d0615758db5d5bd95aa01c.slice/crio-7d7e5a48fd80c82a51f18ab2e874873d5a85f4ed2e49f2d2b59be0e51e7d76b3 WatchSource:0}: Error finding container 7d7e5a48fd80c82a51f18ab2e874873d5a85f4ed2e49f2d2b59be0e51e7d76b3: Status 404 returned error can't find the container with id 7d7e5a48fd80c82a51f18ab2e874873d5a85f4ed2e49f2d2b59be0e51e7d76b3
Jul 31 01:37:00.608309 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:00.608290    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10851091c63cdffce3d56c3115c661b.slice/crio-be86b8fc093824544b29e8b5979fa91a4debcd4e6891905d3748745a2b277659 WatchSource:0}: Error finding container be86b8fc093824544b29e8b5979fa91a4debcd4e6891905d3748745a2b277659: Status 404 returned error can't find the container with id be86b8fc093824544b29e8b5979fa91a4debcd4e6891905d3748745a2b277659
Jul 31 01:37:00.612810 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:00.612776    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:37:02.747144 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.747062    2555 apiserver.go:52] "Watching apiserver"
Jul 31 01:37:02.754763 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.754725    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 01:37:02.755285 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.755258    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-2ss7q","openshift-ovn-kubernetes/ovnkube-node-5nvn2","kube-system/global-pull-secret-syncer-gmwj6","kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal","openshift-cluster-node-tuning-operator/tuned-76f27","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal","openshift-multus/network-metrics-daemon-vb8p5","openshift-network-diagnostics/network-check-target-frgz4","kube-system/konnectivity-agent-dn759","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk","openshift-dns/node-resolver-gshz6","openshift-image-registry/node-ca-p4ww7","openshift-multus/multus-7kxj8","openshift-multus/multus-additional-cni-plugins-gtdnq"]
Jul 31 01:37:02.757822 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.757800    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:02.757916 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.757889    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:02.760469 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.760447    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.762525 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.762417    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:02.762525 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.762482    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:02.762882 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.762862    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.763090 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.763075    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.763261 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.763247    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 01:37:02.763531 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.763506    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 01:37:02.765135 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.763833    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 01:37:02.765135 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.763840    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mjqm5\""
Jul 31 01:37:02.765135 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.764526    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.766930 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.766609    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.766930 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.766824    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.767076 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.766962    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.767076 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.766972    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-965cs\""
Jul 31 01:37:02.769383 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.769363    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7dktv\""
Jul 31 01:37:02.769586 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.769569    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.769787 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.769769    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.771287 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.771268    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 01:37:02.772158 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.772143    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.772245 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.772199    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:02.773400 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.773375    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.774706 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.774688    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 01:37:02.775492 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.775477    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.777054 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.776290    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 01:37:02.777054 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.776472    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 01:37:02.777054 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.776643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvj9l\""
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.777380    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.777893    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysctl-d\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.777914    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-lib-modules\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.777936    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.777961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.777984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-cnibin\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-var-lib-kubelet\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778065    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qqm\" (UniqueName: \"kubernetes.io/projected/a7044ce9-82a1-41fa-9f3f-e10815914026-kube-api-access-d9qqm\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778092    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8m4q\" (UniqueName: \"kubernetes.io/projected/330402cd-8a63-47bc-877d-b7962bd53e8a-kube-api-access-w8m4q\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778110    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7044ce9-82a1-41fa-9f3f-e10815914026-host-slash\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778124    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-os-release\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778147    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778177    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysctl-conf\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778192    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-sys\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.778769 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778207    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-tuned\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-kubelet-config\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778242    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-dbus\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778268    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-kubernetes\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-run\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-host\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778334    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rq2v\" (UniqueName: \"kubernetes.io/projected/637d08ed-3e72-46e9-a4f0-54502d0a3c41-kube-api-access-9rq2v\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778369    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778396    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778419    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysconfig\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778441    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-systemd\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778463    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637d08ed-3e72-46e9-a4f0-54502d0a3c41-tmp\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778489    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778539    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-modprobe-d\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778563    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7044ce9-82a1-41fa-9f3f-e10815914026-iptables-alerter-script\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778587    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:02.779611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.778633    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdd6p\" (UniqueName: \"kubernetes.io/projected/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-kube-api-access-xdd6p\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:02.780357 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.779646    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.780357 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.779676    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.780610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.780588    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.780849    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5bj4r\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.781057    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.782385    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.782449    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.782463    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.782585    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n6nsp\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.782668    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.783234    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fmdz4\""
Jul 31 01:37:02.783392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.783323    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.785275 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.784902    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.788603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.787530    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.788603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.787860    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 01:37:02.788603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.788049    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 01:37:02.788603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.788441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jmrmw\""
Jul 31 01:37:02.789867 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.789677    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 01:37:02.790129 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.790107    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7qbr\""
Jul 31 01:37:02.790223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.790154    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 01:37:02.790455 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.790393    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 01:37:02.790455 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.790433    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 01:37:02.790626 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.790500    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 01:37:02.790626 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.790434    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 01:37:02.803315 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.803299    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:02.804555 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.804381    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9ptmw"
Jul 31 01:37:02.811470 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.811448    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9ptmw"
Jul 31 01:37:02.869278 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.869255    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.878931    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ea1983-2c83-4f97-8fe4-acffae008bad-tmp-dir\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.878970    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysconfig\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.878993    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-systemd\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879019    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-device-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879049    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-sys-fs\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879063    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysconfig\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879134    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-cni-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879146    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-systemd\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879160    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-cni-bin\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879184    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-socket-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879208    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-run-netns\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879232    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-etc-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879254    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk2jt\" (UniqueName: \"kubernetes.io/projected/14cedfa0-8849-49e1-920c-dee94072d1d8-kube-api-access-xk2jt\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879293    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879317    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdd6p\" (UniqueName: \"kubernetes.io/projected/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-kube-api-access-xdd6p\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:02.880194 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879341    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-lib-modules\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4dt\" (UniqueName: \"kubernetes.io/projected/a9ea1983-2c83-4f97-8fe4-acffae008bad-kube-api-access-6m4dt\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-os-release\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-ovnkube-config\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879467    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-conf-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879492    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879494    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-cnibin\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qqm\" (UniqueName: \"kubernetes.io/projected/a7044ce9-82a1-41fa-9f3f-e10815914026-kube-api-access-d9qqm\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879593    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-system-cni-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.879658    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.879763    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:03.379706465 +0000 UTC m=+3.016499166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879764    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-lib-modules\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.879862    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.879907    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:03.379890784 +0000 UTC m=+3.016683482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:02.881078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.879988    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-system-cni-dir\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880048    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-cnibin\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-cnibin\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880115    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-socket-dir-parent\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880140    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-kubelet\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880167    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8m4q\" (UniqueName: \"kubernetes.io/projected/330402cd-8a63-47bc-877d-b7962bd53e8a-kube-api-access-w8m4q\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880192    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7044ce9-82a1-41fa-9f3f-e10815914026-host-slash\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880215    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-hostroot\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880237    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-multus-certs\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-systemd-units\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880282    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880307    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-sys\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880331    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-kubelet-config\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880356    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-dbus\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880385    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m7l2\" (UniqueName: \"kubernetes.io/projected/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-kube-api-access-7m7l2\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-slash\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.881852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880459    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-var-lib-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880485    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-run\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-netns\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-cni-multus\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880591    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-cni-bin\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880613    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-env-overrides\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880640    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rq2v\" (UniqueName: \"kubernetes.io/projected/637d08ed-3e72-46e9-a4f0-54502d0a3c41-kube-api-access-9rq2v\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880663    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9ea1983-2c83-4f97-8fe4-acffae008bad-hosts-file\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880686    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gspw7\" (UniqueName: \"kubernetes.io/projected/65faecef-fc92-4664-9cd9-2a331197b8da-kube-api-access-gspw7\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-cni-netd\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880742    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17da502b-3e11-4ad5-a736-6ba46f2da765-ovn-node-metrics-cert\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880790    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880817    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880840    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637d08ed-3e72-46e9-a4f0-54502d0a3c41-tmp\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880862    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-node-log\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880886    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-modprobe-d\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.882610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880913    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7044ce9-82a1-41fa-9f3f-e10815914026-iptables-alerter-script\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.880972    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-etc-kubernetes\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881002    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-etc-selinux\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881003    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7044ce9-82a1-41fa-9f3f-e10815914026-host-slash\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881044    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881073    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-daemon-config\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881084    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-run\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881103    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysctl-d\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881129    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c1159aa-fadf-4c14-9e6d-1baa9e85ea43-konnectivity-ca\") pod \"konnectivity-agent-dn759\" (UID: \"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43\") " pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881159    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14cedfa0-8849-49e1-920c-dee94072d1d8-cni-binary-copy\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881190    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-log-socket\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881216    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-k8s-cni-cncf-io\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881242    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-var-lib-kubelet\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881267    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-registration-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65faecef-fc92-4664-9cd9-2a331197b8da-host\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881312    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-ovnkube-script-lib\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881337    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-kubelet\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.883445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881359    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65faecef-fc92-4664-9cd9-2a331197b8da-serviceca\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881412    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-os-release\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881478    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/330402cd-8a63-47bc-877d-b7962bd53e8a-os-release\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881701    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-sys\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881709    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881762    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysctl-conf\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881776    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-kubelet-config\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881789    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-tuned\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881819    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c1159aa-fadf-4c14-9e6d-1baa9e85ea43-agent-certs\") pod \"konnectivity-agent-dn759\" (UID: \"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43\") " pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881845    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8h2x\" (UniqueName: \"kubernetes.io/projected/17da502b-3e11-4ad5-a736-6ba46f2da765-kube-api-access-g8h2x\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881871    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-kubernetes\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881894    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-host\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881905    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-dbus\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-systemd\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.881971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-ovn\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.882137    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysctl-d\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.884282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.882216    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.882461    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-sysctl-conf\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.882560    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-modprobe-d\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.882691    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.882792    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-var-lib-kubelet\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.883054    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7044ce9-82a1-41fa-9f3f-e10815914026-iptables-alerter-script\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.883222    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.883276    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-host\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.883723    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/330402cd-8a63-47bc-877d-b7962bd53e8a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.885082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.883805    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-kubernetes\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.887143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.887075    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/637d08ed-3e72-46e9-a4f0-54502d0a3c41-etc-tuned\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.887143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.887113    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/637d08ed-3e72-46e9-a4f0-54502d0a3c41-tmp\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.891088 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.891068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qqm\" (UniqueName: \"kubernetes.io/projected/a7044ce9-82a1-41fa-9f3f-e10815914026-kube-api-access-d9qqm\") pod \"iptables-alerter-2ss7q\" (UID: \"a7044ce9-82a1-41fa-9f3f-e10815914026\") " pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:02.895035 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.894644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rq2v\" (UniqueName: \"kubernetes.io/projected/637d08ed-3e72-46e9-a4f0-54502d0a3c41-kube-api-access-9rq2v\") pod \"tuned-76f27\" (UID: \"637d08ed-3e72-46e9-a4f0-54502d0a3c41\") " pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:02.895035 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.894796    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:02.895035 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.894814    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:02.895035 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.894837    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:02.895035 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:02.894894    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:03.394876292 +0000 UTC m=+3.031669005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:02.895828 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.895808    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdd6p\" (UniqueName: \"kubernetes.io/projected/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-kube-api-access-xdd6p\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:02.900163 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.900140    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8m4q\" (UniqueName: \"kubernetes.io/projected/330402cd-8a63-47bc-877d-b7962bd53e8a-kube-api-access-w8m4q\") pod \"multus-additional-cni-plugins-gtdnq\" (UID: \"330402cd-8a63-47bc-877d-b7962bd53e8a\") " pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:02.926311 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.925798    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal" event={"ID":"d10851091c63cdffce3d56c3115c661b","Type":"ContainerStarted","Data":"be86b8fc093824544b29e8b5979fa91a4debcd4e6891905d3748745a2b277659"}
Jul 31 01:37:02.929559 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.929531    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal" event={"ID":"b212c10c50d0615758db5d5bd95aa01c","Type":"ContainerStarted","Data":"7d7e5a48fd80c82a51f18ab2e874873d5a85f4ed2e49f2d2b59be0e51e7d76b3"}
Jul 31 01:37:02.982519 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982487    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-var-lib-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982533    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-netns\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982558    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-cni-multus\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982583    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982591    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-netns\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982608    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-cni-bin\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982555    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-var-lib-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982639    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-cni-multus\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.982684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982666    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-env-overrides\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982689    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-cni-bin\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982706    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982822    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9ea1983-2c83-4f97-8fe4-acffae008bad-hosts-file\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982876    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9ea1983-2c83-4f97-8fe4-acffae008bad-hosts-file\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.982907    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gspw7\" (UniqueName: \"kubernetes.io/projected/65faecef-fc92-4664-9cd9-2a331197b8da-kube-api-access-gspw7\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983111    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-env-overrides\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-cni-netd\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983188    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17da502b-3e11-4ad5-a736-6ba46f2da765-ovn-node-metrics-cert\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983215    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-node-log\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983239    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-etc-kubernetes\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983261    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-etc-selinux\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983261    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-cni-netd\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983283    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983305    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-daemon-config\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983312    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-node-log\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983328    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c1159aa-fadf-4c14-9e6d-1baa9e85ea43-konnectivity-ca\") pod \"konnectivity-agent-dn759\" (UID: \"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43\") " pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983349    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14cedfa0-8849-49e1-920c-dee94072d1d8-cni-binary-copy\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983377    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-log-socket\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983399    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-k8s-cni-cncf-io\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983423    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-registration-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65faecef-fc92-4664-9cd9-2a331197b8da-host\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-ovnkube-script-lib\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-kubelet\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983514    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65faecef-fc92-4664-9cd9-2a331197b8da-serviceca\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983560    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c1159aa-fadf-4c14-9e6d-1baa9e85ea43-agent-certs\") pod \"konnectivity-agent-dn759\" (UID: \"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43\") " pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983574    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8h2x\" (UniqueName: \"kubernetes.io/projected/17da502b-3e11-4ad5-a736-6ba46f2da765-kube-api-access-g8h2x\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-systemd\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-ovn\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983621    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ea1983-2c83-4f97-8fe4-acffae008bad-tmp-dir\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-device-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983679    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-sys-fs\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983684    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-registration-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983702    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-cni-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983742    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-cni-bin\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.983982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983785    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-socket-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983808    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-run-netns\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983785    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-cni-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983832    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-etc-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983858    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk2jt\" (UniqueName: \"kubernetes.io/projected/14cedfa0-8849-49e1-920c-dee94072d1d8-kube-api-access-xk2jt\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983858    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65faecef-fc92-4664-9cd9-2a331197b8da-host\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983920    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4dt\" (UniqueName: \"kubernetes.io/projected/a9ea1983-2c83-4f97-8fe4-acffae008bad-kube-api-access-6m4dt\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983946    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-os-release\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983971    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-ovnkube-config\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.983997    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-conf-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984025    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-system-cni-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984047    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-cnibin\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984070    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-socket-dir-parent\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984095    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-kubelet\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984120    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-hostroot\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984144    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-multus-certs\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984168    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-systemd-units\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984207    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.984573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984234    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m7l2\" (UniqueName: \"kubernetes.io/projected/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-kube-api-access-7m7l2\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984258    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-slash\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984267    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-log-socket\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984333    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-etc-kubernetes\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984341    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984434    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-etc-selinux\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984491    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14cedfa0-8849-49e1-920c-dee94072d1d8-cni-binary-copy\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984497    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-system-cni-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984546    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-kubelet\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984548    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984807    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-ovnkube-script-lib\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-systemd\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984872    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-cnibin\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984935    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-socket-dir-parent\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984963    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-daemon-config\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.984975    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-kubelet\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985015    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-hostroot\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985049    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-multus-certs\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985072    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-systemd-units\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985100    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985316    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-slash\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-run-k8s-cni-cncf-io\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985362    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c1159aa-fadf-4c14-9e6d-1baa9e85ea43-konnectivity-ca\") pod \"konnectivity-agent-dn759\" (UID: \"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43\") " pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985386    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-host-var-lib-cni-bin\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985475    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-socket-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985541    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-host-run-netns\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985575    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-etc-openvswitch\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17da502b-3e11-4ad5-a736-6ba46f2da765-run-ovn\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985783    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65faecef-fc92-4664-9cd9-2a331197b8da-serviceca\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985867    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ea1983-2c83-4f97-8fe4-acffae008bad-tmp-dir\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:02.985969 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.985928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-os-release\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.986454 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.986021    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-device-dir\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.986454 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.986065    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-sys-fs\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.986454 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.986105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14cedfa0-8849-49e1-920c-dee94072d1d8-multus-conf-dir\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.986454 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.986321    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17da502b-3e11-4ad5-a736-6ba46f2da765-ovnkube-config\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.986454 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.986397    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17da502b-3e11-4ad5-a736-6ba46f2da765-ovn-node-metrics-cert\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.987449 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.987421    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c1159aa-fadf-4c14-9e6d-1baa9e85ea43-agent-certs\") pod \"konnectivity-agent-dn759\" (UID: \"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43\") " pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:02.991360 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.991329    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gspw7\" (UniqueName: \"kubernetes.io/projected/65faecef-fc92-4664-9cd9-2a331197b8da-kube-api-access-gspw7\") pod \"node-ca-p4ww7\" (UID: \"65faecef-fc92-4664-9cd9-2a331197b8da\") " pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:02.992617 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.992574    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk2jt\" (UniqueName: \"kubernetes.io/projected/14cedfa0-8849-49e1-920c-dee94072d1d8-kube-api-access-xk2jt\") pod \"multus-7kxj8\" (UID: \"14cedfa0-8849-49e1-920c-dee94072d1d8\") " pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:02.992710 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.992661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8h2x\" (UniqueName: \"kubernetes.io/projected/17da502b-3e11-4ad5-a736-6ba46f2da765-kube-api-access-g8h2x\") pod \"ovnkube-node-5nvn2\" (UID: \"17da502b-3e11-4ad5-a736-6ba46f2da765\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:02.993684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.993657    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m7l2\" (UniqueName: \"kubernetes.io/projected/26d65ee0-e69f-4ee1-ad1d-94c2599ea37c-kube-api-access-7m7l2\") pod \"aws-ebs-csi-driver-node-l7dtk\" (UID: \"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:02.996076 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:02.996036    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4dt\" (UniqueName: \"kubernetes.io/projected/a9ea1983-2c83-4f97-8fe4-acffae008bad-kube-api-access-6m4dt\") pod \"node-resolver-gshz6\" (UID: \"a9ea1983-2c83-4f97-8fe4-acffae008bad\") " pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:03.078082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.078045    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gtdnq"
Jul 31 01:37:03.092390 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.092361    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-76f27"
Jul 31 01:37:03.102087 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.102058    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2ss7q"
Jul 31 01:37:03.108708 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.108686    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:03.117338 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.117320    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk"
Jul 31 01:37:03.125981 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.125960    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gshz6"
Jul 31 01:37:03.133536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.133517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p4ww7"
Jul 31 01:37:03.142215 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.142193    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kxj8"
Jul 31 01:37:03.147964 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.147946    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:03.387571 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.387016    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:03.387571 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.387069    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:03.387571 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.387145    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:03.387571 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.387189    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:03.387571 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.387226    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:04.387192519 +0000 UTC m=+4.023985236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:03.387571 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.387249    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:04.387237641 +0000 UTC m=+4.024030343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:03.446495 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.446459    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:03.487847 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.487816    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:03.488036 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.487971    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:03.488036 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.487999    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:03.488036 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.488011    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:03.488190 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.488076    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:04.488056248 +0000 UTC m=+4.124848969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:03.814563 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.814514    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 01:32:02 +0000 UTC" deadline="2028-04-27 11:17:33.346637694 +0000 UTC"
Jul 31 01:37:03.814563 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.814552    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15273h40m29.53208938s"
Jul 31 01:37:03.920413 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.920377    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:03.920413 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:03.920403    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:03.920664 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.920515    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:03.920664 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:03.920640    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:04.100585 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.100559    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330402cd_8a63_47bc_877d_b7962bd53e8a.slice/crio-63b090e4bfc2101f55893b9a15e18219126ed0d659814376c7a68542c738dfc4 WatchSource:0}: Error finding container 63b090e4bfc2101f55893b9a15e18219126ed0d659814376c7a68542c738dfc4: Status 404 returned error can't find the container with id 63b090e4bfc2101f55893b9a15e18219126ed0d659814376c7a68542c738dfc4
Jul 31 01:37:04.114838 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.114816    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637d08ed_3e72_46e9_a4f0_54502d0a3c41.slice/crio-2129ed5b00d876f6c5fd1a96ceb2e2ee018fafef17ab21488c29fd825ccb199c WatchSource:0}: Error finding container 2129ed5b00d876f6c5fd1a96ceb2e2ee018fafef17ab21488c29fd825ccb199c: Status 404 returned error can't find the container with id 2129ed5b00d876f6c5fd1a96ceb2e2ee018fafef17ab21488c29fd825ccb199c
Jul 31 01:37:04.116194 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.116170    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d65ee0_e69f_4ee1_ad1d_94c2599ea37c.slice/crio-6c450aa872cd0dbbc6fa37682375ae97964d798018592873308c5d97f6a4b510 WatchSource:0}: Error finding container 6c450aa872cd0dbbc6fa37682375ae97964d798018592873308c5d97f6a4b510: Status 404 returned error can't find the container with id 6c450aa872cd0dbbc6fa37682375ae97964d798018592873308c5d97f6a4b510
Jul 31 01:37:04.116830 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.116805    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1159aa_fadf_4c14_9e6d_1baa9e85ea43.slice/crio-dff79ae01fd247aef4418722abf842334fb7229f57565fd049767752c3e37961 WatchSource:0}: Error finding container dff79ae01fd247aef4418722abf842334fb7229f57565fd049767752c3e37961: Status 404 returned error can't find the container with id dff79ae01fd247aef4418722abf842334fb7229f57565fd049767752c3e37961
Jul 31 01:37:04.117536 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.117516    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17da502b_3e11_4ad5_a736_6ba46f2da765.slice/crio-568c37cc4fe61e8b2b0451c01fe1fb3e81b54d6354ec719f3bb1419c197f2ec5 WatchSource:0}: Error finding container 568c37cc4fe61e8b2b0451c01fe1fb3e81b54d6354ec719f3bb1419c197f2ec5: Status 404 returned error can't find the container with id 568c37cc4fe61e8b2b0451c01fe1fb3e81b54d6354ec719f3bb1419c197f2ec5
Jul 31 01:37:04.118248 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.118155    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7044ce9_82a1_41fa_9f3f_e10815914026.slice/crio-5612d179c3e837d1d9c4ec42a8f5eaf64486a2c29bf88197adbda6d698e2fc4d WatchSource:0}: Error finding container 5612d179c3e837d1d9c4ec42a8f5eaf64486a2c29bf88197adbda6d698e2fc4d: Status 404 returned error can't find the container with id 5612d179c3e837d1d9c4ec42a8f5eaf64486a2c29bf88197adbda6d698e2fc4d
Jul 31 01:37:04.120635 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.120614    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ea1983_2c83_4f97_8fe4_acffae008bad.slice/crio-6f5ecb1655a90106f5b9e300fc5423d49f5cab38821c8e7a71bb7f6d963aa1de WatchSource:0}: Error finding container 6f5ecb1655a90106f5b9e300fc5423d49f5cab38821c8e7a71bb7f6d963aa1de: Status 404 returned error can't find the container with id 6f5ecb1655a90106f5b9e300fc5423d49f5cab38821c8e7a71bb7f6d963aa1de
Jul 31 01:37:04.120973 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.120949    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cedfa0_8849_49e1_920c_dee94072d1d8.slice/crio-0092dae95d6657670875f75f3990f87d817c97dad805cba505f1d9fb76ab49df WatchSource:0}: Error finding container 0092dae95d6657670875f75f3990f87d817c97dad805cba505f1d9fb76ab49df: Status 404 returned error can't find the container with id 0092dae95d6657670875f75f3990f87d817c97dad805cba505f1d9fb76ab49df
Jul 31 01:37:04.122052 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:04.122029    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65faecef_fc92_4664_9cd9_2a331197b8da.slice/crio-4c914b4cce40bdd435bd75a615b76cd7c6c110029fe66ef13bb28d1cba9bd71d WatchSource:0}: Error finding container 4c914b4cce40bdd435bd75a615b76cd7c6c110029fe66ef13bb28d1cba9bd71d: Status 404 returned error can't find the container with id 4c914b4cce40bdd435bd75a615b76cd7c6c110029fe66ef13bb28d1cba9bd71d
Jul 31 01:37:04.395303 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.395278    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:04.395392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.395315    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:04.395436 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.395421    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:04.395467 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.395430    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:04.395500 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.395485    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:06.395468738 +0000 UTC m=+6.032261437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:04.395537 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.395503    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:06.395494722 +0000 UTC m=+6.032287420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:04.496153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.496123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:04.496299 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.496268    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:04.496299 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.496284    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:04.496299 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.496292    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:04.496393 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.496349    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:06.496330695 +0000 UTC m=+6.133123415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:04.815053 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.814968    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 01:32:02 +0000 UTC" deadline="2028-02-06 17:20:43.389646137 +0000 UTC"
Jul 31 01:37:04.815053 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.815050    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13335h43m38.574606388s"
Jul 31 01:37:04.922501 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.922421    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:04.922664 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:04.922537    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:04.947183 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.947151    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gshz6" event={"ID":"a9ea1983-2c83-4f97-8fe4-acffae008bad","Type":"ContainerStarted","Data":"6f5ecb1655a90106f5b9e300fc5423d49f5cab38821c8e7a71bb7f6d963aa1de"}
Jul 31 01:37:04.951614 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.951587    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2ss7q" event={"ID":"a7044ce9-82a1-41fa-9f3f-e10815914026","Type":"ContainerStarted","Data":"5612d179c3e837d1d9c4ec42a8f5eaf64486a2c29bf88197adbda6d698e2fc4d"}
Jul 31 01:37:04.957397 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.957372    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dn759" event={"ID":"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43","Type":"ContainerStarted","Data":"dff79ae01fd247aef4418722abf842334fb7229f57565fd049767752c3e37961"}
Jul 31 01:37:04.961828 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.961802    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk" event={"ID":"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c","Type":"ContainerStarted","Data":"6c450aa872cd0dbbc6fa37682375ae97964d798018592873308c5d97f6a4b510"}
Jul 31 01:37:04.979058 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.979026    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-76f27" event={"ID":"637d08ed-3e72-46e9-a4f0-54502d0a3c41","Type":"ContainerStarted","Data":"2129ed5b00d876f6c5fd1a96ceb2e2ee018fafef17ab21488c29fd825ccb199c"}
Jul 31 01:37:04.997737 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:04.997706    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerStarted","Data":"63b090e4bfc2101f55893b9a15e18219126ed0d659814376c7a68542c738dfc4"}
Jul 31 01:37:05.008770 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.008572    2555 generic.go:356] "Generic (PLEG): container finished" podID="b212c10c50d0615758db5d5bd95aa01c" containerID="04d9c7de81eb30a4057634e25e7075e67aaa1010f3df1af3e04b516b308eb7a1" exitCode=0
Jul 31 01:37:05.008770 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.008651    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal" event={"ID":"b212c10c50d0615758db5d5bd95aa01c","Type":"ContainerDied","Data":"04d9c7de81eb30a4057634e25e7075e67aaa1010f3df1af3e04b516b308eb7a1"}
Jul 31 01:37:05.024666 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.021829    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal" event={"ID":"d10851091c63cdffce3d56c3115c661b","Type":"ContainerStarted","Data":"e881ef4f3f58fb0fb866a5e3987ad4c5fbb0ad74bab8fc30719cb5b6432aae67"}
Jul 31 01:37:05.029478 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.029453    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"568c37cc4fe61e8b2b0451c01fe1fb3e81b54d6354ec719f3bb1419c197f2ec5"}
Jul 31 01:37:05.044853 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.044735    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p4ww7" event={"ID":"65faecef-fc92-4664-9cd9-2a331197b8da","Type":"ContainerStarted","Data":"4c914b4cce40bdd435bd75a615b76cd7c6c110029fe66ef13bb28d1cba9bd71d"}
Jul 31 01:37:05.054840 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.054775    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kxj8" event={"ID":"14cedfa0-8849-49e1-920c-dee94072d1d8","Type":"ContainerStarted","Data":"0092dae95d6657670875f75f3990f87d817c97dad805cba505f1d9fb76ab49df"}
Jul 31 01:37:05.920264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.920233    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:05.920726 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:05.920357    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:05.920823 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:05.920768    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:05.920924 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:05.920872    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:06.072495 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:06.071099    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal" event={"ID":"b212c10c50d0615758db5d5bd95aa01c","Type":"ContainerStarted","Data":"a7242fbeda29e230af78815a02b4bf0355909b9b115a47cd58c51ad0eba8eac6"}
Jul 31 01:37:06.091277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:06.091222    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-87.ec2.internal" podStartSLOduration=5.091203131 podStartE2EDuration="5.091203131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:05.039865209 +0000 UTC m=+4.676657931" watchObservedRunningTime="2026-07-31 01:37:06.091203131 +0000 UTC m=+5.727995853"
Jul 31 01:37:06.411905 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:06.411864    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:06.412092 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:06.411914    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:06.412164 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.412115    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:06.412216 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.412178    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:10.412160493 +0000 UTC m=+10.048953196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:06.412667 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.412573    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:06.412667 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.412629    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:10.412612739 +0000 UTC m=+10.049405458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:06.513801 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:06.513125    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:06.513801 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.513350    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:06.513801 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.513369    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:06.513801 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.513381    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:06.513801 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.513436    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:10.51341889 +0000 UTC m=+10.150211592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:06.921252 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:06.921216    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:06.927003 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:06.926968    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:07.920594 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:07.920555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:07.920795 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:07.920777    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:07.921221 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:07.921202    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:07.921331 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:07.921311    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:08.922030 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:08.922002    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:08.922475 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:08.922133    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:09.919602 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:09.919569    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:09.919797 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:09.919721    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:09.919868 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:09.919810    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:09.919945 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:09.919922    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:10.447315 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:10.447279    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:10.447700 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:10.447330    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:10.447700 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.447453    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:10.447700 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.447456    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:10.447700 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.447512    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:18.44749379 +0000 UTC m=+18.084286503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:10.447700 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.447574    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:18.447558381 +0000 UTC m=+18.084351086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:10.547946 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:10.547905    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:10.548117 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.548086    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:10.548117 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.548105    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:10.548117 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.548118    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:10.548275 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.548175    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:18.548157575 +0000 UTC m=+18.184950279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:10.922347 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:10.920929    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:10.922347 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:10.921059    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:11.920512 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:11.920477    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:11.920978 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:11.920616    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:11.921059 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:11.921041    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:11.921170 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:11.921145    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:12.920572 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:12.920539    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:12.921014 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:12.920678    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:13.920216 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:13.920180    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:13.920397 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:13.920306    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:13.920397 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:13.920360    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:13.920514 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:13.920479    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:14.919896 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:14.919860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:14.920372 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:14.920007    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:15.919942 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:15.919904    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:15.919942 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:15.919937    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:15.920427 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:15.920041    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:15.920427 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:15.920198    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:16.920144 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:16.920110    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:16.920539 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:16.920243    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:17.919618 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:17.919585    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:17.919898 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:17.919723    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:17.919898 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:17.919778    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:17.919988 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:17.919917    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:18.510151 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:18.510114    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:18.510618 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:18.510166    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:18.510618 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.510296    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:18.510618 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.510374    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:34.510352095 +0000 UTC m=+34.147144796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:18.510618 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.510301    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:18.510618 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.510444    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:34.510425909 +0000 UTC m=+34.147218621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:18.611368 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:18.611330    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:18.611516 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.611475    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:18.611516 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.611500    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:18.611516 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.611511    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:18.611652 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.611564    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:34.611545437 +0000 UTC m=+34.248338134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:18.919976 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:18.919946    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:18.920148 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:18.920075    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:19.919729 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:19.919698    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:19.919729 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:19.919736    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:19.920203 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:19.919840    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:19.920203 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:19.919951    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:20.921257 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:20.921221    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:20.921710 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:20.921342    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:21.920132 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:21.920099    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:21.920132 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:21.920124    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:21.920346 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:21.920226    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:21.920346 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:21.920326    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:22.920191 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:22.919963    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:22.920587 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:22.920287    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:23.111236 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.111030    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"a529d2391228be57397fa4064a329509a20179f3ea45ad3a6e2b3d6ad24d0782"}
Jul 31 01:37:23.111344 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.111312    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"4cbcbd97c09dce6cf566b3abb31ea0f489dbafd334b6483f1c76c59f8ee49037"}
Jul 31 01:37:23.112664 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.112638    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p4ww7" event={"ID":"65faecef-fc92-4664-9cd9-2a331197b8da","Type":"ContainerStarted","Data":"c779f6098ac7a122c57b0588690422a0a68ea604dc1ffc2998721286bb02ee2f"}
Jul 31 01:37:23.114204 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.114168    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kxj8" event={"ID":"14cedfa0-8849-49e1-920c-dee94072d1d8","Type":"ContainerStarted","Data":"5d485330c2a4e13503167a8e506ace900a095871f2857a93477060ec7f755fe7"}
Jul 31 01:37:23.115488 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.115470    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gshz6" event={"ID":"a9ea1983-2c83-4f97-8fe4-acffae008bad","Type":"ContainerStarted","Data":"2b9fc6a96cfaacaa73f06420ee246db7b39226aa2d485c2f7904cd22026e1c3c"}
Jul 31 01:37:23.116875 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.116852    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dn759" event={"ID":"6c1159aa-fadf-4c14-9e6d-1baa9e85ea43","Type":"ContainerStarted","Data":"4accfcaa1419b726819cd89132f5736515f0e2d0c368229c8429205cca5ce40a"}
Jul 31 01:37:23.118200 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.118181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk" event={"ID":"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c","Type":"ContainerStarted","Data":"ee29c3ed203230900293e52133383464120a8046ba3c1952a5c3cf04a78304ab"}
Jul 31 01:37:23.119580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.119554    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-76f27" event={"ID":"637d08ed-3e72-46e9-a4f0-54502d0a3c41","Type":"ContainerStarted","Data":"41b390b1cc212a7db7297c2d73d12108cccfdf4e7ae5edad609328258878f439"}
Jul 31 01:37:23.120961 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.120944    2555 generic.go:356] "Generic (PLEG): container finished" podID="330402cd-8a63-47bc-877d-b7962bd53e8a" containerID="25ae531db7b38ba05c28e32769b75d9abc074bd9d582e10ad2278a466f4e7716" exitCode=0
Jul 31 01:37:23.121043 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.120973    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerDied","Data":"25ae531db7b38ba05c28e32769b75d9abc074bd9d582e10ad2278a466f4e7716"}
Jul 31 01:37:23.128308 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.128274    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-87.ec2.internal" podStartSLOduration=22.128262981 podStartE2EDuration="22.128262981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:06.091946058 +0000 UTC m=+5.728738778" watchObservedRunningTime="2026-07-31 01:37:23.128262981 +0000 UTC m=+22.765055701"
Jul 31 01:37:23.128531 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.128513    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p4ww7" podStartSLOduration=3.499733932 podStartE2EDuration="22.128507978s" totalImagesPullingTime="18.628774046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:23.128145384 +0000 UTC m=+22.764938103" watchObservedRunningTime="2026-07-31 01:37:23.128507978 +0000 UTC m=+22.765300698"
Jul 31 01:37:23.144276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.144229    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gshz6" podStartSLOduration=3.514519866 podStartE2EDuration="22.144213627s" totalImagesPullingTime="18.629693761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:23.143388626 +0000 UTC m=+22.780181369" watchObservedRunningTime="2026-07-31 01:37:23.144213627 +0000 UTC m=+22.781006348"
Jul 31 01:37:23.165741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.165705    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7kxj8" podStartSLOduration=3.4822289140000002 podStartE2EDuration="22.165693801s" totalImagesPullingTime="18.683464887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:23.165090278 +0000 UTC m=+22.801883019" watchObservedRunningTime="2026-07-31 01:37:23.165693801 +0000 UTC m=+22.802486521"
Jul 31 01:37:23.203711 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.203674    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-76f27" podStartSLOduration=3.5671467740000002 podStartE2EDuration="22.203661196s" totalImagesPullingTime="18.636514422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:23.20303353 +0000 UTC m=+22.839826269" watchObservedRunningTime="2026-07-31 01:37:23.203661196 +0000 UTC m=+22.840453916"
Jul 31 01:37:23.218642 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.218608    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dn759" podStartSLOduration=11.315716568 podStartE2EDuration="22.218596317s" totalImagesPullingTime="10.902879749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:23.218222521 +0000 UTC m=+22.855015241" watchObservedRunningTime="2026-07-31 01:37:23.218596317 +0000 UTC m=+22.855389037"
Jul 31 01:37:23.920386 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.920352    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:23.920386 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:23.920373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:23.921141 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:23.920472    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:23.921141 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:23.920893    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:24.125156 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.125119    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2ss7q" event={"ID":"a7044ce9-82a1-41fa-9f3f-e10815914026","Type":"ContainerStarted","Data":"70f83973e7182ab5231a7ee8c67b0a7bb7d02f651d82fab0b9672d20e9b676f4"}
Jul 31 01:37:24.128371 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.128309    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"022fef2ab3beabb4f11b1e3095d030a1e4835c328d99c35c122395cfedd567de"}
Jul 31 01:37:24.128518 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.128389    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"80b900b461e82561f9733d44b2873bafd8be2d6f206845e306ac077f26363878"}
Jul 31 01:37:24.128518 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.128438    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"04d90c601c75a3068abed376f9ec99ee907109e339f4d215236a9ce35449a14f"}
Jul 31 01:37:24.128518 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.128477    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"97f3324e40323c84d9e820ff6165e852588d0b5226d462e2824ebe36ae4a7377"}
Jul 31 01:37:24.141030 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.140987    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2ss7q" podStartSLOduration=4.50701987 podStartE2EDuration="23.140974116s" totalImagesPullingTime="18.633954246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:24.140650806 +0000 UTC m=+23.777443529" watchObservedRunningTime="2026-07-31 01:37:24.140974116 +0000 UTC m=+23.777766835"
Jul 31 01:37:24.471953 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.471931    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 01:37:24.836268 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.836181    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T01:37:24.471948112Z","UUID":"0b4fcd29-c380-47b5-870a-346d738a2ff2","Handler":null,"Name":"","Endpoint":""}
Jul 31 01:37:24.837376 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.837356    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 01:37:24.837489 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.837394    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 01:37:24.920267 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:24.920214    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:24.920459 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:24.920367    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:25.134082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:25.133997    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk" event={"ID":"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c","Type":"ContainerStarted","Data":"1afce82080a2607c18bf39a243853fa30f64ec030cf1c1bea0937a29b4660953"}
Jul 31 01:37:25.919779 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:25.919733    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:25.919927 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:25.919891    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:25.920085 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:25.920064    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:25.920261 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:25.920239    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:26.138590 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:26.138555    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk" event={"ID":"26d65ee0-e69f-4ee1-ad1d-94c2599ea37c","Type":"ContainerStarted","Data":"63beb9504e1942955f27a475a7538d9a585472028412eef499f84d153603faa4"}
Jul 31 01:37:26.142468 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:26.142399    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"802eac71661e662748370a0b1c57b82e719b43cc2de003bb4967e0efec2349d7"}
Jul 31 01:37:26.156932 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:26.156887    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7dtk" podStartSLOduration=3.746709219 podStartE2EDuration="25.156869138s" totalImagesPullingTime="21.410159919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:26.156801608 +0000 UTC m=+25.793594357" watchObservedRunningTime="2026-07-31 01:37:26.156869138 +0000 UTC m=+25.793661855"
Jul 31 01:37:26.687155 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:26.686976    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:26.687545 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:26.687522    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:26.919907 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:26.919875    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:26.920075 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:26.920007    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:27.144472 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:27.144444    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:27.144945 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:27.144931    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dn759"
Jul 31 01:37:27.919961 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:27.919927    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:27.920146 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:27.919980    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:27.920146 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:27.920059    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:27.920264 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:27.920198    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:28.920064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:28.919819    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:28.920694 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:28.920068    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:29.150060 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:29.150025    2555 generic.go:356] "Generic (PLEG): container finished" podID="330402cd-8a63-47bc-877d-b7962bd53e8a" containerID="7d9f22d4581590869d35bc44eceb84a79843d7ae53fbdaabdb34fb270e11afa6" exitCode=0
Jul 31 01:37:29.150222 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:29.150107    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerDied","Data":"7d9f22d4581590869d35bc44eceb84a79843d7ae53fbdaabdb34fb270e11afa6"}
Jul 31 01:37:29.153795 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:29.153771    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" event={"ID":"17da502b-3e11-4ad5-a736-6ba46f2da765","Type":"ContainerStarted","Data":"dbc663e33ebe4b5bf3c0811917c217117af05fe175175b256a0839c8001d3a60"}
Jul 31 01:37:29.191893 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:29.191821    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2" podStartSLOduration=9.487217939 podStartE2EDuration="28.191809891s" totalImagesPullingTime="18.704591952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:29.191267812 +0000 UTC m=+28.828060530" watchObservedRunningTime="2026-07-31 01:37:29.191809891 +0000 UTC m=+28.828602611"
Jul 31 01:37:29.920107 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:29.920077    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:29.920586 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:29.920114    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:29.920586 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:29.920194    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:29.920586 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:29.920313    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:30.156809 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.156782    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:30.156963 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.156864    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:30.156963 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.156913    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:30.171730 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.171676    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:30.171879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.171794    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:37:30.340032 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.340003    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-frgz4"]
Jul 31 01:37:30.340138 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.340125    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:30.340224 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:30.340208    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:30.343097 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.342912    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gmwj6"]
Jul 31 01:37:30.343097 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.342999    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:30.343097 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:30.343090    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:30.343737 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.343703    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vb8p5"]
Jul 31 01:37:30.343840 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:30.343806    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:30.343900 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:30.343885    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:31.160281 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:31.160248    2555 generic.go:356] "Generic (PLEG): container finished" podID="330402cd-8a63-47bc-877d-b7962bd53e8a" containerID="653e9be2f4c95dad2ce9bc323f691c381c199440105e701f693a69eaa5bfc6b4" exitCode=0
Jul 31 01:37:31.160668 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:31.160334    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerDied","Data":"653e9be2f4c95dad2ce9bc323f691c381c199440105e701f693a69eaa5bfc6b4"}
Jul 31 01:37:31.920516 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:31.920486    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:31.920636 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:31.920491    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:31.920636 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:31.920593    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:31.920772 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:31.920654    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:31.920772 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:31.920496    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:31.920772 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:31.920727    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:33.167107 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:33.166914    2555 generic.go:356] "Generic (PLEG): container finished" podID="330402cd-8a63-47bc-877d-b7962bd53e8a" containerID="1d3af21f680550ee700e503669400b381d959deb95931af2c657bec93cc336e3" exitCode=0
Jul 31 01:37:33.167500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:33.166991    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerDied","Data":"1d3af21f680550ee700e503669400b381d959deb95931af2c657bec93cc336e3"}
Jul 31 01:37:33.920098 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:33.920067    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:33.920250 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:33.920078    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:33.920250 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:33.920173    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmwj6" podUID="9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1"
Jul 31 01:37:33.920250 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:33.920188    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:33.920250 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:33.920241    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:37:33.920380 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:33.920316    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgz4" podUID="978fae1d-3d03-4d81-a334-3a9e8bc30528"
Jul 31 01:37:34.536139 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:34.536107    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:34.536139 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:34.536140    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:34.536522 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.536244    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:34.536522 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.536246    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:34.536522 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.536293    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret podName:9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:06.536280244 +0000 UTC m=+66.173072942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret") pod "global-pull-secret-syncer-gmwj6" (UID: "9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:34.536522 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.536307    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:06.536300257 +0000 UTC m=+66.173092954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:34.637011 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:34.636979    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:34.637171 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.637098    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:34.637171 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.637114    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:34.637171 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.637122    2555 projected.go:196] Error preparing data for projected volume kube-api-access-8z25p for pod openshift-network-diagnostics/network-check-target-frgz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:34.637171 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:34.637170    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p podName:978fae1d-3d03-4d81-a334-3a9e8bc30528 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:06.637156926 +0000 UTC m=+66.273949623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z25p" (UniqueName: "kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p") pod "network-check-target-frgz4" (UID: "978fae1d-3d03-4d81-a334-3a9e8bc30528") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:35.658001 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.657973    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-87.ec2.internal" event="NodeReady"
Jul 31 01:37:35.658351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.658091    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 01:37:35.691593 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.690897    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79bfc6d44f-8mv5f"]
Jul 31 01:37:35.692896 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.692873    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"]
Jul 31 01:37:35.693038 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.693011    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.694827 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.694808    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:35.695304 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.695263    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 01:37:35.695304 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.695265    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 01:37:35.695475 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.695291    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6prlk\""
Jul 31 01:37:35.695686 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.695663    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 01:37:35.697065 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.697045    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 31 01:37:35.697250 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.697238    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 31 01:37:35.697691 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.697544    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gmnxq\""
Jul 31 01:37:35.704058 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.704023    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"]
Jul 31 01:37:35.704723 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.704702    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 01:37:35.706858 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.706837    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79bfc6d44f-8mv5f"]
Jul 31 01:37:35.709893 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.709875    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9427d"]
Jul 31 01:37:35.712400 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.712385    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qd64g"]
Jul 31 01:37:35.712519 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.712503    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.714206 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.714188    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.714873 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.714855    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 01:37:35.714966 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.714895    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5txjm\""
Jul 31 01:37:35.715116 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.715098    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 01:37:35.717875 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.717844    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 01:37:35.718306 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.718288    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 01:37:35.718378 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.718344    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kcx9d\""
Jul 31 01:37:35.718567 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.718550    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 01:37:35.722255 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.722234    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qd64g"]
Jul 31 01:37:35.722924 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.722901    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9427d"]
Jul 31 01:37:35.841017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.840977    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:35.847865 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.847838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa135198-565e-4fd8-914a-218340ba89b4-config-volume\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.847979 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.847899    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa135198-565e-4fd8-914a-218340ba89b4-tmp-dir\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.847979 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.847926    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24wtt\" (UniqueName: \"kubernetes.io/projected/fa135198-565e-4fd8-914a-218340ba89b4-kube-api-access-24wtt\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.847979 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.847960    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.847984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa52142-daac-4f27-8a4b-3a386aae2eb5-ca-trust-extracted\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848011    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6w4\" (UniqueName: \"kubernetes.io/projected/843a29e7-e3bf-40fb-8e81-ca8a7c64bc10-kube-api-access-tc6w4\") pod \"ingress-canary-qd64g\" (UID: \"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10\") " pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-trusted-ca\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848057    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-bound-sa-token\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848085    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848113    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/843a29e7-e3bf-40fb-8e81-ca8a7c64bc10-cert\") pod \"ingress-canary-qd64g\" (UID: \"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10\") " pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.848148 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848140    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-certificates\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848428 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848159    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-kube-api-access-5prxr\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848428 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848196    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-installation-pull-secrets\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848428 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848219    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a274a59c-e2a0-473f-bfdb-a11dd656ce11-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:35.848428 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848242    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-image-registry-private-configuration\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.848428 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.848267    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.920208 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.920131    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:37:35.920208 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.920199    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:37:35.920394 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.920288    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:37:35.923073 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.923053    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 01:37:35.923196 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.923108    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 01:37:35.923268 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.923054    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 01:37:35.923350 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.923322    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zn99h\""
Jul 31 01:37:35.923525 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.923510    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 01:37:35.923709 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.923691    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfbbx\""
Jul 31 01:37:35.924709 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.924676    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:35.949456 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949439    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/843a29e7-e3bf-40fb-8e81-ca8a7c64bc10-cert\") pod \"ingress-canary-qd64g\" (UID: \"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10\") " pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.949544 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949469    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-certificates\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949544 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-kube-api-access-5prxr\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949544 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-installation-pull-secrets\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949544 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949540    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a274a59c-e2a0-473f-bfdb-a11dd656ce11-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:35.949741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949573    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-image-registry-private-configuration\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949604    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.949741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949662    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa135198-565e-4fd8-914a-218340ba89b4-config-volume\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.949741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949704    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa135198-565e-4fd8-914a-218340ba89b4-tmp-dir\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.949741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949728    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24wtt\" (UniqueName: \"kubernetes.io/projected/fa135198-565e-4fd8-914a-218340ba89b4-kube-api-access-24wtt\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.949965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949775    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949799    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa52142-daac-4f27-8a4b-3a386aae2eb5-ca-trust-extracted\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949825    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6w4\" (UniqueName: \"kubernetes.io/projected/843a29e7-e3bf-40fb-8e81-ca8a7c64bc10-kube-api-access-tc6w4\") pod \"ingress-canary-qd64g\" (UID: \"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10\") " pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.949965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-trusted-ca\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949876    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-bound-sa-token\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.949965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.949902    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:35.950223 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950015    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:37:35.950223 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950078    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:36.45005996 +0000 UTC m=+36.086852674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:37:35.950223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.950106    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-certificates\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.950423 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.950398    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa52142-daac-4f27-8a4b-3a386aae2eb5-ca-trust-extracted\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.950907 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950656    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:35.950907 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950711    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:36.450695906 +0000 UTC m=+36.087488604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:35.950907 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.950762    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a274a59c-e2a0-473f-bfdb-a11dd656ce11-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:35.950907 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950853    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:37:35.950907 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950865    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:37:35.951207 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:35.950915    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:36.450900886 +0000 UTC m=+36.087693598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:37:35.951207 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.950951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa135198-565e-4fd8-914a-218340ba89b4-config-volume\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.951207 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.951117    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa135198-565e-4fd8-914a-218340ba89b4-tmp-dir\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:35.951207 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.951169    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-trusted-ca\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.954217 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.954197    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-installation-pull-secrets\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.954303 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.954202    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-image-registry-private-configuration\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.954303 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.954236    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/843a29e7-e3bf-40fb-8e81-ca8a7c64bc10-cert\") pod \"ingress-canary-qd64g\" (UID: \"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10\") " pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.962022 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.961987    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-bound-sa-token\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.962092 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.961995    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-kube-api-access-5prxr\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:35.962142 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.962104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6w4\" (UniqueName: \"kubernetes.io/projected/843a29e7-e3bf-40fb-8e81-ca8a7c64bc10-kube-api-access-tc6w4\") pod \"ingress-canary-qd64g\" (UID: \"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10\") " pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:35.963637 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:35.963619    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24wtt\" (UniqueName: \"kubernetes.io/projected/fa135198-565e-4fd8-914a-218340ba89b4-kube-api-access-24wtt\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:36.030494 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:36.030437    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qd64g"
Jul 31 01:37:36.173395 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:36.173242    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qd64g"]
Jul 31 01:37:36.455453 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:36.455369    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:36.455453 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:36.455422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:36.455647 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:36.455513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:36.455647 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455546    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:37:36.455647 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455589    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:37:36.455647 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455602    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:37:36.455647 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455625    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:37.455604411 +0000 UTC m=+37.092397114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:37:36.455883 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455667    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:37.455649345 +0000 UTC m=+37.092442045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:37:36.455883 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455730    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:36.455883 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:36.455790    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:37.455776236 +0000 UTC m=+37.092568939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:37.464516 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:37.464468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:37.464527    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:37.464579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464654    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464671    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464681    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464697    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464735    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:39.464718199 +0000 UTC m=+39.101510897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464774    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:39.464760339 +0000 UTC m=+39.101553050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:37:37.465174 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:37.464789    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:39.464782621 +0000 UTC m=+39.101575319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:37:37.644567 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:37:37.644535    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843a29e7_e3bf_40fb_8e81_ca8a7c64bc10.slice/crio-c82ceca9ad1f754d81a9bfd5ab4f417735908a1c9230f875026b6eeba72117dd WatchSource:0}: Error finding container c82ceca9ad1f754d81a9bfd5ab4f417735908a1c9230f875026b6eeba72117dd: Status 404 returned error can't find the container with id c82ceca9ad1f754d81a9bfd5ab4f417735908a1c9230f875026b6eeba72117dd
Jul 31 01:37:38.180499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:38.180285    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qd64g" event={"ID":"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10","Type":"ContainerStarted","Data":"c82ceca9ad1f754d81a9bfd5ab4f417735908a1c9230f875026b6eeba72117dd"}
Jul 31 01:37:38.182899 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:38.182874    2555 generic.go:356] "Generic (PLEG): container finished" podID="330402cd-8a63-47bc-877d-b7962bd53e8a" containerID="8a241c98135a74e458b7bcffc036862bdccc7b4669405e5a328e6c9c79a4eeb9" exitCode=0
Jul 31 01:37:38.182996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:38.182905    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerDied","Data":"8a241c98135a74e458b7bcffc036862bdccc7b4669405e5a328e6c9c79a4eeb9"}
Jul 31 01:37:39.189567 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:39.189534    2555 generic.go:356] "Generic (PLEG): container finished" podID="330402cd-8a63-47bc-877d-b7962bd53e8a" containerID="ea92cb45093c1ccb857aace027ac1f88c03f7b6da00d66b79bf9d1d2ba1ed03b" exitCode=0
Jul 31 01:37:39.189966 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:39.189581    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerDied","Data":"ea92cb45093c1ccb857aace027ac1f88c03f7b6da00d66b79bf9d1d2ba1ed03b"}
Jul 31 01:37:39.478067 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:39.477982    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:39.478216 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:39.478091    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:39.478216 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:39.478123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:39.478216 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478153    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:39.478354 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478225    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:37:39.478354 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478229    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:43.478209426 +0000 UTC m=+43.115002140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:39.478354 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478230    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:37:39.478354 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478255    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:37:39.478354 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478272    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:43.478258328 +0000 UTC m=+43.115051032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:37:39.478354 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:39.478294    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:43.478284211 +0000 UTC m=+43.115076908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:37:40.194974 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:40.194883    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" event={"ID":"330402cd-8a63-47bc-877d-b7962bd53e8a","Type":"ContainerStarted","Data":"152f9cfb35c7363413aec61bab46af0aa7e9e311a2fef8f215710596048592f5"}
Jul 31 01:37:40.216888 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:40.216836    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gtdnq" podStartSLOduration=9.599317267 podStartE2EDuration="40.216817505s" totalImagesPullingTime="30.617500238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:40.216660459 +0000 UTC m=+39.853453204" watchObservedRunningTime="2026-07-31 01:37:40.216817505 +0000 UTC m=+39.853610225"
Jul 31 01:37:40.337566 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:40.337519    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:40.435700 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:40.435663    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:40.671822 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:40.671728    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:40.721932 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:40.721895    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:42.201664 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:42.201629    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qd64g" event={"ID":"843a29e7-e3bf-40fb-8e81-ca8a7c64bc10","Type":"ContainerStarted","Data":"b2273097bbefa94f4b4d5ba49eacf4235e7c45d5b0fabec0229227099a7b011e"}
Jul 31 01:37:42.216201 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:42.216164    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qd64g" podStartSLOduration=3.248275192 podStartE2EDuration="7.216149393s" totalImagesPullingTime="3.967874201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:42.215890073 +0000 UTC m=+41.852682818" watchObservedRunningTime="2026-07-31 01:37:42.216149393 +0000 UTC m=+41.852942126"
Jul 31 01:37:42.272957 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:42.272929    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:42.330513 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:42.330485    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:42.377594 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:42.377563    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:43.311674 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:43.311639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:43.412431 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:43.412381    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log" limit=1024
Jul 31 01:37:43.511033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:43.511006    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:43.511136 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:43.511075    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:43.511136 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:43.511105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:43.511217 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511174    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:43.511217 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511203    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:37:43.511277 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511177    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:37:43.511277 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511238    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:51.511223065 +0000 UTC m=+51.148015765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:43.511277 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511244    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:37:43.511277 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511254    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:51.511248055 +0000 UTC m=+51.148040753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:37:43.511277 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:43.511270    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:51.511260219 +0000 UTC m=+51.148052916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:37:51.566898 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:51.566852    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:51.566906    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:37:51.566957    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567024    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567050    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567051    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567127    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:07.567107247 +0000 UTC m=+67.203899965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567124    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567142    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:07.567134531 +0000 UTC m=+67.203927229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:37:51.567381 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:37:51.567201    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:07.56718947 +0000 UTC m=+67.203982170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:38:02.177291 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:02.177260    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nvn2"
Jul 31 01:38:06.579290 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.579241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:38:06.579290 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.579292    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:38:06.582040 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.582022    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 01:38:06.582213 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.582192    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 01:38:06.590022 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:06.590006    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 01:38:06.590075 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:06.590065    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:39:10.590050872 +0000 UTC m=+130.226843570 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : secret "metrics-daemon-secret" not found
Jul 31 01:38:06.593389 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.593362    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1-original-pull-secret\") pod \"global-pull-secret-syncer-gmwj6\" (UID: \"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1\") " pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:38:06.680160 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.680123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:38:06.682730 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.682715    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 01:38:06.693047 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.693031    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 01:38:06.704082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.704058    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z25p\" (UniqueName: \"kubernetes.io/projected/978fae1d-3d03-4d81-a334-3a9e8bc30528-kube-api-access-8z25p\") pod \"network-check-target-frgz4\" (UID: \"978fae1d-3d03-4d81-a334-3a9e8bc30528\") " pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:38:06.834462 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.834400    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfbbx\""
Jul 31 01:38:06.842496 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.842479    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:38:06.844634 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.844615    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmwj6"
Jul 31 01:38:06.972793 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.972741    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gmwj6"]
Jul 31 01:38:06.976861 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:38:06.976836    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae9d9f3_02b0_4a25_8e13_86bd8e84b8f1.slice/crio-69437722c21b0e54f11d387bb170d43ff509d7f5f853798c8c20434dacffdbec WatchSource:0}: Error finding container 69437722c21b0e54f11d387bb170d43ff509d7f5f853798c8c20434dacffdbec: Status 404 returned error can't find the container with id 69437722c21b0e54f11d387bb170d43ff509d7f5f853798c8c20434dacffdbec
Jul 31 01:38:06.989213 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:06.989188    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-frgz4"]
Jul 31 01:38:06.994581 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:38:06.994558    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978fae1d_3d03_4d81_a334_3a9e8bc30528.slice/crio-e14df608e46775a149cae33b5e2dea6245e7f3a653ecafffa3893821ef26bbed WatchSource:0}: Error finding container e14df608e46775a149cae33b5e2dea6245e7f3a653ecafffa3893821ef26bbed: Status 404 returned error can't find the container with id e14df608e46775a149cae33b5e2dea6245e7f3a653ecafffa3893821ef26bbed
Jul 31 01:38:07.257465 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:07.257395    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gmwj6" event={"ID":"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1","Type":"ContainerStarted","Data":"69437722c21b0e54f11d387bb170d43ff509d7f5f853798c8c20434dacffdbec"}
Jul 31 01:38:07.258476 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:07.258455    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-frgz4" event={"ID":"978fae1d-3d03-4d81-a334-3a9e8bc30528","Type":"ContainerStarted","Data":"e14df608e46775a149cae33b5e2dea6245e7f3a653ecafffa3893821ef26bbed"}
Jul 31 01:38:07.586692 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:07.586653    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:07.586708    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:07.586777    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.586927    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.586990    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:39.586970369 +0000 UTC m=+99.223763068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.587063    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.587074    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:38:07.587166 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.587121    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:39.587109862 +0000 UTC m=+99.223902560 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:38:07.587515 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.587177    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:38:07.587515 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:07.587209    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:39.587198688 +0000 UTC m=+99.223991386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:38:12.272722 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:12.272628    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gmwj6" event={"ID":"9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1","Type":"ContainerStarted","Data":"42b9bf7584d8c2b819f201ea40a99dfa1bbf01177c71f2e38a1861f0319b5b05"}
Jul 31 01:38:12.274147 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:12.274122    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-frgz4" event={"ID":"978fae1d-3d03-4d81-a334-3a9e8bc30528","Type":"ContainerStarted","Data":"207e023b664c934d8e1442f08f5c7ed26095e6646b3be8bfeaf2df1a4768c612"}
Jul 31 01:38:12.274257 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:12.274245    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:38:12.286573 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:12.286532    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gmwj6" podStartSLOduration=66.460981932 podStartE2EDuration="1m11.286519814s" totalImagesPullingTime="4.825537882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:38:12.286165587 +0000 UTC m=+71.922958307" watchObservedRunningTime="2026-07-31 01:38:12.286519814 +0000 UTC m=+71.923312533"
Jul 31 01:38:12.302589 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:12.302552    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-frgz4" podStartSLOduration=67.497613981 podStartE2EDuration="1m12.302539658s" totalImagesPullingTime="4.804925677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:38:12.302284479 +0000 UTC m=+71.939077224" watchObservedRunningTime="2026-07-31 01:38:12.302539658 +0000 UTC m=+71.939332360"
Jul 31 01:38:39.619737 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:39.619593    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:38:39.619737 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:39.619660    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:38:39.619737 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:39.619693    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619743    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619813    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619817    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619834    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619850    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:39:43.619830065 +0000 UTC m=+163.256622763 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619876    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:39:43.619859427 +0000 UTC m=+163.256652140 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:38:39.620356 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:38:39.619894    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:39:43.619885545 +0000 UTC m=+163.256678249 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:38:43.280463 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:38:43.280432    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-frgz4"
Jul 31 01:39:10.635072 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:10.635033    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:39:10.635549 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:10.635180    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 01:39:10.635549 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:10.635252    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:12.635237258 +0000 UTC m=+252.272029956 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : secret "metrics-daemon-secret" not found
Jul 31 01:39:38.707449 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:38.707398    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5"
Jul 31 01:39:38.713519 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:38.713490    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g" podUID="a274a59c-e2a0-473f-bfdb-a11dd656ce11"
Jul 31 01:39:38.723620 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:38.723603    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9427d" podUID="fa135198-565e-4fd8-914a-218340ba89b4"
Jul 31 01:39:38.940355 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:38.940323    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:39:39.475824 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:39.475796    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:39:39.475995 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:39.475796    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:39:39.475995 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:39.475799    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9427d"
Jul 31 01:39:43.665183 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:43.665149    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:43.665193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:43.665244    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665309    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665333    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bfc6d44f-8mv5f: secret "image-registry-tls" not found
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665351    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665369    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665403    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls podName:5fa52142-daac-4f27-8a4b-3a386aae2eb5 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:45.665382321 +0000 UTC m=+285.302175024 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls") pod "image-registry-79bfc6d44f-8mv5f" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5") : secret "image-registry-tls" not found
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665416    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert podName:a274a59c-e2a0-473f-bfdb-a11dd656ce11 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:45.665410635 +0000 UTC m=+285.302203334 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-75p5g" (UID: "a274a59c-e2a0-473f-bfdb-a11dd656ce11") : secret "networking-console-plugin-cert" not found
Jul 31 01:39:43.665634 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:39:43.665427    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls podName:fa135198-565e-4fd8-914a-218340ba89b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:45.665421914 +0000 UTC m=+285.302214612 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls") pod "dns-default-9427d" (UID: "fa135198-565e-4fd8-914a-218340ba89b4") : secret "dns-default-metrics-tls" not found
Jul 31 01:39:50.921498 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:39:50.921467    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:41:05.738346 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.738309    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"]
Jul 31 01:41:05.740140 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.740119    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"]
Jul 31 01:41:05.740259 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.740232    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"
Jul 31 01:41:05.741865 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.741846    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"]
Jul 31 01:41:05.741973 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.741954    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.742807 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.742788    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tsm8c\""
Jul 31 01:41:05.743460 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.743440    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.744237 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.744224    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.746374 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746344    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 31 01:41:05.746374 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746348    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gc7hc\""
Jul 31 01:41:05.746523 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746387    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.746523 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746406    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.746523 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746406    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 31 01:41:05.746523 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746493    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 31 01:41:05.746888 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746787    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wdzp4\""
Jul 31 01:41:05.746888 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746829    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 31 01:41:05.746888 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.746871    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.759651 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.759631    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"]
Jul 31 01:41:05.762953 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.762933    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"]
Jul 31 01:41:05.763794 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.763774    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"]
Jul 31 01:41:05.822242 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822218    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e9029b9d-9235-4a98-8cce-4a2cca4a320a-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.822398 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822247    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grftp\" (UniqueName: \"kubernetes.io/projected/93bcb820-995b-4595-998e-da26e7ec0968-kube-api-access-grftp\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.822398 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822275    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgkr4\" (UniqueName: \"kubernetes.io/projected/6b46c4d2-b18f-4ace-816a-53641ee36f05-kube-api-access-jgkr4\") pod \"network-check-source-65bdbbff45-wd4qp\" (UID: \"6b46c4d2-b18f-4ace-816a-53641ee36f05\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"
Jul 31 01:41:05.822398 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822305    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhvkh\" (UniqueName: \"kubernetes.io/projected/e9029b9d-9235-4a98-8cce-4a2cca4a320a-kube-api-access-hhvkh\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.822398 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822338    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93bcb820-995b-4595-998e-da26e7ec0968-serving-cert\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.822567 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822418    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93bcb820-995b-4595-998e-da26e7ec0968-config\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.822567 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.822458    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.836072 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.836049    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"]
Jul 31 01:41:05.837812 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.837798    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-bl74l"]
Jul 31 01:41:05.837931 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.837917    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:05.839340 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.839324    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:05.842805 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.842789    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.848237 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.848218    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wjl5t\""
Jul 31 01:41:05.848331 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.848317    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.850017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.850002    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 31 01:41:05.850934 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.850920    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 31 01:41:05.852393 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.852379    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 31 01:41:05.852693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.852680    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.854406 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.854393    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.854884 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.854871    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-npvvq\""
Jul 31 01:41:05.854989 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.854972    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 31 01:41:05.863996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.863979    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"]
Jul 31 01:41:05.864984 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.864968    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-bl74l"]
Jul 31 01:41:05.873604 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.873584    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 31 01:41:05.923200 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923178    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgkr4\" (UniqueName: \"kubernetes.io/projected/6b46c4d2-b18f-4ace-816a-53641ee36f05-kube-api-access-jgkr4\") pod \"network-check-source-65bdbbff45-wd4qp\" (UID: \"6b46c4d2-b18f-4ace-816a-53641ee36f05\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"
Jul 31 01:41:05.923325 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923209    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:05.923325 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923229    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93bcb820-995b-4595-998e-da26e7ec0968-serving-cert\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.923325 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923245    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1ff5872-e369-4173-9422-74b878a1504c-config\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:05.923325 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923264    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93bcb820-995b-4595-998e-da26e7ec0968-config\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.923500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923327    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjdl\" (UniqueName: \"kubernetes.io/projected/b1ff5872-e369-4173-9422-74b878a1504c-kube-api-access-9mjdl\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:05.923500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923373    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grftp\" (UniqueName: \"kubernetes.io/projected/93bcb820-995b-4595-998e-da26e7ec0968-kube-api-access-grftp\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.923500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923412    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1ff5872-e369-4173-9422-74b878a1504c-trusted-ca\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:05.923500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923430    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:05.923500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923455    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhvkh\" (UniqueName: \"kubernetes.io/projected/e9029b9d-9235-4a98-8cce-4a2cca4a320a-kube-api-access-hhvkh\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.923764 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923532    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1ff5872-e369-4173-9422-74b878a1504c-serving-cert\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:05.923764 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923589    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.923764 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923629    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57grm\" (UniqueName: \"kubernetes.io/projected/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-kube-api-access-57grm\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:05.923764 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e9029b9d-9235-4a98-8cce-4a2cca4a320a-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.923764 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:05.923698    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:05.923764 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.923740    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93bcb820-995b-4595-998e-da26e7ec0968-config\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.924062 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:05.923793    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls podName:e9029b9d-9235-4a98-8cce-4a2cca4a320a nodeName:}" failed. No retries permitted until 2026-07-31 01:41:06.423773473 +0000 UTC m=+246.060566178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-dhxff" (UID: "e9029b9d-9235-4a98-8cce-4a2cca4a320a") : secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:05.924459 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.924438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e9029b9d-9235-4a98-8cce-4a2cca4a320a-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.925652 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.925636    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93bcb820-995b-4595-998e-da26e7ec0968-serving-cert\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:05.934384 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.932652    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgkr4\" (UniqueName: \"kubernetes.io/projected/6b46c4d2-b18f-4ace-816a-53641ee36f05-kube-api-access-jgkr4\") pod \"network-check-source-65bdbbff45-wd4qp\" (UID: \"6b46c4d2-b18f-4ace-816a-53641ee36f05\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"
Jul 31 01:41:05.934384 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.933067    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhvkh\" (UniqueName: \"kubernetes.io/projected/e9029b9d-9235-4a98-8cce-4a2cca4a320a-kube-api-access-hhvkh\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:05.935288 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:05.935268    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grftp\" (UniqueName: \"kubernetes.io/projected/93bcb820-995b-4595-998e-da26e7ec0968-kube-api-access-grftp\") pod \"service-ca-operator-784f97bcf6-26jk8\" (UID: \"93bcb820-995b-4595-998e-da26e7ec0968\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:06.025055 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.024975    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1ff5872-e369-4173-9422-74b878a1504c-config\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.025055 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjdl\" (UniqueName: \"kubernetes.io/projected/b1ff5872-e369-4173-9422-74b878a1504c-kube-api-access-9mjdl\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.025254 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025060    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1ff5872-e369-4173-9422-74b878a1504c-trusted-ca\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.025254 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.025254 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025113    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1ff5872-e369-4173-9422-74b878a1504c-serving-cert\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.025254 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025142    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57grm\" (UniqueName: \"kubernetes.io/projected/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-kube-api-access-57grm\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.025429 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025290    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.025795 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025772    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.026057 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025844    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1ff5872-e369-4173-9422-74b878a1504c-config\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.026057 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.025919    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1ff5872-e369-4173-9422-74b878a1504c-trusted-ca\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.027554 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.027532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.027642 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.027624    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1ff5872-e369-4173-9422-74b878a1504c-serving-cert\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.033987 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.033962    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjdl\" (UniqueName: \"kubernetes.io/projected/b1ff5872-e369-4173-9422-74b878a1504c-kube-api-access-9mjdl\") pod \"console-operator-5ccd6b445f-bl74l\" (UID: \"b1ff5872-e369-4173-9422-74b878a1504c\") " pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.034080 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.034026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57grm\" (UniqueName: \"kubernetes.io/projected/5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015-kube-api-access-57grm\") pod \"kube-storage-version-migrator-operator-7878f4b88c-g4mwv\" (UID: \"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.049888 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.049871    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"
Jul 31 01:41:06.060367 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.060345    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"
Jul 31 01:41:06.147675 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.147569    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"
Jul 31 01:41:06.152452 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.152428    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:06.183157 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.182961    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp"]
Jul 31 01:41:06.186242 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:06.186208    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b46c4d2_b18f_4ace_816a_53641ee36f05.slice/crio-c13cbdbc60c9ba916b43ebf92d5c4b992f1dc4b232c5b5a782cbc6af7dd0de2f WatchSource:0}: Error finding container c13cbdbc60c9ba916b43ebf92d5c4b992f1dc4b232c5b5a782cbc6af7dd0de2f: Status 404 returned error can't find the container with id c13cbdbc60c9ba916b43ebf92d5c4b992f1dc4b232c5b5a782cbc6af7dd0de2f
Jul 31 01:41:06.199213 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.199161    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8"]
Jul 31 01:41:06.202456 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:06.202425    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bcb820_995b_4595_998e_da26e7ec0968.slice/crio-612258f4159dc5231f17a5e6074c5af39a7ec55b86c5ab5177d208e6746f2629 WatchSource:0}: Error finding container 612258f4159dc5231f17a5e6074c5af39a7ec55b86c5ab5177d208e6746f2629: Status 404 returned error can't find the container with id 612258f4159dc5231f17a5e6074c5af39a7ec55b86c5ab5177d208e6746f2629
Jul 31 01:41:06.292644 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.292616    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv"]
Jul 31 01:41:06.295870 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:06.295846    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd6b4af_0dd7_4da3_bc63_c9cb34d8a015.slice/crio-30419a7f5d3c6f354cacaa74c81d43b338a6f33945837be8b807583235401feb WatchSource:0}: Error finding container 30419a7f5d3c6f354cacaa74c81d43b338a6f33945837be8b807583235401feb: Status 404 returned error can't find the container with id 30419a7f5d3c6f354cacaa74c81d43b338a6f33945837be8b807583235401feb
Jul 31 01:41:06.306351 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.306329    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-bl74l"]
Jul 31 01:41:06.308730 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:06.308711    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ff5872_e369_4173_9422_74b878a1504c.slice/crio-90a3982d2adbda2cb9f29d0d1339b2e2e482ae740f65261593217caa95cc2911 WatchSource:0}: Error finding container 90a3982d2adbda2cb9f29d0d1339b2e2e482ae740f65261593217caa95cc2911: Status 404 returned error can't find the container with id 90a3982d2adbda2cb9f29d0d1339b2e2e482ae740f65261593217caa95cc2911
Jul 31 01:41:06.428654 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.428626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:06.428810 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:06.428737    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:06.428810 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:06.428801    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls podName:e9029b9d-9235-4a98-8cce-4a2cca4a320a nodeName:}" failed. No retries permitted until 2026-07-31 01:41:07.428786934 +0000 UTC m=+247.065579631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-dhxff" (UID: "e9029b9d-9235-4a98-8cce-4a2cca4a320a") : secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:06.677173 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.677090    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" event={"ID":"b1ff5872-e369-4173-9422-74b878a1504c","Type":"ContainerStarted","Data":"90a3982d2adbda2cb9f29d0d1339b2e2e482ae740f65261593217caa95cc2911"}
Jul 31 01:41:06.678409 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.678380    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8" event={"ID":"93bcb820-995b-4595-998e-da26e7ec0968","Type":"ContainerStarted","Data":"612258f4159dc5231f17a5e6074c5af39a7ec55b86c5ab5177d208e6746f2629"}
Jul 31 01:41:06.679661 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.679634    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv" event={"ID":"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015","Type":"ContainerStarted","Data":"30419a7f5d3c6f354cacaa74c81d43b338a6f33945837be8b807583235401feb"}
Jul 31 01:41:06.681346 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.681321    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp" event={"ID":"6b46c4d2-b18f-4ace-816a-53641ee36f05","Type":"ContainerStarted","Data":"2f2c52ad93acb3d98670642b9958468e5d7bb85741757d5ce8c9cd3a6a2a675e"}
Jul 31 01:41:06.681448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.681368    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp" event={"ID":"6b46c4d2-b18f-4ace-816a-53641ee36f05","Type":"ContainerStarted","Data":"c13cbdbc60c9ba916b43ebf92d5c4b992f1dc4b232c5b5a782cbc6af7dd0de2f"}
Jul 31 01:41:06.696675 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:06.696631    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-wd4qp" podStartSLOduration=1.6966164369999999 podStartE2EDuration="1.696616437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:06.695880964 +0000 UTC m=+246.332673710" watchObservedRunningTime="2026-07-31 01:41:06.696616437 +0000 UTC m=+246.333409157"
Jul 31 01:41:07.437677 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:07.437638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:07.438132 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:07.437821    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:07.438132 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:07.437894    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls podName:e9029b9d-9235-4a98-8cce-4a2cca4a320a nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.437872823 +0000 UTC m=+249.074665536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-dhxff" (UID: "e9029b9d-9235-4a98-8cce-4a2cca4a320a") : secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:09.048454 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.048418    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rxf6q"]
Jul 31 01:41:09.051109 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.051082    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.053622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.053592    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 01:41:09.053879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.053859    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 01:41:09.053879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.053872    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 01:41:09.054879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.054862    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 01:41:09.054997 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.054947    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vl56s\""
Jul 31 01:41:09.063389 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.063366    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxf6q"]
Jul 31 01:41:09.154766 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.154711    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.154766 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.154771    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dknk\" (UniqueName: \"kubernetes.io/projected/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-api-access-7dknk\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.155015 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.154897    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-crio-socket\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.155015 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.154930    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.155095 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.155014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-data-volume\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.255790 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.255758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-data-volume\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.255879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.255840    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.255879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.255860    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dknk\" (UniqueName: \"kubernetes.io/projected/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-api-access-7dknk\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.255948 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.255936    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.256033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.256017    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-data-volume\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.256082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.256048    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-crio-socket\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.256082 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.256065    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.756046607 +0000 UTC m=+249.392839308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.256180 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.256106    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.256180 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.256126    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-crio-socket\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.256239 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.256208    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:09.256271 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.256249    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.756236181 +0000 UTC m=+249.393028879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:09.266527 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.266492    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dknk\" (UniqueName: \"kubernetes.io/projected/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-api-access-7dknk\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.457010 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.456968    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:09.457170 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.457147    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:09.457237 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.457227    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls podName:e9029b9d-9235-4a98-8cce-4a2cca4a320a nodeName:}" failed. No retries permitted until 2026-07-31 01:41:13.457207793 +0000 UTC m=+253.094000496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-dhxff" (UID: "e9029b9d-9235-4a98-8cce-4a2cca4a320a") : secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:09.697910 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.693925    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/0.log"
Jul 31 01:41:09.698054 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.697910    2555 generic.go:356] "Generic (PLEG): container finished" podID="b1ff5872-e369-4173-9422-74b878a1504c" containerID="5615ffe7b8d41981f364a969c8b37d09377f38bbfc76e95642837cf36e5e2be2" exitCode=255
Jul 31 01:41:09.698054 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.697991    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" event={"ID":"b1ff5872-e369-4173-9422-74b878a1504c","Type":"ContainerDied","Data":"5615ffe7b8d41981f364a969c8b37d09377f38bbfc76e95642837cf36e5e2be2"}
Jul 31 01:41:09.698697 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.698677    2555 scope.go:117] "RemoveContainer" containerID="5615ffe7b8d41981f364a969c8b37d09377f38bbfc76e95642837cf36e5e2be2"
Jul 31 01:41:09.702666 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.702642    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8" event={"ID":"93bcb820-995b-4595-998e-da26e7ec0968","Type":"ContainerStarted","Data":"1f07425bcd58970054c2505a4905b1a45f437fb54467dbb037af07f83ec955aa"}
Jul 31 01:41:09.705226 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.705202    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv" event={"ID":"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015","Type":"ContainerStarted","Data":"bee7080fbf5cd79c83751d669decdfa0ce8c6379cc2cb756434a2d6b88d9a0a9"}
Jul 31 01:41:09.727915 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.727878    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv" podStartSLOduration=1.808019667 podStartE2EDuration="4.727864839s" totalImagesPullingTime="2.919845172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:09.727376089 +0000 UTC m=+249.364168810" watchObservedRunningTime="2026-07-31 01:41:09.727864839 +0000 UTC m=+249.364657559"
Jul 31 01:41:09.741061 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.741022    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8" podStartSLOduration=1.733259033 podStartE2EDuration="4.741008202s" totalImagesPullingTime="3.007749169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:09.739721487 +0000 UTC m=+249.376514208" watchObservedRunningTime="2026-07-31 01:41:09.741008202 +0000 UTC m=+249.377800922"
Jul 31 01:41:09.759364 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.759337    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.759552 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:09.759534    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:09.759646 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.759630    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.759704 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.759680    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:10.759663377 +0000 UTC m=+250.396456081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.760494 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.760474    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:09.760597 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:09.760534    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:10.760516889 +0000 UTC m=+250.397309604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:10.113265 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.113229    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"]
Jul 31 01:41:10.115154 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.115134    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"
Jul 31 01:41:10.117721 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.117698    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 31 01:41:10.117857 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.117778    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 31 01:41:10.118190 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.118168    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qj2vd\""
Jul 31 01:41:10.125417 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.125396    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"]
Jul 31 01:41:10.161940 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.161908    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxkdp\" (UniqueName: \"kubernetes.io/projected/28e957c0-c80e-4d68-b7c8-7c466e21d251-kube-api-access-qxkdp\") pod \"migrator-68bc745d87-q9gc2\" (UID: \"28e957c0-c80e-4d68-b7c8-7c466e21d251\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"
Jul 31 01:41:10.262366 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.262332    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxkdp\" (UniqueName: \"kubernetes.io/projected/28e957c0-c80e-4d68-b7c8-7c466e21d251-kube-api-access-qxkdp\") pod \"migrator-68bc745d87-q9gc2\" (UID: \"28e957c0-c80e-4d68-b7c8-7c466e21d251\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"
Jul 31 01:41:10.270358 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.270324    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxkdp\" (UniqueName: \"kubernetes.io/projected/28e957c0-c80e-4d68-b7c8-7c466e21d251-kube-api-access-qxkdp\") pod \"migrator-68bc745d87-q9gc2\" (UID: \"28e957c0-c80e-4d68-b7c8-7c466e21d251\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"
Jul 31 01:41:10.423832 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.423736    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"
Jul 31 01:41:10.540959 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.540931    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2"]
Jul 31 01:41:10.543976 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:10.543953    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e957c0_c80e_4d68_b7c8_7c466e21d251.slice/crio-62111f33e484476ddb3b1d3b151b5373ebb6011d748bf77ee944579531fdfd49 WatchSource:0}: Error finding container 62111f33e484476ddb3b1d3b151b5373ebb6011d748bf77ee944579531fdfd49: Status 404 returned error can't find the container with id 62111f33e484476ddb3b1d3b151b5373ebb6011d748bf77ee944579531fdfd49
Jul 31 01:41:10.709270 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.709195    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:41:10.709603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.709588    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/0.log"
Jul 31 01:41:10.709649 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.709622    2555 generic.go:356] "Generic (PLEG): container finished" podID="b1ff5872-e369-4173-9422-74b878a1504c" containerID="c9c23a4cb71d0fcd5df0e779ebc57b38c8d14559dd7c78ce9190c2319d417ee4" exitCode=255
Jul 31 01:41:10.709705 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.709691    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" event={"ID":"b1ff5872-e369-4173-9422-74b878a1504c","Type":"ContainerDied","Data":"c9c23a4cb71d0fcd5df0e779ebc57b38c8d14559dd7c78ce9190c2319d417ee4"}
Jul 31 01:41:10.709778 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.709735    2555 scope.go:117] "RemoveContainer" containerID="5615ffe7b8d41981f364a969c8b37d09377f38bbfc76e95642837cf36e5e2be2"
Jul 31 01:41:10.709993 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.709975    2555 scope.go:117] "RemoveContainer" containerID="c9c23a4cb71d0fcd5df0e779ebc57b38c8d14559dd7c78ce9190c2319d417ee4"
Jul 31 01:41:10.710165 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:10.710145    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-bl74l_openshift-console-operator(b1ff5872-e369-4173-9422-74b878a1504c)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" podUID="b1ff5872-e369-4173-9422-74b878a1504c"
Jul 31 01:41:10.710960 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.710937    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2" event={"ID":"28e957c0-c80e-4d68-b7c8-7c466e21d251","Type":"ContainerStarted","Data":"62111f33e484476ddb3b1d3b151b5373ebb6011d748bf77ee944579531fdfd49"}
Jul 31 01:41:10.766814 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.766775    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:10.767015 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:10.766865    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:10.767015 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:10.766941    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:12.7669206 +0000 UTC m=+252.403713300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:10.767015 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.766983    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:10.767390 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:10.767350    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:10.767467 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:10.767434    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:12.767412894 +0000 UTC m=+252.404205598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:10.814501 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:10.814475    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gshz6_a9ea1983-2c83-4f97-8fe4-acffae008bad/dns-node-resolver/0.log"
Jul 31 01:41:11.720829 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:11.720805    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:41:11.721127 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:11.721106    2555 scope.go:117] "RemoveContainer" containerID="c9c23a4cb71d0fcd5df0e779ebc57b38c8d14559dd7c78ce9190c2319d417ee4"
Jul 31 01:41:11.721277 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:11.721255    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-bl74l_openshift-console-operator(b1ff5872-e369-4173-9422-74b878a1504c)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" podUID="b1ff5872-e369-4173-9422-74b878a1504c"
Jul 31 01:41:12.212462 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.212434    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p4ww7_65faecef-fc92-4664-9cd9-2a331197b8da/node-ca/0.log"
Jul 31 01:41:12.683556 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.683519    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:41:12.683726 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:12.683668    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 01:41:12.683791 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:12.683730    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs podName:b36f04bc-b95a-4360-a452-3bc6bfd8e4c1 nodeName:}" failed. No retries permitted until 2026-07-31 01:43:14.6837113 +0000 UTC m=+374.320503998 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs") pod "network-metrics-daemon-vb8p5" (UID: "b36f04bc-b95a-4360-a452-3bc6bfd8e4c1") : secret "metrics-daemon-secret" not found
Jul 31 01:41:12.725603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.725572    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2" event={"ID":"28e957c0-c80e-4d68-b7c8-7c466e21d251","Type":"ContainerStarted","Data":"729f5a5ca84485baee734a9c0fcc5eda3126bf3a1968efbc11881450783f9bbe"}
Jul 31 01:41:12.726046 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.725620    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2" event={"ID":"28e957c0-c80e-4d68-b7c8-7c466e21d251","Type":"ContainerStarted","Data":"8fe1b271bb3be1a24ce39578b3246644457a3498d9f0c6fbc4cf9010498cc078"}
Jul 31 01:41:12.740409 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.740365    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-q9gc2" podStartSLOduration=1.622174496 podStartE2EDuration="2.740351787s" totalImagesPullingTime="1.118177291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:12.739090606 +0000 UTC m=+252.375883326" watchObservedRunningTime="2026-07-31 01:41:12.740351787 +0000 UTC m=+252.377144507"
Jul 31 01:41:12.784225 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.784199    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:12.784332 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.784275    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:12.784332 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:12.784309    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:12.784424 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:12.784370    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:16.784353168 +0000 UTC m=+256.421145868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:12.784424 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:12.784404    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:12.784506 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:12.784442    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:16.784430046 +0000 UTC m=+256.421222749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:12.811994 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.811974    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qd64g_843a29e7-e3bf-40fb-8e81-ca8a7c64bc10/serve-healthcheck-canary/0.log"
Jul 31 01:41:12.849091 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.849067    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-d5x5v"]
Jul 31 01:41:12.850914 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.850892    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.853298 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.853282    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 31 01:41:12.853298 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.853293    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 31 01:41:12.853460 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.853282    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nnj4w\""
Jul 31 01:41:12.853460 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.853328    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 31 01:41:12.853460 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.853341    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 31 01:41:12.858592 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.858571    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-d5x5v"]
Jul 31 01:41:12.885336 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.885311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2bad34bb-5362-47e3-8be4-e49dae4dcec9-signing-key\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.885423 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.885345    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2bad34bb-5362-47e3-8be4-e49dae4dcec9-signing-cabundle\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.885423 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.885415    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvwl\" (UniqueName: \"kubernetes.io/projected/2bad34bb-5362-47e3-8be4-e49dae4dcec9-kube-api-access-zvvwl\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.986261 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.986188    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2bad34bb-5362-47e3-8be4-e49dae4dcec9-signing-key\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.986261 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.986227    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2bad34bb-5362-47e3-8be4-e49dae4dcec9-signing-cabundle\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.986450 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.986404    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvwl\" (UniqueName: \"kubernetes.io/projected/2bad34bb-5362-47e3-8be4-e49dae4dcec9-kube-api-access-zvvwl\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.986767 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.986734    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2bad34bb-5362-47e3-8be4-e49dae4dcec9-signing-cabundle\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.988732 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.988715    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2bad34bb-5362-47e3-8be4-e49dae4dcec9-signing-key\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:12.994670 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:12.994648    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvwl\" (UniqueName: \"kubernetes.io/projected/2bad34bb-5362-47e3-8be4-e49dae4dcec9-kube-api-access-zvvwl\") pod \"service-ca-98c88fbb5-d5x5v\" (UID: \"2bad34bb-5362-47e3-8be4-e49dae4dcec9\") " pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:13.159835 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:13.159805    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v"
Jul 31 01:41:13.279927 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:13.279850    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-d5x5v"]
Jul 31 01:41:13.283538 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:13.283509    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bad34bb_5362_47e3_8be4_e49dae4dcec9.slice/crio-b639aba272f242ca111c7c4f8a5a77074049c9348f7afd7b606c660572504d01 WatchSource:0}: Error finding container b639aba272f242ca111c7c4f8a5a77074049c9348f7afd7b606c660572504d01: Status 404 returned error can't find the container with id b639aba272f242ca111c7c4f8a5a77074049c9348f7afd7b606c660572504d01
Jul 31 01:41:13.491649 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:13.491612    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:13.491827 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:13.491778    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:13.491874 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:13.491842    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls podName:e9029b9d-9235-4a98-8cce-4a2cca4a320a nodeName:}" failed. No retries permitted until 2026-07-31 01:41:21.491827704 +0000 UTC m=+261.128620402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-dhxff" (UID: "e9029b9d-9235-4a98-8cce-4a2cca4a320a") : secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:13.729595 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:13.729560    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v" event={"ID":"2bad34bb-5362-47e3-8be4-e49dae4dcec9","Type":"ContainerStarted","Data":"1b17366e7616dc98e61be273d54ccdc5c33a3c9e0cef891c865eb2eeeb6128b3"}
Jul 31 01:41:13.730000 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:13.729615    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v" event={"ID":"2bad34bb-5362-47e3-8be4-e49dae4dcec9","Type":"ContainerStarted","Data":"b639aba272f242ca111c7c4f8a5a77074049c9348f7afd7b606c660572504d01"}
Jul 31 01:41:13.748670 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:13.748609    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-d5x5v" podStartSLOduration=1.748591711 podStartE2EDuration="1.748591711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:13.748138595 +0000 UTC m=+253.384931337" watchObservedRunningTime="2026-07-31 01:41:13.748591711 +0000 UTC m=+253.385384433"
Jul 31 01:41:16.152645 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:16.152612    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:16.153033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:16.152658    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:16.153033 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:16.152998    2555 scope.go:117] "RemoveContainer" containerID="c9c23a4cb71d0fcd5df0e779ebc57b38c8d14559dd7c78ce9190c2319d417ee4"
Jul 31 01:41:16.153149 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:16.153131    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-bl74l_openshift-console-operator(b1ff5872-e369-4173-9422-74b878a1504c)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" podUID="b1ff5872-e369-4173-9422-74b878a1504c"
Jul 31 01:41:16.817989 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:16.817952    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:16.818181 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:16.818023    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:16.818181 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:16.818084    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:16.818181 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:16.818125    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:16.818181 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:16.818159    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:24.81813956 +0000 UTC m=+264.454932279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:16.818181 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:16.818176    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:24.818168453 +0000 UTC m=+264.454961150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:21.554523 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:21.554492    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:21.554926 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:21.554609    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:21.554926 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:21.554663    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls podName:e9029b9d-9235-4a98-8cce-4a2cca4a320a nodeName:}" failed. No retries permitted until 2026-07-31 01:41:37.554649585 +0000 UTC m=+277.191442283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-dhxff" (UID: "e9029b9d-9235-4a98-8cce-4a2cca4a320a") : secret "cluster-monitoring-operator-tls" not found
Jul 31 01:41:24.884312 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:24.884229    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:24.884648 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:24.884314    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:24.884648 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:24.884380    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:24.884648 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:24.884448    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls podName:5b9ab97d-f1bd-4980-a6a6-c5456365bc54 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:40.884432682 +0000 UTC m=+280.521225380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxf6q" (UID: "5b9ab97d-f1bd-4980-a6a6-c5456365bc54") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:24.884844 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:24.884827    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:26.920010 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:26.919980    2555 scope.go:117] "RemoveContainer" containerID="c9c23a4cb71d0fcd5df0e779ebc57b38c8d14559dd7c78ce9190c2319d417ee4"
Jul 31 01:41:27.774287 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:27.774259    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:41:27.774524 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:27.774340    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" event={"ID":"b1ff5872-e369-4173-9422-74b878a1504c","Type":"ContainerStarted","Data":"2c3a9a0d0d185727bb99504a15697a3e2bda3d6758c0a929af71b50b3096d008"}
Jul 31 01:41:27.774622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:27.774606    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:27.791014 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:27.790969    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l" podStartSLOduration=19.882944124 podStartE2EDuration="22.79095587s" totalImagesPullingTime="2.908011746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:27.790144042 +0000 UTC m=+267.426936761" watchObservedRunningTime="2026-07-31 01:41:27.79095587 +0000 UTC m=+267.427748589"
Jul 31 01:41:27.885277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:27.885251    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-bl74l"
Jul 31 01:41:36.972861 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.972828    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c7b5bb757-zvtss"]
Jul 31 01:41:36.974679 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.974660    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:36.978164 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978143    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 01:41:36.978326 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978143    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 01:41:36.978326 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978200    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6fdc\""
Jul 31 01:41:36.978485 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978200    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 01:41:36.978485 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978210    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 01:41:36.978485 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978228    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 01:41:36.978485 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978235    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 01:41:36.978485 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.978278    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 01:41:36.984951 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:36.984931    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7b5bb757-zvtss"]
Jul 31 01:41:37.077186 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.077157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-oauth-config\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.077319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.077195    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-config\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.077319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.077224    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-serving-cert\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.077319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.077244    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-oauth-serving-cert\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.077319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.077280    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-service-ca\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.077319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.077316    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7nnm\" (UniqueName: \"kubernetes.io/projected/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-kube-api-access-b7nnm\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.178630 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.178587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-config\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.178630 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.178643    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-serving-cert\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.178893 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.178664    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-oauth-serving-cert\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.178893 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.178705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-service-ca\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.178893 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.178729    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7nnm\" (UniqueName: \"kubernetes.io/projected/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-kube-api-access-b7nnm\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.179051 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.178903    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-oauth-config\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.179368 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.179347    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-config\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.179459 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.179441    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-service-ca\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.179654 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.179636    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-oauth-serving-cert\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.181281 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.181263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-oauth-config\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.181361 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.181280    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-serving-cert\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.186790 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.186767    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7nnm\" (UniqueName: \"kubernetes.io/projected/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-kube-api-access-b7nnm\") pod \"console-6c7b5bb757-zvtss\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") " pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.283826 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.283739    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:37.406805 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.406779    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7b5bb757-zvtss"]
Jul 31 01:41:37.409596 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:37.409569    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf52b9dd_3e6a_4fa9_85bf_f07b716530c6.slice/crio-46f54be92eec0e94c6503e3bf5915ec6310f31f5bbd5967078b9d7a4ed08ab99 WatchSource:0}: Error finding container 46f54be92eec0e94c6503e3bf5915ec6310f31f5bbd5967078b9d7a4ed08ab99: Status 404 returned error can't find the container with id 46f54be92eec0e94c6503e3bf5915ec6310f31f5bbd5967078b9d7a4ed08ab99
Jul 31 01:41:37.581666 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.581641    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:37.584072 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.584055    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9029b9d-9235-4a98-8cce-4a2cca4a320a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-dhxff\" (UID: \"e9029b9d-9235-4a98-8cce-4a2cca4a320a\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:37.805332 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.805299    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7b5bb757-zvtss" event={"ID":"df52b9dd-3e6a-4fa9-85bf-f07b716530c6","Type":"ContainerStarted","Data":"46f54be92eec0e94c6503e3bf5915ec6310f31f5bbd5967078b9d7a4ed08ab99"}
Jul 31 01:41:37.855445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.855390    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"
Jul 31 01:41:37.974241 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:37.974183    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff"]
Jul 31 01:41:37.976126 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:37.976095    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9029b9d_9235_4a98_8cce_4a2cca4a320a.slice/crio-54fb9888cffa74b16b2f9527317c34a59cb3f455386c5e11cbf749d1adf9cefb WatchSource:0}: Error finding container 54fb9888cffa74b16b2f9527317c34a59cb3f455386c5e11cbf749d1adf9cefb: Status 404 returned error can't find the container with id 54fb9888cffa74b16b2f9527317c34a59cb3f455386c5e11cbf749d1adf9cefb
Jul 31 01:41:38.810924 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:38.810889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff" event={"ID":"e9029b9d-9235-4a98-8cce-4a2cca4a320a","Type":"ContainerStarted","Data":"54fb9888cffa74b16b2f9527317c34a59cb3f455386c5e11cbf749d1adf9cefb"}
Jul 31 01:41:38.967536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:38.967501    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-676ffd589f-n9hx5"]
Jul 31 01:41:38.971208 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:38.971047    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:38.979738 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:38.979709    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 01:41:38.982064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:38.982014    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676ffd589f-n9hx5"]
Jul 31 01:41:39.095811 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.095713    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-trusted-ca-bundle\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.095811 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.095791    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-serving-cert\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.096026 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.095834    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-config\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.096026 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.095920    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-oauth-serving-cert\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.096139 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.096034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-oauth-config\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.096139 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.096077    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxjbl\" (UniqueName: \"kubernetes.io/projected/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-kube-api-access-pxjbl\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.096139 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.096107    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-service-ca\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197310 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197236    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-trusted-ca-bundle\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197310 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197288    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-serving-cert\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197553 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197346    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-config\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197553 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-oauth-serving-cert\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197553 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-oauth-config\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197553 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxjbl\" (UniqueName: \"kubernetes.io/projected/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-kube-api-access-pxjbl\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.197553 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.197518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-service-ca\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.198185 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.198139    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-config\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.198304 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.198198    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-service-ca\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.198304 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.198238    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-trusted-ca-bundle\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.198783 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.198719    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-oauth-serving-cert\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.200798 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.200774    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-serving-cert\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.201396 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.201351    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-oauth-config\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.206185 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.206161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxjbl\" (UniqueName: \"kubernetes.io/projected/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-kube-api-access-pxjbl\") pod \"console-676ffd589f-n9hx5\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") " pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:39.284495 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:39.284460    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:40.911265 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:40.911153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:40.914401 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:40.914163    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b9ab97d-f1bd-4980-a6a6-c5456365bc54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxf6q\" (UID: \"5b9ab97d-f1bd-4980-a6a6-c5456365bc54\") " pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:40.952465 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:40.952435    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676ffd589f-n9hx5"]
Jul 31 01:41:40.955875 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:40.955838    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbcf2c3d_abaa_44f2_aa79_13c2ac98e3ce.slice/crio-d96a2428420e0aa96e04c3461f6028952dbf85ebfc1b5a328561110854ad3cae WatchSource:0}: Error finding container d96a2428420e0aa96e04c3461f6028952dbf85ebfc1b5a328561110854ad3cae: Status 404 returned error can't find the container with id d96a2428420e0aa96e04c3461f6028952dbf85ebfc1b5a328561110854ad3cae
Jul 31 01:41:41.161817 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.161726    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxf6q"
Jul 31 01:41:41.326147 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.326123    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxf6q"]
Jul 31 01:41:41.328832 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:41.328796    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9ab97d_f1bd_4980_a6a6_c5456365bc54.slice/crio-28f367e2ce9a28fa1add5531e6d557c47ce36721e8bff49ef97b8cf7a9b4fc0b WatchSource:0}: Error finding container 28f367e2ce9a28fa1add5531e6d557c47ce36721e8bff49ef97b8cf7a9b4fc0b: Status 404 returned error can't find the container with id 28f367e2ce9a28fa1add5531e6d557c47ce36721e8bff49ef97b8cf7a9b4fc0b
Jul 31 01:41:41.823883 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.823822    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxf6q" event={"ID":"5b9ab97d-f1bd-4980-a6a6-c5456365bc54","Type":"ContainerStarted","Data":"b759e80d8e99b929bb2c11178b03b9cad09c06158e4bf374efcc2e3492d351ed"}
Jul 31 01:41:41.824064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.823899    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxf6q" event={"ID":"5b9ab97d-f1bd-4980-a6a6-c5456365bc54","Type":"ContainerStarted","Data":"28f367e2ce9a28fa1add5531e6d557c47ce36721e8bff49ef97b8cf7a9b4fc0b"}
Jul 31 01:41:41.825639 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.825592    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676ffd589f-n9hx5" event={"ID":"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce","Type":"ContainerStarted","Data":"5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f"}
Jul 31 01:41:41.825761 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.825653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676ffd589f-n9hx5" event={"ID":"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce","Type":"ContainerStarted","Data":"d96a2428420e0aa96e04c3461f6028952dbf85ebfc1b5a328561110854ad3cae"}
Jul 31 01:41:41.827180 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.827149    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff" event={"ID":"e9029b9d-9235-4a98-8cce-4a2cca4a320a","Type":"ContainerStarted","Data":"d370a86b8a5c51a2b731f52327613b06983788fc330f9753b8996ead3b199725"}
Jul 31 01:41:41.828590 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.828568    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7b5bb757-zvtss" event={"ID":"df52b9dd-3e6a-4fa9-85bf-f07b716530c6","Type":"ContainerStarted","Data":"0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41"}
Jul 31 01:41:41.842804 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.842768    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-676ffd589f-n9hx5" podStartSLOduration=3.842732931 podStartE2EDuration="3.842732931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:41.841463013 +0000 UTC m=+281.478255755" watchObservedRunningTime="2026-07-31 01:41:41.842732931 +0000 UTC m=+281.479525650"
Jul 31 01:41:41.873665 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.873621    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c7b5bb757-zvtss" podStartSLOduration=2.464130185 podStartE2EDuration="5.873607648s" totalImagesPullingTime="3.409477463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:41.873146027 +0000 UTC m=+281.509938746" watchObservedRunningTime="2026-07-31 01:41:41.873607648 +0000 UTC m=+281.510400346"
Jul 31 01:41:41.874354 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:41.874325    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-dhxff" podStartSLOduration=34.037527859 podStartE2EDuration="36.874316683s" totalImagesPullingTime="2.836788824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:41.855267441 +0000 UTC m=+281.492060164" watchObservedRunningTime="2026-07-31 01:41:41.874316683 +0000 UTC m=+281.511109404"
Jul 31 01:41:42.477005 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:42.476957    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9427d" podUID="fa135198-565e-4fd8-914a-218340ba89b4"
Jul 31 01:41:42.477005 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:42.476983    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5"
Jul 31 01:41:42.477005 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:42.476957    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g" podUID="a274a59c-e2a0-473f-bfdb-a11dd656ce11"
Jul 31 01:41:42.833276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:42.833234    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:41:42.833276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:42.833246    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxf6q" event={"ID":"5b9ab97d-f1bd-4980-a6a6-c5456365bc54","Type":"ContainerStarted","Data":"a55a1f802ddd939dd210c3ad472d44fcc57b86c8679faddacd406f2537dc6c94"}
Jul 31 01:41:42.833491 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:42.833475    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:41:42.833599 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:42.833585    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9427d"
Jul 31 01:41:43.838295 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:43.838264    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxf6q" event={"ID":"5b9ab97d-f1bd-4980-a6a6-c5456365bc54","Type":"ContainerStarted","Data":"fa7130965fd2dd4825be77ab72596ca8ec29a78af831c8571337718cd92103cc"}
Jul 31 01:41:43.855649 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:43.855601    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rxf6q" podStartSLOduration=32.774512521 podStartE2EDuration="34.855588627s" totalImagesPullingTime="2.081076106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:41:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:43.855249252 +0000 UTC m=+283.492041973" watchObservedRunningTime="2026-07-31 01:41:43.855588627 +0000 UTC m=+283.492381348"
Jul 31 01:41:45.752786 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.752707    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:41:45.753132 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.752807    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:41:45.753132 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.752846    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:41:45.755255 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.755229    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa135198-565e-4fd8-914a-218340ba89b4-metrics-tls\") pod \"dns-default-9427d\" (UID: \"fa135198-565e-4fd8-914a-218340ba89b4\") " pod="openshift-dns/dns-default-9427d"
Jul 31 01:41:45.755381 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.755266    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a274a59c-e2a0-473f-bfdb-a11dd656ce11-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-75p5g\" (UID: \"a274a59c-e2a0-473f-bfdb-a11dd656ce11\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:41:45.755381 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.755362    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"image-registry-79bfc6d44f-8mv5f\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") " pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:41:45.838082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.838053    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gmnxq\""
Jul 31 01:41:45.838224 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.838099    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5txjm\""
Jul 31 01:41:45.838224 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.838066    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6prlk\""
Jul 31 01:41:45.844765 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.844721    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"
Jul 31 01:41:45.844898 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.844769    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:41:45.844898 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.844822    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9427d"
Jul 31 01:41:45.999150 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:45.999123    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79bfc6d44f-8mv5f"]
Jul 31 01:41:46.003436 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:46.003376    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa52142_daac_4f27_8a4b_3a386aae2eb5.slice/crio-316152e2dcfae12275a87168e24e4c53310a3ebed75e512967d89987a21be84c WatchSource:0}: Error finding container 316152e2dcfae12275a87168e24e4c53310a3ebed75e512967d89987a21be84c: Status 404 returned error can't find the container with id 316152e2dcfae12275a87168e24e4c53310a3ebed75e512967d89987a21be84c
Jul 31 01:41:46.013716 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.013694    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9427d"]
Jul 31 01:41:46.017110 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:46.017084    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa135198_565e_4fd8_914a_218340ba89b4.slice/crio-eb3d028b33b134463b4e36c5d42a3dccd63c6b29aab0413b6d6814f1c0cac36d WatchSource:0}: Error finding container eb3d028b33b134463b4e36c5d42a3dccd63c6b29aab0413b6d6814f1c0cac36d: Status 404 returned error can't find the container with id eb3d028b33b134463b4e36c5d42a3dccd63c6b29aab0413b6d6814f1c0cac36d
Jul 31 01:41:46.032448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.032423    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-75p5g"]
Jul 31 01:41:46.038795 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:46.038771    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda274a59c_e2a0_473f_bfdb_a11dd656ce11.slice/crio-53584196def3e08c9e54380f36dd5507e12424f36cd2dd3e6f52dc5f25e922f0 WatchSource:0}: Error finding container 53584196def3e08c9e54380f36dd5507e12424f36cd2dd3e6f52dc5f25e922f0: Status 404 returned error can't find the container with id 53584196def3e08c9e54380f36dd5507e12424f36cd2dd3e6f52dc5f25e922f0
Jul 31 01:41:46.850899 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.850863    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9427d" event={"ID":"fa135198-565e-4fd8-914a-218340ba89b4","Type":"ContainerStarted","Data":"eb3d028b33b134463b4e36c5d42a3dccd63c6b29aab0413b6d6814f1c0cac36d"}
Jul 31 01:41:46.853490 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.852994    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" event={"ID":"5fa52142-daac-4f27-8a4b-3a386aae2eb5","Type":"ContainerStarted","Data":"af757fc6a0546c01f2a9c417fdc0d8f62b85e27f05f4426b293d202ade37777c"}
Jul 31 01:41:46.853490 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.853042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" event={"ID":"5fa52142-daac-4f27-8a4b-3a386aae2eb5","Type":"ContainerStarted","Data":"316152e2dcfae12275a87168e24e4c53310a3ebed75e512967d89987a21be84c"}
Jul 31 01:41:46.853490 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.853174    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:41:46.854568 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.854537    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g" event={"ID":"a274a59c-e2a0-473f-bfdb-a11dd656ce11","Type":"ContainerStarted","Data":"53584196def3e08c9e54380f36dd5507e12424f36cd2dd3e6f52dc5f25e922f0"}
Jul 31 01:41:46.873875 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:46.873822    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" podStartSLOduration=285.873802138 podStartE2EDuration="4m45.873802138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:46.872123884 +0000 UTC m=+286.508916624" watchObservedRunningTime="2026-07-31 01:41:46.873802138 +0000 UTC m=+286.510594859"
Jul 31 01:41:47.284235 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.284202    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:47.284366 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.284266    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:41:47.285850 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.285813    2555 patch_prober.go:28] interesting pod/console-6c7b5bb757-zvtss container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 31 01:41:47.285954 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.285868    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c7b5bb757-zvtss" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 31 01:41:47.859791 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.859738    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9427d" event={"ID":"fa135198-565e-4fd8-914a-218340ba89b4","Type":"ContainerStarted","Data":"e94bbdd0ee20301a80ed9d8d74902845d253d9a37d08c125f470dde6b47cc3e6"}
Jul 31 01:41:47.861218 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.861196    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g" event={"ID":"a274a59c-e2a0-473f-bfdb-a11dd656ce11","Type":"ContainerStarted","Data":"b5d9f6fc61bdf9306b1a64130bbc91528e0e9d5ca80adeaaba021b9169bb7452"}
Jul 31 01:41:47.880165 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:47.880068    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-75p5g" podStartSLOduration=278.6796883 podStartE2EDuration="4m39.880050974s" totalImagesPullingTime="1.200362674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:47.878419708 +0000 UTC m=+287.515212429" watchObservedRunningTime="2026-07-31 01:41:47.880050974 +0000 UTC m=+287.516843694"
Jul 31 01:41:48.868174 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:48.868133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9427d" event={"ID":"fa135198-565e-4fd8-914a-218340ba89b4","Type":"ContainerStarted","Data":"e63b503353703d179b91daf8786e7ba6b68c5bfce2c42aa431ae2fae136a560f"}
Jul 31 01:41:48.885847 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:48.885805    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9427d" podStartSLOduration=252.131458056 podStartE2EDuration="4m13.885790934s" totalImagesPullingTime="1.754332878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:48.884682864 +0000 UTC m=+288.521475583" watchObservedRunningTime="2026-07-31 01:41:48.885790934 +0000 UTC m=+288.522583653"
Jul 31 01:41:49.285639 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:49.285550    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:49.285639 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:49.285609    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:41:49.286978 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:49.286955    2555 patch_prober.go:28] interesting pod/console-676ffd589f-n9hx5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
Jul 31 01:41:49.287091 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:49.286998    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-676ffd589f-n9hx5" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused"
Jul 31 01:41:49.872003 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:49.871970    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9427d"
Jul 31 01:41:52.398608 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.398579    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5gz78"]
Jul 31 01:41:52.401252 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.401233    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.401878 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.401852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jsv7\" (UniqueName: \"kubernetes.io/projected/a57dd607-f188-4005-8b8e-37a4f286eb6c-kube-api-access-2jsv7\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.401977 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.401903    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a57dd607-f188-4005-8b8e-37a4f286eb6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.401977 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.401946    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a57dd607-f188-4005-8b8e-37a4f286eb6c-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.402075 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.401992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57dd607-f188-4005-8b8e-37a4f286eb6c-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.403905 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.403883    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 31 01:41:52.404884 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.404862    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wpb2v\""
Jul 31 01:41:52.404972 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.404883    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 31 01:41:52.404972 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.404862    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 01:41:52.410795 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.410776    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5gz78"]
Jul 31 01:41:52.503229 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.503201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57dd607-f188-4005-8b8e-37a4f286eb6c-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.503393 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.503259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jsv7\" (UniqueName: \"kubernetes.io/projected/a57dd607-f188-4005-8b8e-37a4f286eb6c-kube-api-access-2jsv7\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.503393 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.503291    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a57dd607-f188-4005-8b8e-37a4f286eb6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.503393 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.503311    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a57dd607-f188-4005-8b8e-37a4f286eb6c-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.503937 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.503911    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a57dd607-f188-4005-8b8e-37a4f286eb6c-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.505614 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.505588    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a57dd607-f188-4005-8b8e-37a4f286eb6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.505694 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.505670    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57dd607-f188-4005-8b8e-37a4f286eb6c-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.511095 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.511071    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jsv7\" (UniqueName: \"kubernetes.io/projected/a57dd607-f188-4005-8b8e-37a4f286eb6c-kube-api-access-2jsv7\") pod \"prometheus-operator-758d7cb874-5gz78\" (UID: \"a57dd607-f188-4005-8b8e-37a4f286eb6c\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.711077 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.710990    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78"
Jul 31 01:41:52.832549 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.832526    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5gz78"]
Jul 31 01:41:52.835006 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:52.834982    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57dd607_f188_4005_8b8e_37a4f286eb6c.slice/crio-294135642b8a5744fce901ec38aabe696819496801d3212132d4064d4b88618d WatchSource:0}: Error finding container 294135642b8a5744fce901ec38aabe696819496801d3212132d4064d4b88618d: Status 404 returned error can't find the container with id 294135642b8a5744fce901ec38aabe696819496801d3212132d4064d4b88618d
Jul 31 01:41:52.882275 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:52.882241    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78" event={"ID":"a57dd607-f188-4005-8b8e-37a4f286eb6c","Type":"ContainerStarted","Data":"294135642b8a5744fce901ec38aabe696819496801d3212132d4064d4b88618d"}
Jul 31 01:41:53.922327 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:53.922285    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vb8p5" podUID="b36f04bc-b95a-4360-a452-3bc6bfd8e4c1"
Jul 31 01:41:54.890625 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:54.890586    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78" event={"ID":"a57dd607-f188-4005-8b8e-37a4f286eb6c","Type":"ContainerStarted","Data":"1d48b3316c61407345f52b8fcc5b248dbd410138ca529234f33e12c6cda00367"}
Jul 31 01:41:54.890833 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:54.890684    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78" event={"ID":"a57dd607-f188-4005-8b8e-37a4f286eb6c","Type":"ContainerStarted","Data":"870105e24bfa483bc19aae5fc919c5e6d79ca12dd9f4fff1db94afea79f09f61"}
Jul 31 01:41:54.906166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:54.906120    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-5gz78" podStartSLOduration=1.718126921 podStartE2EDuration="2.906106627s" totalImagesPullingTime="1.187979706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:54.905588362 +0000 UTC m=+294.542381101" watchObservedRunningTime="2026-07-31 01:41:54.906106627 +0000 UTC m=+294.542899394"
Jul 31 01:41:56.741865 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.741828    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"]
Jul 31 01:41:56.745683 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.745660    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.748330 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.748305    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 31 01:41:56.748441 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.748306    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 31 01:41:56.748657 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.748643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7l8nz\""
Jul 31 01:41:56.756588 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.756563    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"]
Jul 31 01:41:56.770549 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.770531    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7gqcg"]
Jul 31 01:41:56.773795 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.773774    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.776261 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.776195    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 01:41:56.776367 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.776278    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 01:41:56.776367 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.776325    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 01:41:56.776570 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.776543    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-94jhd\""
Jul 31 01:41:56.834912 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.834886    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-root\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835066 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.834919    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-wtmp\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835066 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.834961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h79g\" (UniqueName: \"kubernetes.io/projected/b5cbbbe8-f675-41ec-b5d9-ce4833212530-kube-api-access-4h79g\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835066 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835039    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3f9f362-9db0-43b9-8408-0ecad8907a4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.835199 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835077    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835199 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835108    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmtmh\" (UniqueName: \"kubernetes.io/projected/c3f9f362-9db0-43b9-8408-0ecad8907a4b-kube-api-access-fmtmh\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.835199 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-textfile\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835199 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835170    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835199 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835187    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f9f362-9db0-43b9-8408-0ecad8907a4b-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.835376 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835222    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5cbbbe8-f675-41ec-b5d9-ce4833212530-metrics-client-ca\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835376 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835268    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-sys\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835376 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835289    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-tls\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.835376 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.835327    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f9f362-9db0-43b9-8408-0ecad8907a4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.936296 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936260    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-wtmp\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936296 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936296    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h79g\" (UniqueName: \"kubernetes.io/projected/b5cbbbe8-f675-41ec-b5d9-ce4833212530-kube-api-access-4h79g\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936314    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3f9f362-9db0-43b9-8408-0ecad8907a4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.936532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936368    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmtmh\" (UniqueName: \"kubernetes.io/projected/c3f9f362-9db0-43b9-8408-0ecad8907a4b-kube-api-access-fmtmh\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.936532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-textfile\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936849 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936790    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936849 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936820    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f9f362-9db0-43b9-8408-0ecad8907a4b-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.936849 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936816    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-textfile\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936998 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936852    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5cbbbe8-f675-41ec-b5d9-ce4833212530-metrics-client-ca\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936998 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936919    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-sys\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936998 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936941    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-tls\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.936998 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936978    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f9f362-9db0-43b9-8408-0ecad8907a4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.937191 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936995    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.937191 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.937058    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-root\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.937191 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.937136    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-root\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.937191 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.937178    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-sys\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.937384 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.936450    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-wtmp\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.937384 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:56.937322    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 01:41:56.937488 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:41:56.937385    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-tls podName:b5cbbbe8-f675-41ec-b5d9-ce4833212530 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:57.437366653 +0000 UTC m=+297.074159380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-tls") pod "node-exporter-7gqcg" (UID: "b5cbbbe8-f675-41ec-b5d9-ce4833212530") : secret "node-exporter-tls" not found
Jul 31 01:41:56.937705 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.937680    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3f9f362-9db0-43b9-8408-0ecad8907a4b-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.937853 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.937833    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5cbbbe8-f675-41ec-b5d9-ce4833212530-metrics-client-ca\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.939500 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.939464    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3f9f362-9db0-43b9-8408-0ecad8907a4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.939681 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.939643    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3f9f362-9db0-43b9-8408-0ecad8907a4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:56.939871 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.939851    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.944189 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.944166    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h79g\" (UniqueName: \"kubernetes.io/projected/b5cbbbe8-f675-41ec-b5d9-ce4833212530-kube-api-access-4h79g\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:56.944803 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:56.944733    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmtmh\" (UniqueName: \"kubernetes.io/projected/c3f9f362-9db0-43b9-8408-0ecad8907a4b-kube-api-access-fmtmh\") pod \"openshift-state-metrics-6bb4d7b4dd-vfvx4\" (UID: \"c3f9f362-9db0-43b9-8408-0ecad8907a4b\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:57.056649 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.056612    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"
Jul 31 01:41:57.204537 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.204509    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4"]
Jul 31 01:41:57.208077 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:57.208050    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f9f362_9db0_43b9_8408_0ecad8907a4b.slice/crio-d92e0e7d75e9e0b63259b15330462f95929db8c8702a2150801b4a5a307e4237 WatchSource:0}: Error finding container d92e0e7d75e9e0b63259b15330462f95929db8c8702a2150801b4a5a307e4237: Status 404 returned error can't find the container with id d92e0e7d75e9e0b63259b15330462f95929db8c8702a2150801b4a5a307e4237
Jul 31 01:41:57.287299 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.284502    2555 patch_prober.go:28] interesting pod/console-6c7b5bb757-zvtss container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 31 01:41:57.287299 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.284546    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c7b5bb757-zvtss" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 31 01:41:57.442893 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.442865    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-tls\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:57.445223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.445201    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5cbbbe8-f675-41ec-b5d9-ce4833212530-node-exporter-tls\") pod \"node-exporter-7gqcg\" (UID: \"b5cbbbe8-f675-41ec-b5d9-ce4833212530\") " pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:57.683787 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.683667    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gqcg"
Jul 31 01:41:57.695617 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:41:57.695581    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cbbbe8_f675_41ec_b5d9_ce4833212530.slice/crio-9b7ed6ad6764fdd0452106f0504046b3738c0611f754015abc1d419955df457d WatchSource:0}: Error finding container 9b7ed6ad6764fdd0452106f0504046b3738c0611f754015abc1d419955df457d: Status 404 returned error can't find the container with id 9b7ed6ad6764fdd0452106f0504046b3738c0611f754015abc1d419955df457d
Jul 31 01:41:57.913222 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.913180    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4" event={"ID":"c3f9f362-9db0-43b9-8408-0ecad8907a4b","Type":"ContainerStarted","Data":"13a25786c464e7d9ca017b7aa4c4934bb04ff02fb9e1605c9d215d67f100113a"}
Jul 31 01:41:57.913668 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.913285    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4" event={"ID":"c3f9f362-9db0-43b9-8408-0ecad8907a4b","Type":"ContainerStarted","Data":"1e12e64534c2de8df4665b30c4738bd2671c6ea9d666aa5ccf777c0e11f9bf16"}
Jul 31 01:41:57.913668 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.913319    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4" event={"ID":"c3f9f362-9db0-43b9-8408-0ecad8907a4b","Type":"ContainerStarted","Data":"d92e0e7d75e9e0b63259b15330462f95929db8c8702a2150801b4a5a307e4237"}
Jul 31 01:41:57.914511 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:57.914478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqcg" event={"ID":"b5cbbbe8-f675-41ec-b5d9-ce4833212530","Type":"ContainerStarted","Data":"9b7ed6ad6764fdd0452106f0504046b3738c0611f754015abc1d419955df457d"}
Jul 31 01:41:58.924548 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:58.924512    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqcg" event={"ID":"b5cbbbe8-f675-41ec-b5d9-ce4833212530","Type":"ContainerStarted","Data":"ac72b26938dfa9ad068123ec4ed103d76bc492b2be91f36a104303e98519a1a2"}
Jul 31 01:41:58.925926 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:58.925898    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4" event={"ID":"c3f9f362-9db0-43b9-8408-0ecad8907a4b","Type":"ContainerStarted","Data":"9d9f27a20155e4c3f987f60cca05d79b50fa89f0557b63182e36f3105c3f8c88"}
Jul 31 01:41:58.953601 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:58.953548    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vfvx4" podStartSLOduration=1.508277205 podStartE2EDuration="2.95353114s" totalImagesPullingTime="1.445253935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:58.952121047 +0000 UTC m=+298.588913767" watchObservedRunningTime="2026-07-31 01:41:58.95353114 +0000 UTC m=+298.590323859"
Jul 31 01:41:59.285543 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:59.285458    2555 patch_prober.go:28] interesting pod/console-676ffd589f-n9hx5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body=
Jul 31 01:41:59.285543 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:59.285516    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-676ffd589f-n9hx5" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused"
Jul 31 01:41:59.877173 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:59.877146    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9427d"
Jul 31 01:41:59.932146 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:59.932115    2555 generic.go:356] "Generic (PLEG): container finished" podID="b5cbbbe8-f675-41ec-b5d9-ce4833212530" containerID="ac72b26938dfa9ad068123ec4ed103d76bc492b2be91f36a104303e98519a1a2" exitCode=0
Jul 31 01:41:59.933133 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:41:59.933105    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqcg" event={"ID":"b5cbbbe8-f675-41ec-b5d9-ce4833212530","Type":"ContainerDied","Data":"ac72b26938dfa9ad068123ec4ed103d76bc492b2be91f36a104303e98519a1a2"}
Jul 31 01:42:00.783095 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:00.783067    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:42:00.784141 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:00.784122    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:42:00.793580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:00.793559    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 01:42:00.937079 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:00.936950    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqcg" event={"ID":"b5cbbbe8-f675-41ec-b5d9-ce4833212530","Type":"ContainerStarted","Data":"c01229b6fd8b78cb17302451ec0c2ffa8548319a6673116ec7b4c83b524178c7"}
Jul 31 01:42:00.937079 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:00.936996    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gqcg" event={"ID":"b5cbbbe8-f675-41ec-b5d9-ce4833212530","Type":"ContainerStarted","Data":"c0f13e86303fab89dc377be7138d5c4e047bfb431cc5487e370164cfee048f3b"}
Jul 31 01:42:00.958169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:00.958130    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7gqcg" podStartSLOduration=3.777103613 podStartE2EDuration="4.958116401s" totalImagesPullingTime="1.102037223s" totalInitContainerRuntime="78.975565ms" isStatefulPod=true podCreationTimestamp="2026-07-31 01:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:00.957949249 +0000 UTC m=+300.594741970" watchObservedRunningTime="2026-07-31 01:42:00.958116401 +0000 UTC m=+300.594909120"
Jul 31 01:42:01.547850 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:01.547813    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7b5bb757-zvtss"]
Jul 31 01:42:03.858826 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:03.858795    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79bfc6d44f-8mv5f"]
Jul 31 01:42:03.863313 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:03.863283    2555 patch_prober.go:28] interesting pod/image-registry-79bfc6d44f-8mv5f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 01:42:03.863440 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:03.863342    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:42:05.920215 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:05.920185    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:42:09.289569 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:09.289541    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:42:09.293413 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:09.293388    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:42:12.059064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:12.059017    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676ffd589f-n9hx5"]
Jul 31 01:42:13.863440 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:13.863411    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:42:20.011314 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:20.011233    2555 generic.go:356] "Generic (PLEG): container finished" podID="5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015" containerID="bee7080fbf5cd79c83751d669decdfa0ce8c6379cc2cb756434a2d6b88d9a0a9" exitCode=0
Jul 31 01:42:20.011656 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:20.011310    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv" event={"ID":"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015","Type":"ContainerDied","Data":"bee7080fbf5cd79c83751d669decdfa0ce8c6379cc2cb756434a2d6b88d9a0a9"}
Jul 31 01:42:20.011656 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:20.011621    2555 scope.go:117] "RemoveContainer" containerID="bee7080fbf5cd79c83751d669decdfa0ce8c6379cc2cb756434a2d6b88d9a0a9"
Jul 31 01:42:21.016032 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:21.016003    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-g4mwv" event={"ID":"5fd6b4af-0dd7-4da3-bc63-c9cb34d8a015","Type":"ContainerStarted","Data":"f6f0e24a7fcbed2700b5130ca9f3e4af2e8e5c117103c2bae06cbce7e5e5216e"}
Jul 31 01:42:26.567264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.567217    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c7b5bb757-zvtss" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerName="console" containerID="cri-o://0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41" gracePeriod=15
Jul 31 01:42:26.818543 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.818485    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:42:26.898322 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898294    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-oauth-config\") pod \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") "
Jul 31 01:42:26.898322 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898325    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7nnm\" (UniqueName: \"kubernetes.io/projected/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-kube-api-access-b7nnm\") pod \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") "
Jul 31 01:42:26.898522 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898352    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-serving-cert\") pod \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") "
Jul 31 01:42:26.898522 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898387    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-service-ca\") pod \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") "
Jul 31 01:42:26.898522 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-oauth-serving-cert\") pod \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") "
Jul 31 01:42:26.898522 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898461    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-config\") pod \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\" (UID: \"df52b9dd-3e6a-4fa9-85bf-f07b716530c6\") "
Jul 31 01:42:26.898978 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898945    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df52b9dd-3e6a-4fa9-85bf-f07b716530c6" (UID: "df52b9dd-3e6a-4fa9-85bf-f07b716530c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:26.898978 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898953    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "df52b9dd-3e6a-4fa9-85bf-f07b716530c6" (UID: "df52b9dd-3e6a-4fa9-85bf-f07b716530c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:26.898978 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.898967    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-config" (OuterVolumeSpecName: "console-config") pod "df52b9dd-3e6a-4fa9-85bf-f07b716530c6" (UID: "df52b9dd-3e6a-4fa9-85bf-f07b716530c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:26.900643 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.900615    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df52b9dd-3e6a-4fa9-85bf-f07b716530c6" (UID: "df52b9dd-3e6a-4fa9-85bf-f07b716530c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:42:26.900738 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.900661    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df52b9dd-3e6a-4fa9-85bf-f07b716530c6" (UID: "df52b9dd-3e6a-4fa9-85bf-f07b716530c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:42:26.900738 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.900676    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-kube-api-access-b7nnm" (OuterVolumeSpecName: "kube-api-access-b7nnm") pod "df52b9dd-3e6a-4fa9-85bf-f07b716530c6" (UID: "df52b9dd-3e6a-4fa9-85bf-f07b716530c6"). InnerVolumeSpecName "kube-api-access-b7nnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:42:26.999852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.999828    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-oauth-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:26.999852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.999851    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7nnm\" (UniqueName: \"kubernetes.io/projected/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-kube-api-access-b7nnm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:26.999996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.999865    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:26.999996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.999877    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:26.999996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.999888    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-oauth-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:26.999996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:26.999900    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df52b9dd-3e6a-4fa9-85bf-f07b716530c6-console-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:27.038558 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.038526    2555 generic.go:356] "Generic (PLEG): container finished" podID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerID="0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41" exitCode=0
Jul 31 01:42:27.038667 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.038575    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7b5bb757-zvtss"
Jul 31 01:42:27.038667 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.038620    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7b5bb757-zvtss" event={"ID":"df52b9dd-3e6a-4fa9-85bf-f07b716530c6","Type":"ContainerDied","Data":"0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41"}
Jul 31 01:42:27.038741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.038672    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7b5bb757-zvtss" event={"ID":"df52b9dd-3e6a-4fa9-85bf-f07b716530c6","Type":"ContainerDied","Data":"46f54be92eec0e94c6503e3bf5915ec6310f31f5bbd5967078b9d7a4ed08ab99"}
Jul 31 01:42:27.038741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.038691    2555 scope.go:117] "RemoveContainer" containerID="0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41"
Jul 31 01:42:27.046878 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.046861    2555 scope.go:117] "RemoveContainer" containerID="0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41"
Jul 31 01:42:27.047160 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:42:27.047133    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41\": container with ID starting with 0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41 not found: ID does not exist" containerID="0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41"
Jul 31 01:42:27.047225 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.047172    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41"} err="failed to get container status \"0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41\": rpc error: code = NotFound desc = could not find container \"0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41\": container with ID starting with 0cb95d4f81263279a29a952559919b44bf444f4cc1dd2d41054b871407ee5c41 not found: ID does not exist"
Jul 31 01:42:27.053198 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.053179    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7b5bb757-zvtss"]
Jul 31 01:42:27.059297 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:27.059277    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c7b5bb757-zvtss"]
Jul 31 01:42:28.294289 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:28.294259    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-dhxff_e9029b9d-9235-4a98-8cce-4a2cca4a320a/cluster-monitoring-operator/0.log"
Jul 31 01:42:28.877770 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:28.877699    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" containerName="registry" containerID="cri-o://af757fc6a0546c01f2a9c417fdc0d8f62b85e27f05f4426b293d202ade37777c" gracePeriod=30
Jul 31 01:42:28.925090 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:28.925065    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" path="/var/lib/kubelet/pods/df52b9dd-3e6a-4fa9-85bf-f07b716530c6/volumes"
Jul 31 01:42:29.049699 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.049635    2555 generic.go:356] "Generic (PLEG): container finished" podID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" containerID="af757fc6a0546c01f2a9c417fdc0d8f62b85e27f05f4426b293d202ade37777c" exitCode=0
Jul 31 01:42:29.049852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.049719    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" event={"ID":"5fa52142-daac-4f27-8a4b-3a386aae2eb5","Type":"ContainerDied","Data":"af757fc6a0546c01f2a9c417fdc0d8f62b85e27f05f4426b293d202ade37777c"}
Jul 31 01:42:29.140341 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.140281    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:42:29.320971 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.320938    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-kube-api-access-5prxr\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.320978    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-trusted-ca\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321031    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa52142-daac-4f27-8a4b-3a386aae2eb5-ca-trust-extracted\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321054    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-certificates\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321079    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-image-registry-private-configuration\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321121    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-bound-sa-token\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321152    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321174    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-installation-pull-secrets\") pod \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\" (UID: \"5fa52142-daac-4f27-8a4b-3a386aae2eb5\") "
Jul 31 01:42:29.321804 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321479    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:29.321804 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.321512    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:29.323852 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.323800    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:42:29.323965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.323862    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:42:29.323965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.323861    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:42:29.324160 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.324137    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:42:29.324305 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.324282    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-kube-api-access-5prxr" (OuterVolumeSpecName: "kube-api-access-5prxr") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "kube-api-access-5prxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:42:29.330335 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.330312    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa52142-daac-4f27-8a4b-3a386aae2eb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5fa52142-daac-4f27-8a4b-3a386aae2eb5" (UID: "5fa52142-daac-4f27-8a4b-3a386aae2eb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:42:29.422265 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422207    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5prxr\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-kube-api-access-5prxr\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422265 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422230    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-trusted-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422265 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422242    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fa52142-daac-4f27-8a4b-3a386aae2eb5-ca-trust-extracted\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422265 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422254    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-certificates\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422450 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422267    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-image-registry-private-configuration\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422450 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422282    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-bound-sa-token\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422450 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422295    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fa52142-daac-4f27-8a4b-3a386aae2eb5-registry-tls\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.422450 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.422306    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fa52142-daac-4f27-8a4b-3a386aae2eb5-installation-pull-secrets\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:29.493066 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.493045    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqcg_b5cbbbe8-f675-41ec-b5d9-ce4833212530/init-textfile/0.log"
Jul 31 01:42:29.693163 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.693093    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqcg_b5cbbbe8-f675-41ec-b5d9-ce4833212530/node-exporter/0.log"
Jul 31 01:42:29.893015 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:29.892991    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqcg_b5cbbbe8-f675-41ec-b5d9-ce4833212530/kube-rbac-proxy/0.log"
Jul 31 01:42:30.054899 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:30.054872    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f" event={"ID":"5fa52142-daac-4f27-8a4b-3a386aae2eb5","Type":"ContainerDied","Data":"316152e2dcfae12275a87168e24e4c53310a3ebed75e512967d89987a21be84c"}
Jul 31 01:42:30.055062 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:30.054884    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bfc6d44f-8mv5f"
Jul 31 01:42:30.055062 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:30.054923    2555 scope.go:117] "RemoveContainer" containerID="af757fc6a0546c01f2a9c417fdc0d8f62b85e27f05f4426b293d202ade37777c"
Jul 31 01:42:30.074798 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:30.074778    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79bfc6d44f-8mv5f"]
Jul 31 01:42:30.078172 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:30.078152    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79bfc6d44f-8mv5f"]
Jul 31 01:42:30.924995 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:30.924964    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" path="/var/lib/kubelet/pods/5fa52142-daac-4f27-8a4b-3a386aae2eb5/volumes"
Jul 31 01:42:31.292801 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:31.292775    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vfvx4_c3f9f362-9db0-43b9-8408-0ecad8907a4b/kube-rbac-proxy-main/0.log"
Jul 31 01:42:31.493046 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:31.493015    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vfvx4_c3f9f362-9db0-43b9-8408-0ecad8907a4b/kube-rbac-proxy-self/0.log"
Jul 31 01:42:31.692983 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:31.692908    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vfvx4_c3f9f362-9db0-43b9-8408-0ecad8907a4b/openshift-state-metrics/0.log"
Jul 31 01:42:33.294622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:33.294581    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5gz78_a57dd607-f188-4005-8b8e-37a4f286eb6c/prometheus-operator/0.log"
Jul 31 01:42:33.492838 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:33.492807    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5gz78_a57dd607-f188-4005-8b8e-37a4f286eb6c/kube-rbac-proxy/0.log"
Jul 31 01:42:35.075647 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.075619    2555 generic.go:356] "Generic (PLEG): container finished" podID="93bcb820-995b-4595-998e-da26e7ec0968" containerID="1f07425bcd58970054c2505a4905b1a45f437fb54467dbb037af07f83ec955aa" exitCode=0
Jul 31 01:42:35.076065 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.075668    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8" event={"ID":"93bcb820-995b-4595-998e-da26e7ec0968","Type":"ContainerDied","Data":"1f07425bcd58970054c2505a4905b1a45f437fb54467dbb037af07f83ec955aa"}
Jul 31 01:42:35.076065 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.075961    2555 scope.go:117] "RemoveContainer" containerID="1f07425bcd58970054c2505a4905b1a45f437fb54467dbb037af07f83ec955aa"
Jul 31 01:42:35.093586 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.093562    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-75p5g_a274a59c-e2a0-473f-bfdb-a11dd656ce11/networking-console-plugin/0.log"
Jul 31 01:42:35.293612 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.293583    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:42:35.494702 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.494633    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/2.log"
Jul 31 01:42:35.693430 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:35.693404    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-676ffd589f-n9hx5_fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce/console/0.log"
Jul 31 01:42:36.080958 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:36.080922    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-26jk8" event={"ID":"93bcb820-995b-4595-998e-da26e7ec0968","Type":"ContainerStarted","Data":"7efad2e14e5801799447f27a19fef39439b327feaf565f43de553b5a952b73e0"}
Jul 31 01:42:36.897497 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:36.897467    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9427d_fa135198-565e-4fd8-914a-218340ba89b4/dns/0.log"
Jul 31 01:42:37.079009 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.078974    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-676ffd589f-n9hx5" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerName="console" containerID="cri-o://5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f" gracePeriod=15
Jul 31 01:42:37.094224 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.094196    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9427d_fa135198-565e-4fd8-914a-218340ba89b4/kube-rbac-proxy/0.log"
Jul 31 01:42:37.327294 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.327272    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:42:37.384856 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.384826    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-config\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.384880    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-oauth-config\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.384905    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-oauth-serving-cert\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.384930    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-serving-cert\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385008 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.384953    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-service-ca\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385210 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385105    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-trusted-ca-bundle\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385210 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385150    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxjbl\" (UniqueName: \"kubernetes.io/projected/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-kube-api-access-pxjbl\") pod \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\" (UID: \"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce\") "
Jul 31 01:42:37.385317 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385252    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-config" (OuterVolumeSpecName: "console-config") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:37.385377 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385359    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:37.385377 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385366    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-service-ca" (OuterVolumeSpecName: "service-ca") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:37.385481 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385459    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.385583 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385484    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.385583 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385497    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-oauth-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.385583 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.385494    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:42:37.387168 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.387146    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:42:37.387293 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.387271    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-kube-api-access-pxjbl" (OuterVolumeSpecName: "kube-api-access-pxjbl") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "kube-api-access-pxjbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:42:37.387356 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.387295    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" (UID: "fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:42:37.486081 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.485994    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-oauth-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.486081 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.486024    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-console-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.486081 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.486036    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-trusted-ca-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.486081 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.486048    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxjbl\" (UniqueName: \"kubernetes.io/projected/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce-kube-api-access-pxjbl\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:42:37.693209 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:37.693182    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gshz6_a9ea1983-2c83-4f97-8fe4-acffae008bad/dns-node-resolver/0.log"
Jul 31 01:42:38.092881 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.092847    2555 generic.go:356] "Generic (PLEG): container finished" podID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerID="5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f" exitCode=0
Jul 31 01:42:38.093040 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.092893    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676ffd589f-n9hx5" event={"ID":"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce","Type":"ContainerDied","Data":"5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f"}
Jul 31 01:42:38.093040 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.092926    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676ffd589f-n9hx5" event={"ID":"fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce","Type":"ContainerDied","Data":"d96a2428420e0aa96e04c3461f6028952dbf85ebfc1b5a328561110854ad3cae"}
Jul 31 01:42:38.093040 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.092944    2555 scope.go:117] "RemoveContainer" containerID="5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f"
Jul 31 01:42:38.093040 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.092894    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676ffd589f-n9hx5"
Jul 31 01:42:38.101939 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.101924    2555 scope.go:117] "RemoveContainer" containerID="5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f"
Jul 31 01:42:38.102172 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:42:38.102155    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f\": container with ID starting with 5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f not found: ID does not exist" containerID="5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f"
Jul 31 01:42:38.102214 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.102180    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f"} err="failed to get container status \"5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f\": rpc error: code = NotFound desc = could not find container \"5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f\": container with ID starting with 5c7292b9b58cfc5408d3985d522a9f49c810fd1a51d7b80a4eb0dacc40bd977f not found: ID does not exist"
Jul 31 01:42:38.113588 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.113566    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676ffd589f-n9hx5"]
Jul 31 01:42:38.116962 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.116943    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-676ffd589f-n9hx5"]
Jul 31 01:42:38.693371 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.693308    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qd64g_843a29e7-e3bf-40fb-8e81-ca8a7c64bc10/serve-healthcheck-canary/0.log"
Jul 31 01:42:38.925011 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:42:38.924981    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" path="/var/lib/kubelet/pods/fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce/volumes"
Jul 31 01:43:14.766993 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:14.766960    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:43:14.769323 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:14.769306    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b36f04bc-b95a-4360-a452-3bc6bfd8e4c1-metrics-certs\") pod \"network-metrics-daemon-vb8p5\" (UID: \"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1\") " pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:43:14.923319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:14.923294    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zn99h\""
Jul 31 01:43:14.931280 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:14.931260    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vb8p5"
Jul 31 01:43:15.060857 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:15.060829    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vb8p5"]
Jul 31 01:43:15.063671 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:43:15.063643    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36f04bc_b95a_4360_a452_3bc6bfd8e4c1.slice/crio-1d9b0d78e45570f560800f600bfadeedbad8a20c1aee8fc6b58720549046aa1f WatchSource:0}: Error finding container 1d9b0d78e45570f560800f600bfadeedbad8a20c1aee8fc6b58720549046aa1f: Status 404 returned error can't find the container with id 1d9b0d78e45570f560800f600bfadeedbad8a20c1aee8fc6b58720549046aa1f
Jul 31 01:43:15.065528 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:15.065512    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:43:15.227842 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:15.227807    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vb8p5" event={"ID":"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1","Type":"ContainerStarted","Data":"1d9b0d78e45570f560800f600bfadeedbad8a20c1aee8fc6b58720549046aa1f"}
Jul 31 01:43:17.237788 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:17.237724    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vb8p5" event={"ID":"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1","Type":"ContainerStarted","Data":"b1bee187173f24b2fad729a3d3bd8652de0ea41dc885223c77b034cd65e95ab2"}
Jul 31 01:43:17.238239 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:17.237810    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vb8p5" event={"ID":"b36f04bc-b95a-4360-a452-3bc6bfd8e4c1","Type":"ContainerStarted","Data":"71d7c0ec9476f6f4192beba19ce3ea100814e06bd275ce1933a494452119d6d6"}
Jul 31 01:43:17.253612 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:17.253570    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vb8p5" podStartSLOduration=375.968276437 podStartE2EDuration="6m17.253555786s" totalImagesPullingTime="1.285279349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:43:17.252784003 +0000 UTC m=+376.889576736" watchObservedRunningTime="2026-07-31 01:43:17.253555786 +0000 UTC m=+376.890348506"
Jul 31 01:43:24.430408 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430377    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b86ccfb8d-67qnk"]
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430675    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerName="console"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430692    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerName="console"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430705    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" containerName="registry"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430714    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" containerName="registry"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430726    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerName="console"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430731    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerName="console"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430809    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa52142-daac-4f27-8a4b-3a386aae2eb5" containerName="registry"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430819    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="df52b9dd-3e6a-4fa9-85bf-f07b716530c6" containerName="console"
Jul 31 01:43:24.430897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.430826    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbcf2c3d-abaa-44f2-aa79-13c2ac98e3ce" containerName="console"
Jul 31 01:43:24.433647 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.433632    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.437811 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.437785    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 01:43:24.437811 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.437800    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 01:43:24.437947 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.437785    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 01:43:24.437947 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.437808    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 01:43:24.437947 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.437785    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 01:43:24.438162 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.438139    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 01:43:24.438276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.438140    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6fdc\""
Jul 31 01:43:24.438276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.438202    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 01:43:24.442608 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.442592    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 01:43:24.449146 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.449128    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b86ccfb8d-67qnk"]
Jul 31 01:43:24.536242 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536214    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-serving-cert\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.536242 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536241    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-service-ca\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.536410 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536258    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-trusted-ca-bundle\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.536410 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgnp\" (UniqueName: \"kubernetes.io/projected/edd297fb-a480-4487-996d-9a544487f4f9-kube-api-access-bhgnp\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.536410 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536366    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-oauth-config\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.536410 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536401    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-console-config\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.536531 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.536429    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-oauth-serving-cert\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.636717 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.636690    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgnp\" (UniqueName: \"kubernetes.io/projected/edd297fb-a480-4487-996d-9a544487f4f9-kube-api-access-bhgnp\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.636831 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.636727    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-oauth-config\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.636831 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.636743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-console-config\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.636831 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.636815    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-oauth-serving-cert\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.636977 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.636858    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-serving-cert\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.636977 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.636879    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-service-ca\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.637058 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.637019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-trusted-ca-bundle\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.637535 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.637509    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-console-config\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.637658 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.637509    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-service-ca\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.637779 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.637735    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-oauth-serving-cert\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.637856 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.637806    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-trusted-ca-bundle\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.639217 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.639192    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-oauth-config\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.639313 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.639297    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-serving-cert\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.644583 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.644559    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgnp\" (UniqueName: \"kubernetes.io/projected/edd297fb-a480-4487-996d-9a544487f4f9-kube-api-access-bhgnp\") pod \"console-5b86ccfb8d-67qnk\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") " pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.743985 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.743927    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:24.867787 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:24.867660    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b86ccfb8d-67qnk"]
Jul 31 01:43:24.870331 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:43:24.870307    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd297fb_a480_4487_996d_9a544487f4f9.slice/crio-602117756f1693e4aa4ea14d940c7a5514161baa6b1806801e85d1596dc61db2 WatchSource:0}: Error finding container 602117756f1693e4aa4ea14d940c7a5514161baa6b1806801e85d1596dc61db2: Status 404 returned error can't find the container with id 602117756f1693e4aa4ea14d940c7a5514161baa6b1806801e85d1596dc61db2
Jul 31 01:43:25.265739 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:25.265701    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86ccfb8d-67qnk" event={"ID":"edd297fb-a480-4487-996d-9a544487f4f9","Type":"ContainerStarted","Data":"03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9"}
Jul 31 01:43:25.265960 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:25.265777    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86ccfb8d-67qnk" event={"ID":"edd297fb-a480-4487-996d-9a544487f4f9","Type":"ContainerStarted","Data":"602117756f1693e4aa4ea14d940c7a5514161baa6b1806801e85d1596dc61db2"}
Jul 31 01:43:25.283681 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:25.283627    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b86ccfb8d-67qnk" podStartSLOduration=1.283611739 podStartE2EDuration="1.283611739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:43:25.281709187 +0000 UTC m=+384.918501902" watchObservedRunningTime="2026-07-31 01:43:25.283611739 +0000 UTC m=+384.920404459"
Jul 31 01:43:34.744066 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:34.744027    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:34.744595 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:34.744109    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:34.748770 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:34.748728    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:35.306144 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.306118    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:43:35.458385 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.458353    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb6fbb657-wkgsw"]
Jul 31 01:43:35.461318 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.461295    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.472387 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.472367    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb6fbb657-wkgsw"]
Jul 31 01:43:35.616551 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616467    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-config\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.616551 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616503    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-service-ca\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.616551 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616525    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-serving-cert\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.616832 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616627    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-oauth-serving-cert\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.616832 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616672    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-oauth-config\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.616832 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-trusted-ca-bundle\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.616832 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.616778    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mswj\" (UniqueName: \"kubernetes.io/projected/0ac5e93d-4062-43b8-9354-dd006c29b02b-kube-api-access-7mswj\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718004 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.717969    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-oauth-serving-cert\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718015    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-oauth-config\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718037    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-trusted-ca-bundle\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718054    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mswj\" (UniqueName: \"kubernetes.io/projected/0ac5e93d-4062-43b8-9354-dd006c29b02b-kube-api-access-7mswj\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-config\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718110    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-service-ca\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-serving-cert\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.718793 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718739    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-oauth-serving-cert\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.719064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718888    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-service-ca\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.719064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.718935    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-trusted-ca-bundle\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.719064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.719030    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-config\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.720684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.720667    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-serving-cert\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.720774 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.720688    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-oauth-config\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.726183 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.726162    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mswj\" (UniqueName: \"kubernetes.io/projected/0ac5e93d-4062-43b8-9354-dd006c29b02b-kube-api-access-7mswj\") pod \"console-bb6fbb657-wkgsw\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") " pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.772155 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.772129    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:35.898097 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:35.898076    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb6fbb657-wkgsw"]
Jul 31 01:43:35.900382 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:43:35.900355    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac5e93d_4062_43b8_9354_dd006c29b02b.slice/crio-d9bbd96a344cc71075bb74b3ab9283e4d18bd8465fecca82397ca118aaff4147 WatchSource:0}: Error finding container d9bbd96a344cc71075bb74b3ab9283e4d18bd8465fecca82397ca118aaff4147: Status 404 returned error can't find the container with id d9bbd96a344cc71075bb74b3ab9283e4d18bd8465fecca82397ca118aaff4147
Jul 31 01:43:36.307017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:36.306981    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb6fbb657-wkgsw" event={"ID":"0ac5e93d-4062-43b8-9354-dd006c29b02b","Type":"ContainerStarted","Data":"a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e"}
Jul 31 01:43:36.307195 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:36.307033    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb6fbb657-wkgsw" event={"ID":"0ac5e93d-4062-43b8-9354-dd006c29b02b","Type":"ContainerStarted","Data":"d9bbd96a344cc71075bb74b3ab9283e4d18bd8465fecca82397ca118aaff4147"}
Jul 31 01:43:36.325004 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:36.324947    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bb6fbb657-wkgsw" podStartSLOduration=1.324929915 podStartE2EDuration="1.324929915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:43:36.323977666 +0000 UTC m=+395.960770434" watchObservedRunningTime="2026-07-31 01:43:36.324929915 +0000 UTC m=+395.961722634"
Jul 31 01:43:45.772521 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:45.772482    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:45.773023 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:45.772543    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:45.777185 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:45.777163    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:46.348484 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:46.348449    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:43:46.394000 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:43:46.393883    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b86ccfb8d-67qnk"]
Jul 31 01:44:11.418068 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.418009    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b86ccfb8d-67qnk" podUID="edd297fb-a480-4487-996d-9a544487f4f9" containerName="console" containerID="cri-o://03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9" gracePeriod=15
Jul 31 01:44:11.666774 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.666733    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:44:11.781563 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781481    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-console-config\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781563 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781525    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-serving-cert\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781733 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781565    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-trusted-ca-bundle\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781733 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781684    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-oauth-serving-cert\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781733 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781727    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-service-ca\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781894 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781807    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-oauth-config\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781894 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781850    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhgnp\" (UniqueName: \"kubernetes.io/projected/edd297fb-a480-4487-996d-9a544487f4f9-kube-api-access-bhgnp\") pod \"edd297fb-a480-4487-996d-9a544487f4f9\" (UID: \"edd297fb-a480-4487-996d-9a544487f4f9\") "
Jul 31 01:44:11.781995 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781911    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-console-config" (OuterVolumeSpecName: "console-config") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:11.781995 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.781969    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:11.782239 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.782221    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-trusted-ca-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:11.782300 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.782250    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-console-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:11.782300 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.782220    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:11.782459 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.782434    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:11.784115 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.784085    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:44:11.784223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.784196    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd297fb-a480-4487-996d-9a544487f4f9-kube-api-access-bhgnp" (OuterVolumeSpecName: "kube-api-access-bhgnp") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "kube-api-access-bhgnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:44:11.784444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.784410    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "edd297fb-a480-4487-996d-9a544487f4f9" (UID: "edd297fb-a480-4487-996d-9a544487f4f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:44:11.882588 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.882554    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:11.882588 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.882587    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-oauth-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:11.882791 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.882599    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edd297fb-a480-4487-996d-9a544487f4f9-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:11.882791 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.882609    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edd297fb-a480-4487-996d-9a544487f4f9-console-oauth-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:11.882791 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:11.882618    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhgnp\" (UniqueName: \"kubernetes.io/projected/edd297fb-a480-4487-996d-9a544487f4f9-kube-api-access-bhgnp\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:44:12.439790 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.439742    2555 generic.go:356] "Generic (PLEG): container finished" podID="edd297fb-a480-4487-996d-9a544487f4f9" containerID="03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9" exitCode=0
Jul 31 01:44:12.439790 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.439795    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86ccfb8d-67qnk" event={"ID":"edd297fb-a480-4487-996d-9a544487f4f9","Type":"ContainerDied","Data":"03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9"}
Jul 31 01:44:12.440241 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.439807    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b86ccfb8d-67qnk"
Jul 31 01:44:12.440241 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.439831    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b86ccfb8d-67qnk" event={"ID":"edd297fb-a480-4487-996d-9a544487f4f9","Type":"ContainerDied","Data":"602117756f1693e4aa4ea14d940c7a5514161baa6b1806801e85d1596dc61db2"}
Jul 31 01:44:12.440241 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.439851    2555 scope.go:117] "RemoveContainer" containerID="03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9"
Jul 31 01:44:12.448711 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.448695    2555 scope.go:117] "RemoveContainer" containerID="03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9"
Jul 31 01:44:12.448969 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:44:12.448952    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9\": container with ID starting with 03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9 not found: ID does not exist" containerID="03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9"
Jul 31 01:44:12.449036 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.448982    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9"} err="failed to get container status \"03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9\": rpc error: code = NotFound desc = could not find container \"03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9\": container with ID starting with 03d30120ac39736307dadb044a923d7a9d70bab4980e1d2c7ba96864c09c5ad9 not found: ID does not exist"
Jul 31 01:44:12.459902 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.459882    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b86ccfb8d-67qnk"]
Jul 31 01:44:12.465013 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.464994    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b86ccfb8d-67qnk"]
Jul 31 01:44:12.924519 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:44:12.924486    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd297fb-a480-4487-996d-9a544487f4f9" path="/var/lib/kubelet/pods/edd297fb-a480-4487-996d-9a544487f4f9/volumes"
Jul 31 01:46:16.517845 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.517770    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"]
Jul 31 01:46:16.518296 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.518127    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd297fb-a480-4487-996d-9a544487f4f9" containerName="console"
Jul 31 01:46:16.518296 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.518145    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd297fb-a480-4487-996d-9a544487f4f9" containerName="console"
Jul 31 01:46:16.518296 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.518216    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd297fb-a480-4487-996d-9a544487f4f9" containerName="console"
Jul 31 01:46:16.521101 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.521085    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.523631 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.523604    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 01:46:16.523776 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.523632    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6p88\""
Jul 31 01:46:16.523776 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.523616    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 01:46:16.536948 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.536926    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"]
Jul 31 01:46:16.624161 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.624129    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.624306 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.624185    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm487\" (UniqueName: \"kubernetes.io/projected/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-kube-api-access-pm487\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.624306 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.624235    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.725130 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.725087    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm487\" (UniqueName: \"kubernetes.io/projected/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-kube-api-access-pm487\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.725277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.725149    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.725277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.725213    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.725471 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.725452    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.725536 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.725509    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.732881 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.732859    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm487\" (UniqueName: \"kubernetes.io/projected/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-kube-api-access-pm487\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.830160 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.830123    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:16.959633 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:16.959598    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"]
Jul 31 01:46:16.966143 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:46:16.966108    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4dbb65_ac8a_41ee_9f07_c2eef18ec5bf.slice/crio-dfc1d0a9f0a5e733e26bc2f8c078acf018ef63f51c2f233c78769f1fd7332434 WatchSource:0}: Error finding container dfc1d0a9f0a5e733e26bc2f8c078acf018ef63f51c2f233c78769f1fd7332434: Status 404 returned error can't find the container with id dfc1d0a9f0a5e733e26bc2f8c078acf018ef63f51c2f233c78769f1fd7332434
Jul 31 01:46:17.880324 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:17.880290    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf" event={"ID":"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf","Type":"ContainerStarted","Data":"dfc1d0a9f0a5e733e26bc2f8c078acf018ef63f51c2f233c78769f1fd7332434"}
Jul 31 01:46:23.905023 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:23.904984    2555 generic.go:356] "Generic (PLEG): container finished" podID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerID="0c6e0037584698e0cd0f462805b03d7096a7a6c4345aafab83d520f69583e0bb" exitCode=0
Jul 31 01:46:23.905373 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:23.905072    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf" event={"ID":"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf","Type":"ContainerDied","Data":"0c6e0037584698e0cd0f462805b03d7096a7a6c4345aafab83d520f69583e0bb"}
Jul 31 01:46:26.918459 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:26.918372    2555 generic.go:356] "Generic (PLEG): container finished" podID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerID="fc4444ffb643bb8ca80e6a4086691170265c3858b15da4adffd7da028d823bb7" exitCode=0
Jul 31 01:46:26.918459 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:26.918421    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf" event={"ID":"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf","Type":"ContainerDied","Data":"fc4444ffb643bb8ca80e6a4086691170265c3858b15da4adffd7da028d823bb7"}
Jul 31 01:46:34.954397 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:34.954354    2555 generic.go:356] "Generic (PLEG): container finished" podID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerID="9d9b8d9a7e474fb86319c00d561e05045bcaeb5825b93b069541a2ed6e0ade64" exitCode=0
Jul 31 01:46:34.954808 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:34.954439    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf" event={"ID":"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf","Type":"ContainerDied","Data":"9d9b8d9a7e474fb86319c00d561e05045bcaeb5825b93b069541a2ed6e0ade64"}
Jul 31 01:46:36.082048 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.082024    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:36.190662 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.190629    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-bundle\") pod \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") "
Jul 31 01:46:36.190662 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.190668    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-util\") pod \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") "
Jul 31 01:46:36.190904 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.190738    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm487\" (UniqueName: \"kubernetes.io/projected/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-kube-api-access-pm487\") pod \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\" (UID: \"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf\") "
Jul 31 01:46:36.191343 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.191316    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-bundle" (OuterVolumeSpecName: "bundle") pod "ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" (UID: "ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:46:36.193080 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.193040    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-kube-api-access-pm487" (OuterVolumeSpecName: "kube-api-access-pm487") pod "ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" (UID: "ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf"). InnerVolumeSpecName "kube-api-access-pm487". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:46:36.194719 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.194698    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-util" (OuterVolumeSpecName: "util") pod "ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" (UID: "ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:46:36.291455 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.291426    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:46:36.291455 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.291456    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm487\" (UniqueName: \"kubernetes.io/projected/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-kube-api-access-pm487\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:46:36.291625 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.291467    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:46:36.963482 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.963460    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf"
Jul 31 01:46:36.963621 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.963458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540plvxf" event={"ID":"ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf","Type":"ContainerDied","Data":"dfc1d0a9f0a5e733e26bc2f8c078acf018ef63f51c2f233c78769f1fd7332434"}
Jul 31 01:46:36.963621 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:36.963588    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfc1d0a9f0a5e733e26bc2f8c078acf018ef63f51c2f233c78769f1fd7332434"
Jul 31 01:46:44.427830 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.427795    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"]
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428085    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="util"
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428095    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="util"
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428103    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="extract"
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428108    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="extract"
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428123    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="pull"
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428128    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="pull"
Jul 31 01:46:44.428264 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.428175    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab4dbb65-ac8a-41ee-9f07-c2eef18ec5bf" containerName="extract"
Jul 31 01:46:44.431402 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.431386    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.434170 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.434146    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-k9x4b\""
Jul 31 01:46:44.434298 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.434279    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 31 01:46:44.434431 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.434417    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:46:44.444380 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.444362    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"]
Jul 31 01:46:44.548820 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.548785    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85t2d\" (UniqueName: \"kubernetes.io/projected/489275e2-ec81-4e6d-a16d-e4fb9737963e-kube-api-access-85t2d\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7gvn\" (UID: \"489275e2-ec81-4e6d-a16d-e4fb9737963e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.548988 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.548857    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489275e2-ec81-4e6d-a16d-e4fb9737963e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7gvn\" (UID: \"489275e2-ec81-4e6d-a16d-e4fb9737963e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.650091 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.650056    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489275e2-ec81-4e6d-a16d-e4fb9737963e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7gvn\" (UID: \"489275e2-ec81-4e6d-a16d-e4fb9737963e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.650227 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.650109    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85t2d\" (UniqueName: \"kubernetes.io/projected/489275e2-ec81-4e6d-a16d-e4fb9737963e-kube-api-access-85t2d\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7gvn\" (UID: \"489275e2-ec81-4e6d-a16d-e4fb9737963e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.650504 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.650480    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/489275e2-ec81-4e6d-a16d-e4fb9737963e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7gvn\" (UID: \"489275e2-ec81-4e6d-a16d-e4fb9737963e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.658687 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.658666    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85t2d\" (UniqueName: \"kubernetes.io/projected/489275e2-ec81-4e6d-a16d-e4fb9737963e-kube-api-access-85t2d\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7gvn\" (UID: \"489275e2-ec81-4e6d-a16d-e4fb9737963e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.740888 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.740805    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"
Jul 31 01:46:44.872155 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.872130    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn"]
Jul 31 01:46:44.874791 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:46:44.874758    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489275e2_ec81_4e6d_a16d_e4fb9737963e.slice/crio-d570f132a2855c070db41e6d5a86df3351bce0e02379b1ccf669292bef4c0235 WatchSource:0}: Error finding container d570f132a2855c070db41e6d5a86df3351bce0e02379b1ccf669292bef4c0235: Status 404 returned error can't find the container with id d570f132a2855c070db41e6d5a86df3351bce0e02379b1ccf669292bef4c0235
Jul 31 01:46:44.995822 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:44.995739    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn" event={"ID":"489275e2-ec81-4e6d-a16d-e4fb9737963e","Type":"ContainerStarted","Data":"d570f132a2855c070db41e6d5a86df3351bce0e02379b1ccf669292bef4c0235"}
Jul 31 01:46:47.960796 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:47.960760    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l5lt8"]
Jul 31 01:46:47.962777 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:47.962741    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:47.965289 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:47.965266    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 31 01:46:47.965410 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:47.965308    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 31 01:46:47.966278 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:47.966260    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wl2md\""
Jul 31 01:46:47.974203 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:47.974184    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l5lt8"]
Jul 31 01:46:48.011879 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.011849    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn" event={"ID":"489275e2-ec81-4e6d-a16d-e4fb9737963e","Type":"ContainerStarted","Data":"9bf4ae5130b927166e293ecc3f1eb0901fc1909b6650447b26991e07fb9b5af7"}
Jul 31 01:46:48.031554 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.031494    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7gvn" podStartSLOduration=1.816657521 podStartE2EDuration="4.031475821s" totalImagesPullingTime="2.2148183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:46:48.027771576 +0000 UTC m=+587.664564299" watchObservedRunningTime="2026-07-31 01:46:48.031475821 +0000 UTC m=+587.668268544"
Jul 31 01:46:48.079361 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.079337    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76dx5\" (UniqueName: \"kubernetes.io/projected/af6b3146-c00e-4527-98d3-5371cf4e27f9-kube-api-access-76dx5\") pod \"cert-manager-webhook-6486ffd997-l5lt8\" (UID: \"af6b3146-c00e-4527-98d3-5371cf4e27f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.079464 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.079383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af6b3146-c00e-4527-98d3-5371cf4e27f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l5lt8\" (UID: \"af6b3146-c00e-4527-98d3-5371cf4e27f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.179959 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.179925    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af6b3146-c00e-4527-98d3-5371cf4e27f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l5lt8\" (UID: \"af6b3146-c00e-4527-98d3-5371cf4e27f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.180074 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.180000    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76dx5\" (UniqueName: \"kubernetes.io/projected/af6b3146-c00e-4527-98d3-5371cf4e27f9-kube-api-access-76dx5\") pod \"cert-manager-webhook-6486ffd997-l5lt8\" (UID: \"af6b3146-c00e-4527-98d3-5371cf4e27f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.188202 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.188171    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af6b3146-c00e-4527-98d3-5371cf4e27f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l5lt8\" (UID: \"af6b3146-c00e-4527-98d3-5371cf4e27f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.188290 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.188249    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76dx5\" (UniqueName: \"kubernetes.io/projected/af6b3146-c00e-4527-98d3-5371cf4e27f9-kube-api-access-76dx5\") pod \"cert-manager-webhook-6486ffd997-l5lt8\" (UID: \"af6b3146-c00e-4527-98d3-5371cf4e27f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.285491 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.285433    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:48.425167 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.425137    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l5lt8"]
Jul 31 01:46:48.427333 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:46:48.427284    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf6b3146_c00e_4527_98d3_5371cf4e27f9.slice/crio-3a37fd10e7e2a646544e0cddc5e39dc9d4799570a4efeb0bff91a621b7fa4237 WatchSource:0}: Error finding container 3a37fd10e7e2a646544e0cddc5e39dc9d4799570a4efeb0bff91a621b7fa4237: Status 404 returned error can't find the container with id 3a37fd10e7e2a646544e0cddc5e39dc9d4799570a4efeb0bff91a621b7fa4237
Jul 31 01:46:48.989439 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.989410    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"]
Jul 31 01:46:48.992256 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.992239    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:48.994594 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.994572    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 01:46:48.994594 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.994588    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 01:46:48.995462 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:48.995449    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6p88\""
Jul 31 01:46:49.000524 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.000502    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"]
Jul 31 01:46:49.017051 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.017023    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8" event={"ID":"af6b3146-c00e-4527-98d3-5371cf4e27f9","Type":"ContainerStarted","Data":"3a37fd10e7e2a646544e0cddc5e39dc9d4799570a4efeb0bff91a621b7fa4237"}
Jul 31 01:46:49.086597 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.086576    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.086771 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.086621    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.086771 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.086639    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjpst\" (UniqueName: \"kubernetes.io/projected/78a732db-e915-4d06-b061-aa4c7c72f7ea-kube-api-access-bjpst\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.187707 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.187682    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.187812 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.187714    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.187812 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.187733    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjpst\" (UniqueName: \"kubernetes.io/projected/78a732db-e915-4d06-b061-aa4c7c72f7ea-kube-api-access-bjpst\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.188051 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.188035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.188115 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.188099    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.195671 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.195643    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjpst\" (UniqueName: \"kubernetes.io/projected/78a732db-e915-4d06-b061-aa4c7c72f7ea-kube-api-access-bjpst\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.302062 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.302035    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:49.446574 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:49.446461    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"]
Jul 31 01:46:49.449455 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:46:49.449413    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a732db_e915_4d06_b061_aa4c7c72f7ea.slice/crio-47043910272d7914fe32846ac5ae1b9a0164cdea8b0765f202e425d0b9ef3984 WatchSource:0}: Error finding container 47043910272d7914fe32846ac5ae1b9a0164cdea8b0765f202e425d0b9ef3984: Status 404 returned error can't find the container with id 47043910272d7914fe32846ac5ae1b9a0164cdea8b0765f202e425d0b9ef3984
Jul 31 01:46:50.022701 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:50.022610    2555 generic.go:356] "Generic (PLEG): container finished" podID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerID="006fec1dbfdc9a87aa39dbda2efa094d8ff68e54d067deea68570d05e42656e8" exitCode=0
Jul 31 01:46:50.023153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:50.022706    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn" event={"ID":"78a732db-e915-4d06-b061-aa4c7c72f7ea","Type":"ContainerDied","Data":"006fec1dbfdc9a87aa39dbda2efa094d8ff68e54d067deea68570d05e42656e8"}
Jul 31 01:46:50.023153 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:50.022769    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn" event={"ID":"78a732db-e915-4d06-b061-aa4c7c72f7ea","Type":"ContainerStarted","Data":"47043910272d7914fe32846ac5ae1b9a0164cdea8b0765f202e425d0b9ef3984"}
Jul 31 01:46:51.544402 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.544360    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"]
Jul 31 01:46:51.546674 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.546654    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.548990 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.548967    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wkwc6\""
Jul 31 01:46:51.554144 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.554121    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"]
Jul 31 01:46:51.608087 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.608057    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a64a519-902c-4375-83e0-c09cdb1eb36d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jf4s\" (UID: \"9a64a519-902c-4375-83e0-c09cdb1eb36d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.608260 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.608123    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h768g\" (UniqueName: \"kubernetes.io/projected/9a64a519-902c-4375-83e0-c09cdb1eb36d-kube-api-access-h768g\") pod \"cert-manager-cainjector-559cdd8c87-9jf4s\" (UID: \"9a64a519-902c-4375-83e0-c09cdb1eb36d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.709138 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.709104    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h768g\" (UniqueName: \"kubernetes.io/projected/9a64a519-902c-4375-83e0-c09cdb1eb36d-kube-api-access-h768g\") pod \"cert-manager-cainjector-559cdd8c87-9jf4s\" (UID: \"9a64a519-902c-4375-83e0-c09cdb1eb36d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.709304 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.709199    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a64a519-902c-4375-83e0-c09cdb1eb36d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jf4s\" (UID: \"9a64a519-902c-4375-83e0-c09cdb1eb36d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.717560 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.717532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a64a519-902c-4375-83e0-c09cdb1eb36d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jf4s\" (UID: \"9a64a519-902c-4375-83e0-c09cdb1eb36d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.717970 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.717946    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h768g\" (UniqueName: \"kubernetes.io/projected/9a64a519-902c-4375-83e0-c09cdb1eb36d-kube-api-access-h768g\") pod \"cert-manager-cainjector-559cdd8c87-9jf4s\" (UID: \"9a64a519-902c-4375-83e0-c09cdb1eb36d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:51.858734 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:51.858656    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"
Jul 31 01:46:52.820558 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:52.820529    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s"]
Jul 31 01:46:52.822198 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:46:52.822168    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a64a519_902c_4375_83e0_c09cdb1eb36d.slice/crio-106d141c15f47fe04ca6ed21c8f4d9663a3469a59a4d4962d00320dcee297bb6 WatchSource:0}: Error finding container 106d141c15f47fe04ca6ed21c8f4d9663a3469a59a4d4962d00320dcee297bb6: Status 404 returned error can't find the container with id 106d141c15f47fe04ca6ed21c8f4d9663a3469a59a4d4962d00320dcee297bb6
Jul 31 01:46:53.038722 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.038643    2555 generic.go:356] "Generic (PLEG): container finished" podID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerID="ecbb1e5fc95e7b46ce1e4aad8faface00c9f3999b08dc9c1c959468477ffe3f9" exitCode=0
Jul 31 01:46:53.038909 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.038723    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn" event={"ID":"78a732db-e915-4d06-b061-aa4c7c72f7ea","Type":"ContainerDied","Data":"ecbb1e5fc95e7b46ce1e4aad8faface00c9f3999b08dc9c1c959468477ffe3f9"}
Jul 31 01:46:53.040329 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.040267    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s" event={"ID":"9a64a519-902c-4375-83e0-c09cdb1eb36d","Type":"ContainerStarted","Data":"05e28724c71f7ae6fd294fc29a8818e676f17aa31a6dc382bb011881a351fe09"}
Jul 31 01:46:53.040329 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.040311    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s" event={"ID":"9a64a519-902c-4375-83e0-c09cdb1eb36d","Type":"ContainerStarted","Data":"106d141c15f47fe04ca6ed21c8f4d9663a3469a59a4d4962d00320dcee297bb6"}
Jul 31 01:46:53.042082 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.042057    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8" event={"ID":"af6b3146-c00e-4527-98d3-5371cf4e27f9","Type":"ContainerStarted","Data":"28f957b45f3b8053a82a15dd01e90052db0d6252664764d79114b09404c46fc5"}
Jul 31 01:46:53.042195 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.042181    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:53.070987 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.070941    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8" podStartSLOduration=1.7948410080000001 podStartE2EDuration="6.07092812s" totalImagesPullingTime="4.276087112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:46:53.06932508 +0000 UTC m=+592.706117812" watchObservedRunningTime="2026-07-31 01:46:53.07092812 +0000 UTC m=+592.707720840"
Jul 31 01:46:53.085422 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:53.085370    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jf4s" podStartSLOduration=2.085352238 podStartE2EDuration="2.085352238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:46:53.083886221 +0000 UTC m=+592.720678954" watchObservedRunningTime="2026-07-31 01:46:53.085352238 +0000 UTC m=+592.722144960"
Jul 31 01:46:54.048423 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:54.048392    2555 generic.go:356] "Generic (PLEG): container finished" podID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerID="d98d17362b9b9eebe49c77fc0f3b26dc2a4c88c02a2dbac9d16933170ae6183a" exitCode=0
Jul 31 01:46:54.048839 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:54.048470    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn" event={"ID":"78a732db-e915-4d06-b061-aa4c7c72f7ea","Type":"ContainerDied","Data":"d98d17362b9b9eebe49c77fc0f3b26dc2a4c88c02a2dbac9d16933170ae6183a"}
Jul 31 01:46:55.169456 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.169433    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:55.239876 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.239845    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-bundle\") pod \"78a732db-e915-4d06-b061-aa4c7c72f7ea\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") "
Jul 31 01:46:55.240016 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.239904    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-util\") pod \"78a732db-e915-4d06-b061-aa4c7c72f7ea\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") "
Jul 31 01:46:55.240016 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.239937    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjpst\" (UniqueName: \"kubernetes.io/projected/78a732db-e915-4d06-b061-aa4c7c72f7ea-kube-api-access-bjpst\") pod \"78a732db-e915-4d06-b061-aa4c7c72f7ea\" (UID: \"78a732db-e915-4d06-b061-aa4c7c72f7ea\") "
Jul 31 01:46:55.240215 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.240194    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-bundle" (OuterVolumeSpecName: "bundle") pod "78a732db-e915-4d06-b061-aa4c7c72f7ea" (UID: "78a732db-e915-4d06-b061-aa4c7c72f7ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:46:55.242065 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.242042    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78a732db-e915-4d06-b061-aa4c7c72f7ea-kube-api-access-bjpst" (OuterVolumeSpecName: "kube-api-access-bjpst") pod "78a732db-e915-4d06-b061-aa4c7c72f7ea" (UID: "78a732db-e915-4d06-b061-aa4c7c72f7ea"). InnerVolumeSpecName "kube-api-access-bjpst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:46:55.244141 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.244115    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-util" (OuterVolumeSpecName: "util") pod "78a732db-e915-4d06-b061-aa4c7c72f7ea" (UID: "78a732db-e915-4d06-b061-aa4c7c72f7ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:46:55.340622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.340564    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:46:55.340622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.340584    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78a732db-e915-4d06-b061-aa4c7c72f7ea-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:46:55.340622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:55.340593    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjpst\" (UniqueName: \"kubernetes.io/projected/78a732db-e915-4d06-b061-aa4c7c72f7ea-kube-api-access-bjpst\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:46:56.059412 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:56.059381    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn"
Jul 31 01:46:56.059412 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:56.059404    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqxrqn" event={"ID":"78a732db-e915-4d06-b061-aa4c7c72f7ea","Type":"ContainerDied","Data":"47043910272d7914fe32846ac5ae1b9a0164cdea8b0765f202e425d0b9ef3984"}
Jul 31 01:46:56.059608 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:56.059446    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47043910272d7914fe32846ac5ae1b9a0164cdea8b0765f202e425d0b9ef3984"
Jul 31 01:46:58.224064 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224031    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k96sm"]
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224332    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="extract"
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224343    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="extract"
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224357    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="pull"
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224362    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="pull"
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224374    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="util"
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224379    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="util"
Jul 31 01:46:58.224448 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.224434    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="78a732db-e915-4d06-b061-aa4c7c72f7ea" containerName="extract"
Jul 31 01:46:58.226084 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.226070    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.228493 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.228463    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lwt9w\""
Jul 31 01:46:58.234705 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.234681    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k96sm"]
Jul 31 01:46:58.364011 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.363980    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4z6x\" (UniqueName: \"kubernetes.io/projected/20c49bb6-af5c-4d63-8e60-619e96656c65-kube-api-access-b4z6x\") pod \"cert-manager-55b4d954d5-k96sm\" (UID: \"20c49bb6-af5c-4d63-8e60-619e96656c65\") " pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.364143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.364020    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c49bb6-af5c-4d63-8e60-619e96656c65-bound-sa-token\") pod \"cert-manager-55b4d954d5-k96sm\" (UID: \"20c49bb6-af5c-4d63-8e60-619e96656c65\") " pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.465290 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.465245    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c49bb6-af5c-4d63-8e60-619e96656c65-bound-sa-token\") pod \"cert-manager-55b4d954d5-k96sm\" (UID: \"20c49bb6-af5c-4d63-8e60-619e96656c65\") " pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.465427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.465345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z6x\" (UniqueName: \"kubernetes.io/projected/20c49bb6-af5c-4d63-8e60-619e96656c65-kube-api-access-b4z6x\") pod \"cert-manager-55b4d954d5-k96sm\" (UID: \"20c49bb6-af5c-4d63-8e60-619e96656c65\") " pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.473342 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.473314    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c49bb6-af5c-4d63-8e60-619e96656c65-bound-sa-token\") pod \"cert-manager-55b4d954d5-k96sm\" (UID: \"20c49bb6-af5c-4d63-8e60-619e96656c65\") " pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.473485 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.473468    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z6x\" (UniqueName: \"kubernetes.io/projected/20c49bb6-af5c-4d63-8e60-619e96656c65-kube-api-access-b4z6x\") pod \"cert-manager-55b4d954d5-k96sm\" (UID: \"20c49bb6-af5c-4d63-8e60-619e96656c65\") " pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.535371 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.535285    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k96sm"
Jul 31 01:46:58.662802 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:58.662721    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k96sm"]
Jul 31 01:46:58.665345 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:46:58.665323    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20c49bb6_af5c_4d63_8e60_619e96656c65.slice/crio-e4d16bbd2b1964cce218966eda35475e82c6332b0e4876c01d94ed0dee6bb32b WatchSource:0}: Error finding container e4d16bbd2b1964cce218966eda35475e82c6332b0e4876c01d94ed0dee6bb32b: Status 404 returned error can't find the container with id e4d16bbd2b1964cce218966eda35475e82c6332b0e4876c01d94ed0dee6bb32b
Jul 31 01:46:59.051050 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:59.051024    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l5lt8"
Jul 31 01:46:59.074109 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:59.074076    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k96sm" event={"ID":"20c49bb6-af5c-4d63-8e60-619e96656c65","Type":"ContainerStarted","Data":"0642285c171581817e71d98d979bd6951db0e26edbd1afa3e41f1208c7f1032a"}
Jul 31 01:46:59.074278 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:59.074119    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k96sm" event={"ID":"20c49bb6-af5c-4d63-8e60-619e96656c65","Type":"ContainerStarted","Data":"e4d16bbd2b1964cce218966eda35475e82c6332b0e4876c01d94ed0dee6bb32b"}
Jul 31 01:46:59.091636 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:46:59.091586    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-k96sm" podStartSLOduration=1.091572408 podStartE2EDuration="1.091572408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:46:59.090586983 +0000 UTC m=+598.727379724" watchObservedRunningTime="2026-07-31 01:46:59.091572408 +0000 UTC m=+598.728365127"
Jul 31 01:47:00.811017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:00.810991    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:47:00.811419 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:00.811217    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:47:08.627526 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.627492    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"]
Jul 31 01:47:08.629593 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.629576    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.633060 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.633033    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 01:47:08.633160 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.633037    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6p88\""
Jul 31 01:47:08.633160 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.633041    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 01:47:08.640091 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.640071    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"]
Jul 31 01:47:08.744252 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.744224    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.744252 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.744254    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r945\" (UniqueName: \"kubernetes.io/projected/415aa3db-46ce-4433-8d8f-60475b06e165-kube-api-access-6r945\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.744450 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.744276    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.844891 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.844850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.844891 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.844891    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r945\" (UniqueName: \"kubernetes.io/projected/415aa3db-46ce-4433-8d8f-60475b06e165-kube-api-access-6r945\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.845071 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.844911    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.845252 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.845238    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.845314 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.845296    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.853244 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.853220    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r945\" (UniqueName: \"kubernetes.io/projected/415aa3db-46ce-4433-8d8f-60475b06e165-kube-api-access-6r945\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:08.938428 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:08.938370    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:09.062938 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:09.062717    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"]
Jul 31 01:47:09.065037 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:47:09.065007    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415aa3db_46ce_4433_8d8f_60475b06e165.slice/crio-78cb223f8d7d8cbef90745ff7986e098e6741610d8e33f445103a33b5c7cddc4 WatchSource:0}: Error finding container 78cb223f8d7d8cbef90745ff7986e098e6741610d8e33f445103a33b5c7cddc4: Status 404 returned error can't find the container with id 78cb223f8d7d8cbef90745ff7986e098e6741610d8e33f445103a33b5c7cddc4
Jul 31 01:47:09.123578 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:09.123550    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr" event={"ID":"415aa3db-46ce-4433-8d8f-60475b06e165","Type":"ContainerStarted","Data":"78cb223f8d7d8cbef90745ff7986e098e6741610d8e33f445103a33b5c7cddc4"}
Jul 31 01:47:10.130478 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:10.130388    2555 generic.go:356] "Generic (PLEG): container finished" podID="415aa3db-46ce-4433-8d8f-60475b06e165" containerID="df6313879d75e8dc63a5a8b935322be1f1171067853c6f12b65f96249a54a7ad" exitCode=0
Jul 31 01:47:10.130875 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:10.130480    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr" event={"ID":"415aa3db-46ce-4433-8d8f-60475b06e165","Type":"ContainerDied","Data":"df6313879d75e8dc63a5a8b935322be1f1171067853c6f12b65f96249a54a7ad"}
Jul 31 01:47:11.136611 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:11.136580    2555 generic.go:356] "Generic (PLEG): container finished" podID="415aa3db-46ce-4433-8d8f-60475b06e165" containerID="39f9c73b8264d8b74f83b08e019580a5bf7cc4c079bd9dec793a64cc49217b70" exitCode=0
Jul 31 01:47:11.137017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:11.136674    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr" event={"ID":"415aa3db-46ce-4433-8d8f-60475b06e165","Type":"ContainerDied","Data":"39f9c73b8264d8b74f83b08e019580a5bf7cc4c079bd9dec793a64cc49217b70"}
Jul 31 01:47:12.142919 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:12.142888    2555 generic.go:356] "Generic (PLEG): container finished" podID="415aa3db-46ce-4433-8d8f-60475b06e165" containerID="b829cf8732e5cd05d0396e85d30be263090a2458d22b776b0e778ae6bb46a720" exitCode=0
Jul 31 01:47:12.143362 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:12.142955    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr" event={"ID":"415aa3db-46ce-4433-8d8f-60475b06e165","Type":"ContainerDied","Data":"b829cf8732e5cd05d0396e85d30be263090a2458d22b776b0e778ae6bb46a720"}
Jul 31 01:47:13.273200 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.273175    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:13.382078 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.382046    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r945\" (UniqueName: \"kubernetes.io/projected/415aa3db-46ce-4433-8d8f-60475b06e165-kube-api-access-6r945\") pod \"415aa3db-46ce-4433-8d8f-60475b06e165\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") "
Jul 31 01:47:13.382244 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.382119    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-util\") pod \"415aa3db-46ce-4433-8d8f-60475b06e165\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") "
Jul 31 01:47:13.382244 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.382158    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-bundle\") pod \"415aa3db-46ce-4433-8d8f-60475b06e165\" (UID: \"415aa3db-46ce-4433-8d8f-60475b06e165\") "
Jul 31 01:47:13.382889 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.382856    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-bundle" (OuterVolumeSpecName: "bundle") pod "415aa3db-46ce-4433-8d8f-60475b06e165" (UID: "415aa3db-46ce-4433-8d8f-60475b06e165"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:47:13.384314 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.384292    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415aa3db-46ce-4433-8d8f-60475b06e165-kube-api-access-6r945" (OuterVolumeSpecName: "kube-api-access-6r945") pod "415aa3db-46ce-4433-8d8f-60475b06e165" (UID: "415aa3db-46ce-4433-8d8f-60475b06e165"). InnerVolumeSpecName "kube-api-access-6r945". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:47:13.387848 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.387813    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-util" (OuterVolumeSpecName: "util") pod "415aa3db-46ce-4433-8d8f-60475b06e165" (UID: "415aa3db-46ce-4433-8d8f-60475b06e165"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:47:13.483714 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.483637    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r945\" (UniqueName: \"kubernetes.io/projected/415aa3db-46ce-4433-8d8f-60475b06e165-kube-api-access-6r945\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:13.483714 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.483666    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:13.483714 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:13.483678    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/415aa3db-46ce-4433-8d8f-60475b06e165-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:14.153426 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:14.153398    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr"
Jul 31 01:47:14.153426 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:14.153412    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgx4fr" event={"ID":"415aa3db-46ce-4433-8d8f-60475b06e165","Type":"ContainerDied","Data":"78cb223f8d7d8cbef90745ff7986e098e6741610d8e33f445103a33b5c7cddc4"}
Jul 31 01:47:14.153626 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:14.153451    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78cb223f8d7d8cbef90745ff7986e098e6741610d8e33f445103a33b5c7cddc4"
Jul 31 01:47:14.263994 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:14.263964    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb6fbb657-wkgsw"]
Jul 31 01:47:24.879131 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879049    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"]
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879366    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="util"
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879378    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="util"
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879392    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="pull"
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879398    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="pull"
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879404    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="extract"
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879410    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="extract"
Jul 31 01:47:24.879580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.879461    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="415aa3db-46ce-4433-8d8f-60475b06e165" containerName="extract"
Jul 31 01:47:24.882163 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.882145    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:24.884543 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.884524    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 01:47:24.884659 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.884641    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 01:47:24.884788 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.884772    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 01:47:24.885684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.885669    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 01:47:24.885741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.885675    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:47:24.885741 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.885765    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5st4h\""
Jul 31 01:47:24.893688 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:24.893663    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"]
Jul 31 01:47:25.074684 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.074642    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9m9\" (UniqueName: \"kubernetes.io/projected/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-kube-api-access-7b9m9\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.074863 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.074717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-cert\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.074863 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.074741    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-metrics-cert\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.074863 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.074831    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-manager-config\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.176115 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.176014    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-manager-config\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.176115 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.176065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9m9\" (UniqueName: \"kubernetes.io/projected/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-kube-api-access-7b9m9\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.176115 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.176113    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-cert\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.176392 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.176131    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-metrics-cert\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.176734 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.176708    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-manager-config\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.178760 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.178728    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-cert\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.178947 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.178912    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-metrics-cert\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.199032 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.199000    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9m9\" (UniqueName: \"kubernetes.io/projected/ac9b592c-5cff-4d9c-83ca-99e4a49aa517-kube-api-access-7b9m9\") pod \"lws-controller-manager-8657cf6695-svqxt\" (UID: \"ac9b592c-5cff-4d9c-83ca-99e4a49aa517\") " pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.496143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.496045    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:25.672443 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.672417    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"]
Jul 31 01:47:25.674690 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:47:25.674663    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9b592c_5cff_4d9c_83ca_99e4a49aa517.slice/crio-a352dc9c75d58b126761a1b02b3e6365595be0460e1a25a3dfa9af626f0f701d WatchSource:0}: Error finding container a352dc9c75d58b126761a1b02b3e6365595be0460e1a25a3dfa9af626f0f701d: Status 404 returned error can't find the container with id a352dc9c75d58b126761a1b02b3e6365595be0460e1a25a3dfa9af626f0f701d
Jul 31 01:47:25.970880 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.970844    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"]
Jul 31 01:47:25.980543 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.980515    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:25.982951 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.982928    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 01:47:25.983067 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.982974    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 01:47:25.983565 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.983551    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r7hfn\""
Jul 31 01:47:25.984324 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.984304    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 01:47:25.984408 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.984381    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 01:47:25.991124 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:25.991102    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"]
Jul 31 01:47:26.082922 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.082891    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e877e95f-3a9a-4d57-ac6d-266f328a53b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.083102 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.082973    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e877e95f-3a9a-4d57-ac6d-266f328a53b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.083102 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.083001    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6994h\" (UniqueName: \"kubernetes.io/projected/e877e95f-3a9a-4d57-ac6d-266f328a53b3-kube-api-access-6994h\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.083102 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.083029    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e877e95f-3a9a-4d57-ac6d-266f328a53b3-manifests\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.083102 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.083052    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e877e95f-3a9a-4d57-ac6d-266f328a53b3-tmp\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.183439 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.183403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e877e95f-3a9a-4d57-ac6d-266f328a53b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.183602 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.183475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e877e95f-3a9a-4d57-ac6d-266f328a53b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.183602 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.183504    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6994h\" (UniqueName: \"kubernetes.io/projected/e877e95f-3a9a-4d57-ac6d-266f328a53b3-kube-api-access-6994h\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.183602 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.183531    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e877e95f-3a9a-4d57-ac6d-266f328a53b3-manifests\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.183602 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.183556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e877e95f-3a9a-4d57-ac6d-266f328a53b3-tmp\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.184178 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.184127    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e877e95f-3a9a-4d57-ac6d-266f328a53b3-manifests\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.186090 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.186063    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e877e95f-3a9a-4d57-ac6d-266f328a53b3-tmp\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.186330 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.186313    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e877e95f-3a9a-4d57-ac6d-266f328a53b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.186415 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.186399    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e877e95f-3a9a-4d57-ac6d-266f328a53b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.191540 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.191522    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6994h\" (UniqueName: \"kubernetes.io/projected/e877e95f-3a9a-4d57-ac6d-266f328a53b3-kube-api-access-6994h\") pod \"opendatahub-operator-controller-manager-77df9dc58b-bgxps\" (UID: \"e877e95f-3a9a-4d57-ac6d-266f328a53b3\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.204599 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.204575    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt" event={"ID":"ac9b592c-5cff-4d9c-83ca-99e4a49aa517","Type":"ContainerStarted","Data":"a352dc9c75d58b126761a1b02b3e6365595be0460e1a25a3dfa9af626f0f701d"}
Jul 31 01:47:26.294451 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.294419    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:26.447803 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:26.447773    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"]
Jul 31 01:47:26.452202 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:47:26.452171    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode877e95f_3a9a_4d57_ac6d_266f328a53b3.slice/crio-70fe328adc2a0585d8577d0e35c6d5323729aa18330c8e93806def63428d3322 WatchSource:0}: Error finding container 70fe328adc2a0585d8577d0e35c6d5323729aa18330c8e93806def63428d3322: Status 404 returned error can't find the container with id 70fe328adc2a0585d8577d0e35c6d5323729aa18330c8e93806def63428d3322
Jul 31 01:47:27.213248 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:27.213212    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps" event={"ID":"e877e95f-3a9a-4d57-ac6d-266f328a53b3","Type":"ContainerStarted","Data":"70fe328adc2a0585d8577d0e35c6d5323729aa18330c8e93806def63428d3322"}
Jul 31 01:47:30.233585 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:30.233545    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps" event={"ID":"e877e95f-3a9a-4d57-ac6d-266f328a53b3","Type":"ContainerStarted","Data":"0f63097a189249f4f37f32240d9d44f09a7559c7027ee9d46bc02b8de32430c5"}
Jul 31 01:47:30.234986 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:30.234965    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt" event={"ID":"ac9b592c-5cff-4d9c-83ca-99e4a49aa517","Type":"ContainerStarted","Data":"c5d70370dc7f77fbc550efceb40bf31632949536de76c00588844ae52abae121"}
Jul 31 01:47:30.235111 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:30.235098    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:30.267323 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:30.267278    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt" podStartSLOduration=2.355394493 podStartE2EDuration="6.267261732s" totalImagesPullingTime="3.911867239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:30.266687471 +0000 UTC m=+629.903480211" watchObservedRunningTime="2026-07-31 01:47:30.267261732 +0000 UTC m=+629.904054430"
Jul 31 01:47:31.241472 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:31.241437    2555 generic.go:356] "Generic (PLEG): container finished" podID="e877e95f-3a9a-4d57-ac6d-266f328a53b3" containerID="0f63097a189249f4f37f32240d9d44f09a7559c7027ee9d46bc02b8de32430c5" exitCode=0
Jul 31 01:47:31.241972 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:31.241530    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps" event={"ID":"e877e95f-3a9a-4d57-ac6d-266f328a53b3","Type":"ContainerDied","Data":"0f63097a189249f4f37f32240d9d44f09a7559c7027ee9d46bc02b8de32430c5"}
Jul 31 01:47:32.248427 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:32.248388    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps" event={"ID":"e877e95f-3a9a-4d57-ac6d-266f328a53b3","Type":"ContainerStarted","Data":"46fe12f6564222c10713cc122a48262c5fe815418a3fc69f355b127fa70ef887"}
Jul 31 01:47:32.248866 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:32.248505    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:32.271633 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:32.271573    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps" podStartSLOduration=2.693256171 podStartE2EDuration="7.271559975s" totalImagesPullingTime="3.503451307s" totalInitContainerRuntime="1.074852497s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:32.269121012 +0000 UTC m=+631.905913733" watchObservedRunningTime="2026-07-31 01:47:32.271559975 +0000 UTC m=+631.908352695"
Jul 31 01:47:39.284001 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.283936    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bb6fbb657-wkgsw" podUID="0ac5e93d-4062-43b8-9354-dd006c29b02b" containerName="console" containerID="cri-o://a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e" gracePeriod=15
Jul 31 01:47:39.538509 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.538457    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:47:39.586366 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586343    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-service-ca\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586379    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-trusted-ca-bundle\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586406    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-config\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586532 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586428    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-oauth-config\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586689 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586542    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-serving-cert\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586689 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586574    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mswj\" (UniqueName: \"kubernetes.io/projected/0ac5e93d-4062-43b8-9354-dd006c29b02b-kube-api-access-7mswj\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586689 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586619    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-oauth-serving-cert\") pod \"0ac5e93d-4062-43b8-9354-dd006c29b02b\" (UID: \"0ac5e93d-4062-43b8-9354-dd006c29b02b\") "
Jul 31 01:47:39.586864 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586823    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:47:39.586864 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586850    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:47:39.586954 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.586862    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-config" (OuterVolumeSpecName: "console-config") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:47:39.587162 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.587141    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:47:39.588900 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.588869    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac5e93d-4062-43b8-9354-dd006c29b02b-kube-api-access-7mswj" (OuterVolumeSpecName: "kube-api-access-7mswj") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "kube-api-access-7mswj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:47:39.589276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.589258    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:47:39.589347 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.589278    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ac5e93d-4062-43b8-9354-dd006c29b02b" (UID: "0ac5e93d-4062-43b8-9354-dd006c29b02b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:47:39.687986 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.687955    2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-oauth-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:39.687986 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.687979    2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:39.687986 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.687988    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mswj\" (UniqueName: \"kubernetes.io/projected/0ac5e93d-4062-43b8-9354-dd006c29b02b-kube-api-access-7mswj\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:39.687986 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.687997    2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-oauth-serving-cert\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:39.688226 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.688007    2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:39.688226 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.688014    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-trusted-ca-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:39.688226 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:39.688022    2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ac5e93d-4062-43b8-9354-dd006c29b02b-console-config\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:47:40.285114 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.285079    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ac5e93d-4062-43b8-9354-dd006c29b02b" containerID="a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e" exitCode=0
Jul 31 01:47:40.285114 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.285116    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb6fbb657-wkgsw"
Jul 31 01:47:40.285614 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.285146    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb6fbb657-wkgsw" event={"ID":"0ac5e93d-4062-43b8-9354-dd006c29b02b","Type":"ContainerDied","Data":"a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e"}
Jul 31 01:47:40.285614 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.285193    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb6fbb657-wkgsw" event={"ID":"0ac5e93d-4062-43b8-9354-dd006c29b02b","Type":"ContainerDied","Data":"d9bbd96a344cc71075bb74b3ab9283e4d18bd8465fecca82397ca118aaff4147"}
Jul 31 01:47:40.285614 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.285222    2555 scope.go:117] "RemoveContainer" containerID="a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e"
Jul 31 01:47:40.294819 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.294802    2555 scope.go:117] "RemoveContainer" containerID="a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e"
Jul 31 01:47:40.295087 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:47:40.295061    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e\": container with ID starting with a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e not found: ID does not exist" containerID="a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e"
Jul 31 01:47:40.295143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.295087    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e"} err="failed to get container status \"a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e\": rpc error: code = NotFound desc = could not find container \"a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e\": container with ID starting with a0fd6fbce602320b0abd7e8f48744946f5beba6329976ef3a5d516752577779e not found: ID does not exist"
Jul 31 01:47:40.306474 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.306450    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb6fbb657-wkgsw"]
Jul 31 01:47:40.312678 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.312655    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bb6fbb657-wkgsw"]
Jul 31 01:47:40.925256 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:40.925223    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac5e93d-4062-43b8-9354-dd006c29b02b" path="/var/lib/kubelet/pods/0ac5e93d-4062-43b8-9354-dd006c29b02b/volumes"
Jul 31 01:47:41.243822 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:41.243731    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8657cf6695-svqxt"
Jul 31 01:47:43.255098 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:43.255071    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-bgxps"
Jul 31 01:47:51.605957 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.605924    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"]
Jul 31 01:47:51.606394 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.606233    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac5e93d-4062-43b8-9354-dd006c29b02b" containerName="console"
Jul 31 01:47:51.606394 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.606244    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac5e93d-4062-43b8-9354-dd006c29b02b" containerName="console"
Jul 31 01:47:51.606394 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.606302    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac5e93d-4062-43b8-9354-dd006c29b02b" containerName="console"
Jul 31 01:47:51.609326 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.609305    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.611796 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.611764    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 01:47:51.611796 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.611793    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 01:47:51.612653 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.612631    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bfkdz\""
Jul 31 01:47:51.612789 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.612700    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 01:47:51.612789 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.612717    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 01:47:51.622404 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.622380    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"]
Jul 31 01:47:51.689101 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.689065    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw4t9\" (UniqueName: \"kubernetes.io/projected/501cd197-6590-437c-86b2-215b1a9e3f82-kube-api-access-rw4t9\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.689289 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.689210    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501cd197-6590-437c-86b2-215b1a9e3f82-tls-certs\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.689289 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.689246    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501cd197-6590-437c-86b2-215b1a9e3f82-tmp\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.790399 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.790358    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501cd197-6590-437c-86b2-215b1a9e3f82-tls-certs\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.790655 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.790629    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501cd197-6590-437c-86b2-215b1a9e3f82-tmp\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.790814 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.790703    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw4t9\" (UniqueName: \"kubernetes.io/projected/501cd197-6590-437c-86b2-215b1a9e3f82-kube-api-access-rw4t9\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.793723 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.793658    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501cd197-6590-437c-86b2-215b1a9e3f82-tls-certs\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.793991 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.793954    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501cd197-6590-437c-86b2-215b1a9e3f82-tmp\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.804345 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.804320    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw4t9\" (UniqueName: \"kubernetes.io/projected/501cd197-6590-437c-86b2-215b1a9e3f82-kube-api-access-rw4t9\") pod \"kube-auth-proxy-647dc4ddc5-qbqg2\" (UID: \"501cd197-6590-437c-86b2-215b1a9e3f82\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:51.920045 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:51.919963    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"
Jul 31 01:47:52.066924 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:52.066893    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2"]
Jul 31 01:47:52.069298 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:47:52.069266    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501cd197_6590_437c_86b2_215b1a9e3f82.slice/crio-8a5e141cd22720c6b305704cacf6a313dfd874d5ced0db94aae2ced80643f3c0 WatchSource:0}: Error finding container 8a5e141cd22720c6b305704cacf6a313dfd874d5ced0db94aae2ced80643f3c0: Status 404 returned error can't find the container with id 8a5e141cd22720c6b305704cacf6a313dfd874d5ced0db94aae2ced80643f3c0
Jul 31 01:47:52.340528 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:52.340497    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2" event={"ID":"501cd197-6590-437c-86b2-215b1a9e3f82","Type":"ContainerStarted","Data":"8a5e141cd22720c6b305704cacf6a313dfd874d5ced0db94aae2ced80643f3c0"}
Jul 31 01:47:55.360225 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:55.360190    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2" event={"ID":"501cd197-6590-437c-86b2-215b1a9e3f82","Type":"ContainerStarted","Data":"d0b17543a81551a62dac363165f2775628f75ad9dc1fd77c2f00ed29f9001114"}
Jul 31 01:47:55.377626 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:47:55.377583    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-qbqg2" podStartSLOduration=1.710637131 podStartE2EDuration="4.377568027s" totalImagesPullingTime="2.666930896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:55.37548794 +0000 UTC m=+655.012280660" watchObservedRunningTime="2026-07-31 01:47:55.377568027 +0000 UTC m=+655.014360747"
Jul 31 01:48:50.436445 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.436408    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"]
Jul 31 01:48:50.440273 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.440257    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.442864 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.442834    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6p88\""
Jul 31 01:48:50.442864 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.442843    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 01:48:50.443546 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.443531    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 01:48:50.447430 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.447401    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"]
Jul 31 01:48:50.533837 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.533800    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"]
Jul 31 01:48:50.537521 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.537505    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.544937 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.544903    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"]
Jul 31 01:48:50.555610 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.555589    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.555714 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.555619    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.555714 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.555652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwfsr\" (UniqueName: \"kubernetes.io/projected/8015d559-e853-470e-bef9-84bfc0e91bd1-kube-api-access-bwfsr\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.635629 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.635595    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"]
Jul 31 01:48:50.639278 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.639262    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.647432 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.647411    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"]
Jul 31 01:48:50.656126 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/845ab7d5-d1f0-428f-b703-d11bedd1e223-kube-api-access-7kckk\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.656238 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656132    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.656238 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656162    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.656238 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656203    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.656379 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.656379 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656311    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfsr\" (UniqueName: \"kubernetes.io/projected/8015d559-e853-470e-bef9-84bfc0e91bd1-kube-api-access-bwfsr\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.656623 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656602    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.656660 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.656627    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.663783 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.663767    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwfsr\" (UniqueName: \"kubernetes.io/projected/8015d559-e853-470e-bef9-84bfc0e91bd1-kube-api-access-bwfsr\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.734634 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.734547    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"]
Jul 31 01:48:50.738559 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.738537    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.747089 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.747065    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"]
Jul 31 01:48:50.750424 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.750402    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:50.757167 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757137    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxnfq\" (UniqueName: \"kubernetes.io/projected/a8fabbfe-925a-4595-9762-5a80b9d548aa-kube-api-access-hxnfq\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.757277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/845ab7d5-d1f0-428f-b703-d11bedd1e223-kube-api-access-7kckk\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.757277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.757277 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757257    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.757481 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757286    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.757481 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757317    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.757632 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757607    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.757783 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.757742    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.767408 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.767380    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/845ab7d5-d1f0-428f-b703-d11bedd1e223-kube-api-access-7kckk\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.848097 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.848063    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:50.857947 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.857866    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxnfq\" (UniqueName: \"kubernetes.io/projected/a8fabbfe-925a-4595-9762-5a80b9d548aa-kube-api-access-hxnfq\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.857947 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.857941    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.858131 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.857977    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.858131 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.858006    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.858131 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.858055    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.858131 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.858082    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n2lm\" (UniqueName: \"kubernetes.io/projected/a638ceee-b619-41aa-b9fc-289bcc44ff8a-kube-api-access-8n2lm\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.858821 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.858795    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.859083 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.859050    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.868522 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.868470    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxnfq\" (UniqueName: \"kubernetes.io/projected/a8fabbfe-925a-4595-9762-5a80b9d548aa-kube-api-access-hxnfq\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.891799 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.891725    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"]
Jul 31 01:48:50.894518 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:48:50.894489    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8015d559_e853_470e_bef9_84bfc0e91bd1.slice/crio-6220f67f07d8ab5d358b137a26c7ea3b7e2e3c9340924b6a66b3a64723f2def0 WatchSource:0}: Error finding container 6220f67f07d8ab5d358b137a26c7ea3b7e2e3c9340924b6a66b3a64723f2def0: Status 404 returned error can't find the container with id 6220f67f07d8ab5d358b137a26c7ea3b7e2e3c9340924b6a66b3a64723f2def0
Jul 31 01:48:50.949299 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.949273    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:50.958787 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.958737    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.958958 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.958937    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.959122 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.959097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n2lm\" (UniqueName: \"kubernetes.io/projected/a638ceee-b619-41aa-b9fc-289bcc44ff8a-kube-api-access-8n2lm\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.959266 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.959162    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.959442 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.959413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:50.971986 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:50.971960    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n2lm\" (UniqueName: \"kubernetes.io/projected/a638ceee-b619-41aa-b9fc-289bcc44ff8a-kube-api-access-8n2lm\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:51.005603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.005479    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"]
Jul 31 01:48:51.008022 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:48:51.007990    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845ab7d5_d1f0_428f_b703_d11bedd1e223.slice/crio-9da682c77d2fb1f6369ef488b353501f11b3f51fcfa8319289ea1e4122fb0298 WatchSource:0}: Error finding container 9da682c77d2fb1f6369ef488b353501f11b3f51fcfa8319289ea1e4122fb0298: Status 404 returned error can't find the container with id 9da682c77d2fb1f6369ef488b353501f11b3f51fcfa8319289ea1e4122fb0298
Jul 31 01:48:51.049246 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.049217    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:51.104031 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.103926    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"]
Jul 31 01:48:51.107936 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:48:51.107908    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fabbfe_925a_4595_9762_5a80b9d548aa.slice/crio-d5f70b6f70db83a42dea9453878ef37f7953bceaae33536e60f093e2dfc27666 WatchSource:0}: Error finding container d5f70b6f70db83a42dea9453878ef37f7953bceaae33536e60f093e2dfc27666: Status 404 returned error can't find the container with id d5f70b6f70db83a42dea9453878ef37f7953bceaae33536e60f093e2dfc27666
Jul 31 01:48:51.201380 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.201356    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"]
Jul 31 01:48:51.204083 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:48:51.204055    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda638ceee_b619_41aa_b9fc_289bcc44ff8a.slice/crio-168313f346ab2af95eeb063094777dfe379de1d32ed7a5ba96194d9422ea4728 WatchSource:0}: Error finding container 168313f346ab2af95eeb063094777dfe379de1d32ed7a5ba96194d9422ea4728: Status 404 returned error can't find the container with id 168313f346ab2af95eeb063094777dfe379de1d32ed7a5ba96194d9422ea4728
Jul 31 01:48:51.630839 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.630733    2555 generic.go:356] "Generic (PLEG): container finished" podID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerID="6240f5652624184bc6782a0544d218518c25224fcfc72d45aff01b4078697ee4" exitCode=0
Jul 31 01:48:51.631271 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.630828    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76" event={"ID":"a638ceee-b619-41aa-b9fc-289bcc44ff8a","Type":"ContainerDied","Data":"6240f5652624184bc6782a0544d218518c25224fcfc72d45aff01b4078697ee4"}
Jul 31 01:48:51.631271 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.630887    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76" event={"ID":"a638ceee-b619-41aa-b9fc-289bcc44ff8a","Type":"ContainerStarted","Data":"168313f346ab2af95eeb063094777dfe379de1d32ed7a5ba96194d9422ea4728"}
Jul 31 01:48:51.631999 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.631981    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:48:51.632433 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.632410    2555 generic.go:356] "Generic (PLEG): container finished" podID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerID="6274eee10846d2ebfec8eee65080c4e2046413f97f3770d3f6d8dc568fb08ff1" exitCode=0
Jul 31 01:48:51.632522 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.632495    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb" event={"ID":"8015d559-e853-470e-bef9-84bfc0e91bd1","Type":"ContainerDied","Data":"6274eee10846d2ebfec8eee65080c4e2046413f97f3770d3f6d8dc568fb08ff1"}
Jul 31 01:48:51.632622 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.632545    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb" event={"ID":"8015d559-e853-470e-bef9-84bfc0e91bd1","Type":"ContainerStarted","Data":"6220f67f07d8ab5d358b137a26c7ea3b7e2e3c9340924b6a66b3a64723f2def0"}
Jul 31 01:48:51.634068 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.634052    2555 generic.go:356] "Generic (PLEG): container finished" podID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerID="b6c186a8511be60af0c9dd3d226569a260a3704d6986d8a59648891aaee2f15d" exitCode=0
Jul 31 01:48:51.634124 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.634112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj" event={"ID":"a8fabbfe-925a-4595-9762-5a80b9d548aa","Type":"ContainerDied","Data":"b6c186a8511be60af0c9dd3d226569a260a3704d6986d8a59648891aaee2f15d"}
Jul 31 01:48:51.634165 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.634152    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj" event={"ID":"a8fabbfe-925a-4595-9762-5a80b9d548aa","Type":"ContainerStarted","Data":"d5f70b6f70db83a42dea9453878ef37f7953bceaae33536e60f093e2dfc27666"}
Jul 31 01:48:51.635872 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.635850    2555 generic.go:356] "Generic (PLEG): container finished" podID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerID="af3e44d410f3f20828fb8b994791f831f13c783c2f79abf5491628f22ff7c648" exitCode=0
Jul 31 01:48:51.635966 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.635892    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc" event={"ID":"845ab7d5-d1f0-428f-b703-d11bedd1e223","Type":"ContainerDied","Data":"af3e44d410f3f20828fb8b994791f831f13c783c2f79abf5491628f22ff7c648"}
Jul 31 01:48:51.635966 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:51.635927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc" event={"ID":"845ab7d5-d1f0-428f-b703-d11bedd1e223","Type":"ContainerStarted","Data":"9da682c77d2fb1f6369ef488b353501f11b3f51fcfa8319289ea1e4122fb0298"}
Jul 31 01:48:53.645992 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.645962    2555 generic.go:356] "Generic (PLEG): container finished" podID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerID="0f445959e2ab478e3fbc384dbc375a91fec6d38db54f7ba078cb1ae3842dee16" exitCode=0
Jul 31 01:48:53.646431 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.646061    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76" event={"ID":"a638ceee-b619-41aa-b9fc-289bcc44ff8a","Type":"ContainerDied","Data":"0f445959e2ab478e3fbc384dbc375a91fec6d38db54f7ba078cb1ae3842dee16"}
Jul 31 01:48:53.647885 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.647863    2555 generic.go:356] "Generic (PLEG): container finished" podID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerID="35638869345dd544eb44934d42f5d6f84702b253f5afa3537ed6a4d0ff1d14d6" exitCode=0
Jul 31 01:48:53.648005 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.647946    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb" event={"ID":"8015d559-e853-470e-bef9-84bfc0e91bd1","Type":"ContainerDied","Data":"35638869345dd544eb44934d42f5d6f84702b253f5afa3537ed6a4d0ff1d14d6"}
Jul 31 01:48:53.649790 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.649769    2555 generic.go:356] "Generic (PLEG): container finished" podID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerID="cd9009cbcf893dfc4fd89ca40a22f7adfd22bffe315241808d0b49aeb0497109" exitCode=0
Jul 31 01:48:53.649877 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.649841    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj" event={"ID":"a8fabbfe-925a-4595-9762-5a80b9d548aa","Type":"ContainerDied","Data":"cd9009cbcf893dfc4fd89ca40a22f7adfd22bffe315241808d0b49aeb0497109"}
Jul 31 01:48:53.651740 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.651719    2555 generic.go:356] "Generic (PLEG): container finished" podID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerID="676d10823b8d23480f30c36c8053d5f3e2c0aaf408cce744284b11b10e094f8e" exitCode=0
Jul 31 01:48:53.651841 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:53.651776    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc" event={"ID":"845ab7d5-d1f0-428f-b703-d11bedd1e223","Type":"ContainerDied","Data":"676d10823b8d23480f30c36c8053d5f3e2c0aaf408cce744284b11b10e094f8e"}
Jul 31 01:48:54.661134 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.661100    2555 generic.go:356] "Generic (PLEG): container finished" podID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerID="a2af1d809eaefefd96645d43f3c249dd67d0c637bc14d1305d2ca40b11c9abe1" exitCode=0
Jul 31 01:48:54.661577 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.661192    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76" event={"ID":"a638ceee-b619-41aa-b9fc-289bcc44ff8a","Type":"ContainerDied","Data":"a2af1d809eaefefd96645d43f3c249dd67d0c637bc14d1305d2ca40b11c9abe1"}
Jul 31 01:48:54.663236 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.663217    2555 generic.go:356] "Generic (PLEG): container finished" podID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerID="82b4fb5a28259cc320c2934f2aa87e1778e6ca725c22371fa8a00e8aacfe7dd4" exitCode=0
Jul 31 01:48:54.663353 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.663304    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb" event={"ID":"8015d559-e853-470e-bef9-84bfc0e91bd1","Type":"ContainerDied","Data":"82b4fb5a28259cc320c2934f2aa87e1778e6ca725c22371fa8a00e8aacfe7dd4"}
Jul 31 01:48:54.665267 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.665244    2555 generic.go:356] "Generic (PLEG): container finished" podID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerID="6c0b74c6d98530b3acbe166b5770e9d9f52e3e5d0d400a05f1e26da24257cb7c" exitCode=0
Jul 31 01:48:54.665346 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.665279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj" event={"ID":"a8fabbfe-925a-4595-9762-5a80b9d548aa","Type":"ContainerDied","Data":"6c0b74c6d98530b3acbe166b5770e9d9f52e3e5d0d400a05f1e26da24257cb7c"}
Jul 31 01:48:54.667205 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.667182    2555 generic.go:356] "Generic (PLEG): container finished" podID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerID="7b25ce2dce9ba787d3ff9b8cb570182ba80ceef8bd490094a98a027a125d624f" exitCode=0
Jul 31 01:48:54.667290 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:54.667225    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc" event={"ID":"845ab7d5-d1f0-428f-b703-d11bedd1e223","Type":"ContainerDied","Data":"7b25ce2dce9ba787d3ff9b8cb570182ba80ceef8bd490094a98a027a125d624f"}
Jul 31 01:48:55.846731 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.846460    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:55.884409 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.884387    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:48:55.887726 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.887709    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:55.890856 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.890838    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:55.900024 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.900003    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-util\") pod \"a8fabbfe-925a-4595-9762-5a80b9d548aa\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") "
Jul 31 01:48:55.900119 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.900059    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxnfq\" (UniqueName: \"kubernetes.io/projected/a8fabbfe-925a-4595-9762-5a80b9d548aa-kube-api-access-hxnfq\") pod \"a8fabbfe-925a-4595-9762-5a80b9d548aa\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") "
Jul 31 01:48:55.900180 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.900130    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-bundle\") pod \"a8fabbfe-925a-4595-9762-5a80b9d548aa\" (UID: \"a8fabbfe-925a-4595-9762-5a80b9d548aa\") "
Jul 31 01:48:55.900511 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.900478    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-bundle" (OuterVolumeSpecName: "bundle") pod "a8fabbfe-925a-4595-9762-5a80b9d548aa" (UID: "a8fabbfe-925a-4595-9762-5a80b9d548aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:55.902520 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.902497    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8fabbfe-925a-4595-9762-5a80b9d548aa-kube-api-access-hxnfq" (OuterVolumeSpecName: "kube-api-access-hxnfq") pod "a8fabbfe-925a-4595-9762-5a80b9d548aa" (UID: "a8fabbfe-925a-4595-9762-5a80b9d548aa"). InnerVolumeSpecName "kube-api-access-hxnfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:48:55.906616 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:55.906591    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-util" (OuterVolumeSpecName: "util") pod "a8fabbfe-925a-4595-9762-5a80b9d548aa" (UID: "a8fabbfe-925a-4595-9762-5a80b9d548aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.001308 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001235    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-bundle\") pod \"8015d559-e853-470e-bef9-84bfc0e91bd1\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") "
Jul 31 01:48:56.001308 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001286    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwfsr\" (UniqueName: \"kubernetes.io/projected/8015d559-e853-470e-bef9-84bfc0e91bd1-kube-api-access-bwfsr\") pod \"8015d559-e853-470e-bef9-84bfc0e91bd1\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") "
Jul 31 01:48:56.001308 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001301    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-bundle\") pod \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") "
Jul 31 01:48:56.001557 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001330    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/845ab7d5-d1f0-428f-b703-d11bedd1e223-kube-api-access-7kckk\") pod \"845ab7d5-d1f0-428f-b703-d11bedd1e223\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") "
Jul 31 01:48:56.001557 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001351    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-bundle\") pod \"845ab7d5-d1f0-428f-b703-d11bedd1e223\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") "
Jul 31 01:48:56.001557 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001382    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-util\") pod \"845ab7d5-d1f0-428f-b703-d11bedd1e223\" (UID: \"845ab7d5-d1f0-428f-b703-d11bedd1e223\") "
Jul 31 01:48:56.001557 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001406    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-util\") pod \"8015d559-e853-470e-bef9-84bfc0e91bd1\" (UID: \"8015d559-e853-470e-bef9-84bfc0e91bd1\") "
Jul 31 01:48:56.001557 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001449    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-util\") pod \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") "
Jul 31 01:48:56.001557 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001493    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n2lm\" (UniqueName: \"kubernetes.io/projected/a638ceee-b619-41aa-b9fc-289bcc44ff8a-kube-api-access-8n2lm\") pod \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\" (UID: \"a638ceee-b619-41aa-b9fc-289bcc44ff8a\") "
Jul 31 01:48:56.001904 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001792    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.001904 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001810    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8fabbfe-925a-4595-9762-5a80b9d548aa-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.001904 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001825    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxnfq\" (UniqueName: \"kubernetes.io/projected/a8fabbfe-925a-4595-9762-5a80b9d548aa-kube-api-access-hxnfq\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.002170 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.002145    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-bundle" (OuterVolumeSpecName: "bundle") pod "845ab7d5-d1f0-428f-b703-d11bedd1e223" (UID: "845ab7d5-d1f0-428f-b703-d11bedd1e223"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.002347 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.001971    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-bundle" (OuterVolumeSpecName: "bundle") pod "8015d559-e853-470e-bef9-84bfc0e91bd1" (UID: "8015d559-e853-470e-bef9-84bfc0e91bd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.002997 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.002929    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-bundle" (OuterVolumeSpecName: "bundle") pod "a638ceee-b619-41aa-b9fc-289bcc44ff8a" (UID: "a638ceee-b619-41aa-b9fc-289bcc44ff8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.004040 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.004018    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845ab7d5-d1f0-428f-b703-d11bedd1e223-kube-api-access-7kckk" (OuterVolumeSpecName: "kube-api-access-7kckk") pod "845ab7d5-d1f0-428f-b703-d11bedd1e223" (UID: "845ab7d5-d1f0-428f-b703-d11bedd1e223"). InnerVolumeSpecName "kube-api-access-7kckk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:48:56.004571 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.004544    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a638ceee-b619-41aa-b9fc-289bcc44ff8a-kube-api-access-8n2lm" (OuterVolumeSpecName: "kube-api-access-8n2lm") pod "a638ceee-b619-41aa-b9fc-289bcc44ff8a" (UID: "a638ceee-b619-41aa-b9fc-289bcc44ff8a"). InnerVolumeSpecName "kube-api-access-8n2lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:48:56.004571 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.004550    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8015d559-e853-470e-bef9-84bfc0e91bd1-kube-api-access-bwfsr" (OuterVolumeSpecName: "kube-api-access-bwfsr") pod "8015d559-e853-470e-bef9-84bfc0e91bd1" (UID: "8015d559-e853-470e-bef9-84bfc0e91bd1"). InnerVolumeSpecName "kube-api-access-bwfsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:48:56.008965 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.008946    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-util" (OuterVolumeSpecName: "util") pod "a638ceee-b619-41aa-b9fc-289bcc44ff8a" (UID: "a638ceee-b619-41aa-b9fc-289bcc44ff8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.010619 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.010589    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-util" (OuterVolumeSpecName: "util") pod "845ab7d5-d1f0-428f-b703-d11bedd1e223" (UID: "845ab7d5-d1f0-428f-b703-d11bedd1e223"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.010892 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.010872    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-util" (OuterVolumeSpecName: "util") pod "8015d559-e853-470e-bef9-84bfc0e91bd1" (UID: "8015d559-e853-470e-bef9-84bfc0e91bd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:56.102802 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102767    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.102802 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102797    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n2lm\" (UniqueName: \"kubernetes.io/projected/a638ceee-b619-41aa-b9fc-289bcc44ff8a-kube-api-access-8n2lm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.102802 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102808    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.103017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102816    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwfsr\" (UniqueName: \"kubernetes.io/projected/8015d559-e853-470e-bef9-84bfc0e91bd1-kube-api-access-bwfsr\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.103017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102825    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a638ceee-b619-41aa-b9fc-289bcc44ff8a-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.103017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102833    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kckk\" (UniqueName: \"kubernetes.io/projected/845ab7d5-d1f0-428f-b703-d11bedd1e223-kube-api-access-7kckk\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.103017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102841    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-bundle\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.103017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102850    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845ab7d5-d1f0-428f-b703-d11bedd1e223-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.103017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.102857    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8015d559-e853-470e-bef9-84bfc0e91bd1-util\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 01:48:56.678560 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.678534    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj"
Jul 31 01:48:56.678560 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.678533    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nf6zj" event={"ID":"a8fabbfe-925a-4595-9762-5a80b9d548aa","Type":"ContainerDied","Data":"d5f70b6f70db83a42dea9453878ef37f7953bceaae33536e60f093e2dfc27666"}
Jul 31 01:48:56.678839 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.678600    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5f70b6f70db83a42dea9453878ef37f7953bceaae33536e60f093e2dfc27666"
Jul 31 01:48:56.680424 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.680405    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc"
Jul 31 01:48:56.680424 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.680413    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wfgjc" event={"ID":"845ab7d5-d1f0-428f-b703-d11bedd1e223","Type":"ContainerDied","Data":"9da682c77d2fb1f6369ef488b353501f11b3f51fcfa8319289ea1e4122fb0298"}
Jul 31 01:48:56.680604 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.680450    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9da682c77d2fb1f6369ef488b353501f11b3f51fcfa8319289ea1e4122fb0298"
Jul 31 01:48:56.682530 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.682511    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76"
Jul 31 01:48:56.682633 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.682546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ch2j76" event={"ID":"a638ceee-b619-41aa-b9fc-289bcc44ff8a","Type":"ContainerDied","Data":"168313f346ab2af95eeb063094777dfe379de1d32ed7a5ba96194d9422ea4728"}
Jul 31 01:48:56.682633 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.682590    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="168313f346ab2af95eeb063094777dfe379de1d32ed7a5ba96194d9422ea4728"
Jul 31 01:48:56.684572 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.684553    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb" event={"ID":"8015d559-e853-470e-bef9-84bfc0e91bd1","Type":"ContainerDied","Data":"6220f67f07d8ab5d358b137a26c7ea3b7e2e3c9340924b6a66b3a64723f2def0"}
Jul 31 01:48:56.684674 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.684589    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6220f67f07d8ab5d358b137a26c7ea3b7e2e3c9340924b6a66b3a64723f2def0"
Jul 31 01:48:56.684674 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:48:56.684607    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbj86vb"
Jul 31 01:49:10.507081 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507047    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"]
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507385    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="util"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507398    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="util"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507409    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="extract"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507414    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="extract"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507426    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="pull"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507431    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="pull"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507437    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="extract"
Jul 31 01:49:10.507444 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507443    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507451    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="pull"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507456    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="pull"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507462    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="pull"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507467    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="pull"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507474    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="util"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507479    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="util"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507484    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="util"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507489    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="util"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507496    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="util"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507501    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="util"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507508    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="pull"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507512    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="pull"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507527    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507531    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507537    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507542    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507610    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8fabbfe-925a-4595-9762-5a80b9d548aa" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507617    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a638ceee-b619-41aa-b9fc-289bcc44ff8a" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507625    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8015d559-e853-470e-bef9-84bfc0e91bd1" containerName="extract"
Jul 31 01:49:10.507693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.507631    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="845ab7d5-d1f0-428f-b703-d11bedd1e223" containerName="extract"
Jul 31 01:49:10.511568 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.511552    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:10.514188 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.514169    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 01:49:10.514302 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.514187    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 31 01:49:10.515034 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.515018    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kfkl6\""
Jul 31 01:49:10.515096 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.515020    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 01:49:10.523941 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.523920    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"]
Jul 31 01:49:10.621971 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.621940    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2c5v\" (UniqueName: \"kubernetes.io/projected/9a1e9154-e7df-428d-9650-6dee626d8001-kube-api-access-c2c5v\") pod \"dns-operator-controller-manager-5985564776-xtrlw\" (UID: \"9a1e9154-e7df-428d-9650-6dee626d8001\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:10.722380 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.722345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2c5v\" (UniqueName: \"kubernetes.io/projected/9a1e9154-e7df-428d-9650-6dee626d8001-kube-api-access-c2c5v\") pod \"dns-operator-controller-manager-5985564776-xtrlw\" (UID: \"9a1e9154-e7df-428d-9650-6dee626d8001\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:10.738213 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.738186    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2c5v\" (UniqueName: \"kubernetes.io/projected/9a1e9154-e7df-428d-9650-6dee626d8001-kube-api-access-c2c5v\") pod \"dns-operator-controller-manager-5985564776-xtrlw\" (UID: \"9a1e9154-e7df-428d-9650-6dee626d8001\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:10.822982 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.822936    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:10.959422 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:10.959393    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"]
Jul 31 01:49:10.961478 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:49:10.961451    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1e9154_e7df_428d_9650_6dee626d8001.slice/crio-ac00d9f8485f98aa6a7e2ce8d04373c9da032d181751f812ff7c0db81eb522cb WatchSource:0}: Error finding container ac00d9f8485f98aa6a7e2ce8d04373c9da032d181751f812ff7c0db81eb522cb: Status 404 returned error can't find the container with id ac00d9f8485f98aa6a7e2ce8d04373c9da032d181751f812ff7c0db81eb522cb
Jul 31 01:49:11.757276 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:11.757239    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw" event={"ID":"9a1e9154-e7df-428d-9650-6dee626d8001","Type":"ContainerStarted","Data":"ac00d9f8485f98aa6a7e2ce8d04373c9da032d181751f812ff7c0db81eb522cb"}
Jul 31 01:49:12.298065 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.298028    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"]
Jul 31 01:49:12.302150 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.302123    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.304577 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.304551    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 31 01:49:12.304721 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.304658    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kp5l8\""
Jul 31 01:49:12.304902 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.304881    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 31 01:49:12.309666 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.309620    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"]
Jul 31 01:49:12.438403 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.438366    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkj6f\" (UniqueName: \"kubernetes.io/projected/da0ea522-3f73-4662-b9fa-5d2284e43457-kube-api-access-jkj6f\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.438606 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.438407    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0ea522-3f73-4662-b9fa-5d2284e43457-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.438606 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.438478    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da0ea522-3f73-4662-b9fa-5d2284e43457-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.539823 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.539764    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da0ea522-3f73-4662-b9fa-5d2284e43457-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.540020 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.539894    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkj6f\" (UniqueName: \"kubernetes.io/projected/da0ea522-3f73-4662-b9fa-5d2284e43457-kube-api-access-jkj6f\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.540020 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.539928    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0ea522-3f73-4662-b9fa-5d2284e43457-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.540159 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:49:12.540081    2555 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 31 01:49:12.540228 ip-10-0-140-87 kubenswrapper[2555]: E0731 01:49:12.540174    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da0ea522-3f73-4662-b9fa-5d2284e43457-plugin-serving-cert podName:da0ea522-3f73-4662-b9fa-5d2284e43457 nodeName:}" failed. No retries permitted until 2026-07-31 01:49:13.040152196 +0000 UTC m=+732.676944898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/da0ea522-3f73-4662-b9fa-5d2284e43457-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-9gzpf" (UID: "da0ea522-3f73-4662-b9fa-5d2284e43457") : secret "plugin-serving-cert" not found
Jul 31 01:49:12.540509 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.540480    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da0ea522-3f73-4662-b9fa-5d2284e43457-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:12.549282 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:12.549193    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkj6f\" (UniqueName: \"kubernetes.io/projected/da0ea522-3f73-4662-b9fa-5d2284e43457-kube-api-access-jkj6f\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:13.044988 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:13.044511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0ea522-3f73-4662-b9fa-5d2284e43457-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:13.047598 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:13.047557    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0ea522-3f73-4662-b9fa-5d2284e43457-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-9gzpf\" (UID: \"da0ea522-3f73-4662-b9fa-5d2284e43457\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:13.218073 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:13.218034    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"
Jul 31 01:49:13.853951 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:13.853928    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf"]
Jul 31 01:49:13.855728 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:49:13.855704    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda0ea522_3f73_4662_b9fa_5d2284e43457.slice/crio-b021d6c9eaf9c95469121b74a1e667c49868e203b1cab8df60f027f3e04d8075 WatchSource:0}: Error finding container b021d6c9eaf9c95469121b74a1e667c49868e203b1cab8df60f027f3e04d8075: Status 404 returned error can't find the container with id b021d6c9eaf9c95469121b74a1e667c49868e203b1cab8df60f027f3e04d8075
Jul 31 01:49:14.774469 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:14.774436    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf" event={"ID":"da0ea522-3f73-4662-b9fa-5d2284e43457","Type":"ContainerStarted","Data":"b021d6c9eaf9c95469121b74a1e667c49868e203b1cab8df60f027f3e04d8075"}
Jul 31 01:49:14.776116 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:14.776097    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw" event={"ID":"9a1e9154-e7df-428d-9650-6dee626d8001","Type":"ContainerStarted","Data":"0d5da3ba87d3b0267544068d6a2be6c8841e4ae06b467f6873c1731503f9a987"}
Jul 31 01:49:14.776226 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:14.776206    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:14.810426 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:14.810380    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw" podStartSLOduration=1.977172245 podStartE2EDuration="4.810367657s" totalImagesPullingTime="2.833195412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:14.808851192 +0000 UTC m=+734.445643933" watchObservedRunningTime="2026-07-31 01:49:14.810367657 +0000 UTC m=+734.447160380"
Jul 31 01:49:22.817051 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:22.817013    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf" event={"ID":"da0ea522-3f73-4662-b9fa-5d2284e43457","Type":"ContainerStarted","Data":"a1b16bf0a96bcce140d6e1f80ce170397da3c15c325e8cdb741dc8d2f33b47d1"}
Jul 31 01:49:22.834693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:22.834645    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-9gzpf" podStartSLOduration=2.498574828 podStartE2EDuration="10.834629581s" totalImagesPullingTime="8.336054753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:22.83339643 +0000 UTC m=+742.470189151" watchObservedRunningTime="2026-07-31 01:49:22.834629581 +0000 UTC m=+742.471422300"
Jul 31 01:49:25.782455 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:25.782428    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xtrlw"
Jul 31 01:49:53.476770 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.476712    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:49:53.486429 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.486397    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.486989 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.486963    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:49:53.488924 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.488899    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 31 01:49:53.515101 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.515076    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:49:53.566399 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.566375    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e0a5e7d0-575d-4e85-8b97-1f70c4072c2d-config-file\") pod \"limitador-limitador-85d9db4d5d-z52jl\" (UID: \"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.566502 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.566441    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/e0a5e7d0-575d-4e85-8b97-1f70c4072c2d-kube-api-access-rt6mh\") pod \"limitador-limitador-85d9db4d5d-z52jl\" (UID: \"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.667666 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.667636    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/e0a5e7d0-575d-4e85-8b97-1f70c4072c2d-kube-api-access-rt6mh\") pod \"limitador-limitador-85d9db4d5d-z52jl\" (UID: \"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.667805 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.667691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e0a5e7d0-575d-4e85-8b97-1f70c4072c2d-config-file\") pod \"limitador-limitador-85d9db4d5d-z52jl\" (UID: \"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.668287 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.668270    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e0a5e7d0-575d-4e85-8b97-1f70c4072c2d-config-file\") pod \"limitador-limitador-85d9db4d5d-z52jl\" (UID: \"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.675319 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.675299    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/e0a5e7d0-575d-4e85-8b97-1f70c4072c2d-kube-api-access-rt6mh\") pod \"limitador-limitador-85d9db4d5d-z52jl\" (UID: \"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.796967 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.796938    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:53.942710 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.942684    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:49:53.944354 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:49:53.944327    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a5e7d0_575d_4e85_8b97_1f70c4072c2d.slice/crio-9f872fcf7af693f988d43989d623f7aa30451281c5766bef03efbcd63b655529 WatchSource:0}: Error finding container 9f872fcf7af693f988d43989d623f7aa30451281c5766bef03efbcd63b655529: Status 404 returned error can't find the container with id 9f872fcf7af693f988d43989d623f7aa30451281c5766bef03efbcd63b655529
Jul 31 01:49:53.977143 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:53.977115    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl" event={"ID":"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d","Type":"ContainerStarted","Data":"9f872fcf7af693f988d43989d623f7aa30451281c5766bef03efbcd63b655529"}
Jul 31 01:49:56.992669 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:56.992635    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl" event={"ID":"e0a5e7d0-575d-4e85-8b97-1f70c4072c2d","Type":"ContainerStarted","Data":"c904efc2415ef33a5d06c1b4dca9a1c14b6ec97bc9f16e9703a9b3aa8e0326d3"}
Jul 31 01:49:56.993053 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:56.992720    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:49:57.010560 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:49:57.010518    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl" podStartSLOduration=2.003781997 podStartE2EDuration="4.01050602s" totalImagesPullingTime="2.006724023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:57.0084123 +0000 UTC m=+776.645205022" watchObservedRunningTime="2026-07-31 01:49:57.01050602 +0000 UTC m=+776.647298756"
Jul 31 01:50:07.998503 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:50:07.998469    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"
Jul 31 01:51:13.136796 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:51:13.136767    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:51:36.283876 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:51:36.283839    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:51:53.587693 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:51:53.587621    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:52:00.842614 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:00.842587    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:52:00.843041 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:00.842918    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:52:15.486501 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:15.486467    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:52:25.192849 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.192814    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"]
Jul 31 01:52:25.196123 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.196105    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.198580 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.198558    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 01:52:25.199603 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.199582    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4vc5j\""
Jul 31 01:52:25.199717 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.199660    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 31 01:52:25.199824 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.199717    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 01:52:25.207205 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.207179    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"]
Jul 31 01:52:25.304295 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.304259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.304295 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.304299    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0d320a0-5609-496f-b825-e2feb7e8ee3e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.304510 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.304320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.304510 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.304401    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.304510 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.304430    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6dhj\" (UniqueName: \"kubernetes.io/projected/a0d320a0-5609-496f-b825-e2feb7e8ee3e-kube-api-access-h6dhj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.304510 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.304451    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405119 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405083    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405283 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405145    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405283 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405173    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6dhj\" (UniqueName: \"kubernetes.io/projected/a0d320a0-5609-496f-b825-e2feb7e8ee3e-kube-api-access-h6dhj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405283 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405199    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405422 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405401    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405476 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0d320a0-5609-496f-b825-e2feb7e8ee3e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405604 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405580    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405676 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405612    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.405738 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.405706    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.407475 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.407458    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0d320a0-5609-496f-b825-e2feb7e8ee3e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.407999 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.407980    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0d320a0-5609-496f-b825-e2feb7e8ee3e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.413337 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.413319    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6dhj\" (UniqueName: \"kubernetes.io/projected/a0d320a0-5609-496f-b825-e2feb7e8ee3e-kube-api-access-h6dhj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv\" (UID: \"a0d320a0-5609-496f-b825-e2feb7e8ee3e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.508184 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.508100    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:25.639546 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.639489    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"]
Jul 31 01:52:25.641793 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:52:25.641767    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d320a0_5609_496f_b825_e2feb7e8ee3e.slice/crio-4b6c0974d9d50e0d51868c9db26d0003bf9f06ce1eba59badffc1127f0e5bc19 WatchSource:0}: Error finding container 4b6c0974d9d50e0d51868c9db26d0003bf9f06ce1eba59badffc1127f0e5bc19: Status 404 returned error can't find the container with id 4b6c0974d9d50e0d51868c9db26d0003bf9f06ce1eba59badffc1127f0e5bc19
Jul 31 01:52:25.732890 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:25.732856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv" event={"ID":"a0d320a0-5609-496f-b825-e2feb7e8ee3e","Type":"ContainerStarted","Data":"4b6c0974d9d50e0d51868c9db26d0003bf9f06ce1eba59badffc1127f0e5bc19"}
Jul 31 01:52:26.486582 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:26.486544    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:52:26.744829 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:26.744737    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv" event={"ID":"a0d320a0-5609-496f-b825-e2feb7e8ee3e","Type":"ContainerStarted","Data":"7bc5cf62f1b002875c7af25264fb7025a7394333a5d803ed0f35b64a356bd3bf"}
Jul 31 01:52:26.766163 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:26.766119    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv" podStartSLOduration=0.75330076 podStartE2EDuration="1.766103517s" totalImagesPullingTime="1.012802757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:52:26.764495192 +0000 UTC m=+926.401287915" watchObservedRunningTime="2026-07-31 01:52:26.766103517 +0000 UTC m=+926.402896235"
Jul 31 01:52:35.508686 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:35.508649    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:35.509114 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:35.508706    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:35.521100 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:35.521080    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:35.799187 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:35.799162    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv"
Jul 31 01:52:42.779996 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.779961    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"]
Jul 31 01:52:42.783471 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.783454    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.785977 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.785952    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 31 01:52:42.795026 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.795006    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"]
Jul 31 01:52:42.848271 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.848239    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.848271 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.848271    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.848488 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.848296    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eba067f-bcf1-4b31-a68d-02161ee7d110-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.848488 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.848417    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjfzr\" (UniqueName: \"kubernetes.io/projected/3eba067f-bcf1-4b31-a68d-02161ee7d110-kube-api-access-tjfzr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.848488 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.848471    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.848649 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.848508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949190    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949221    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949429 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eba067f-bcf1-4b31-a68d-02161ee7d110-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949429 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjfzr\" (UniqueName: \"kubernetes.io/projected/3eba067f-bcf1-4b31-a68d-02161ee7d110-kube-api-access-tjfzr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949429 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949324    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949429 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949676 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949655    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949780 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949722    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.949827 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.949736    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.951589 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.951572    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eba067f-bcf1-4b31-a68d-02161ee7d110-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.951760 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.951729    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eba067f-bcf1-4b31-a68d-02161ee7d110-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:42.956242 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:42.956221    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjfzr\" (UniqueName: \"kubernetes.io/projected/3eba067f-bcf1-4b31-a68d-02161ee7d110-kube-api-access-tjfzr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vrff5\" (UID: \"3eba067f-bcf1-4b31-a68d-02161ee7d110\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:43.096240 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:43.096210    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:43.224094 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:43.224070    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"]
Jul 31 01:52:43.225939 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:52:43.225910    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eba067f_bcf1_4b31_a68d_02161ee7d110.slice/crio-fbab81f18154f5e34449503c8a7794fc5dbf86b9ede72f8a9c683c79da0cc1b1 WatchSource:0}: Error finding container fbab81f18154f5e34449503c8a7794fc5dbf86b9ede72f8a9c683c79da0cc1b1: Status 404 returned error can't find the container with id fbab81f18154f5e34449503c8a7794fc5dbf86b9ede72f8a9c683c79da0cc1b1
Jul 31 01:52:43.827543 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:43.827501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5" event={"ID":"3eba067f-bcf1-4b31-a68d-02161ee7d110","Type":"ContainerStarted","Data":"ecb0b3901ab958133afde78d03bdd69ca0d24f7a30d96c5619ab04c8eb59e481"}
Jul 31 01:52:43.827955 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:43.827566    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5" event={"ID":"3eba067f-bcf1-4b31-a68d-02161ee7d110","Type":"ContainerStarted","Data":"fbab81f18154f5e34449503c8a7794fc5dbf86b9ede72f8a9c683c79da0cc1b1"}
Jul 31 01:52:43.844515 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:43.844468    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5" podStartSLOduration=1.6713202200000001 podStartE2EDuration="1.844451815s" totalImagesPullingTime="173.131595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:52:43.843280298 +0000 UTC m=+943.480073041" watchObservedRunningTime="2026-07-31 01:52:43.844451815 +0000 UTC m=+943.481244536"
Jul 31 01:52:44.888579 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:44.888548    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:52:49.491866 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.491833    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"]
Jul 31 01:52:49.495223 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.495203    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.497547 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.497526    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 31 01:52:49.505047 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.505019    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"]
Jul 31 01:52:49.608017 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.607991    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.608166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.608030    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.608166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.608069    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.608166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.608087    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4mxv\" (UniqueName: \"kubernetes.io/projected/351be459-e9a9-4dd6-9499-5d52c6c30c1c-kube-api-access-m4mxv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.608166 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.608105    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.608307 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.608175    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351be459-e9a9-4dd6-9499-5d52c6c30c1c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709366 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709331    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351be459-e9a9-4dd6-9499-5d52c6c30c1c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709375    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709440    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709457    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4mxv\" (UniqueName: \"kubernetes.io/projected/351be459-e9a9-4dd6-9499-5d52c6c30c1c-kube-api-access-m4mxv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709499 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709881 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709853    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.709881 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709875    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.710002 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.709941    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.711689 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.711671    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/351be459-e9a9-4dd6-9499-5d52c6c30c1c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.712035 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.712020    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/351be459-e9a9-4dd6-9499-5d52c6c30c1c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.718845 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.718825    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4mxv\" (UniqueName: \"kubernetes.io/projected/351be459-e9a9-4dd6-9499-5d52c6c30c1c-kube-api-access-m4mxv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-krqgr\" (UID: \"351be459-e9a9-4dd6-9499-5d52c6c30c1c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.805056 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.805018    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:49.938301 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:49.938271    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"]
Jul 31 01:52:49.940090 ip-10-0-140-87 kubenswrapper[2555]: W0731 01:52:49.940063    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod351be459_e9a9_4dd6_9499_5d52c6c30c1c.slice/crio-d65e504c60a7396f965de133e1aa171fae504f1192dec1b1166b3114dc37b566 WatchSource:0}: Error finding container d65e504c60a7396f965de133e1aa171fae504f1192dec1b1166b3114dc37b566: Status 404 returned error can't find the container with id d65e504c60a7396f965de133e1aa171fae504f1192dec1b1166b3114dc37b566
Jul 31 01:52:50.866929 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:50.866892    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr" event={"ID":"351be459-e9a9-4dd6-9499-5d52c6c30c1c","Type":"ContainerStarted","Data":"a10010a32b74aaac93469d45596f681ad629f7f4a23bf9a6ddbac57e6e64d8ef"}
Jul 31 01:52:50.867314 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:50.866940    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr" event={"ID":"351be459-e9a9-4dd6-9499-5d52c6c30c1c","Type":"ContainerStarted","Data":"d65e504c60a7396f965de133e1aa171fae504f1192dec1b1166b3114dc37b566"}
Jul 31 01:52:50.884329 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:50.884277    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr" podStartSLOduration=1.7022213750000001 podStartE2EDuration="1.884262202s" totalImagesPullingTime="182.040827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:52:50.882283409 +0000 UTC m=+950.519076166" watchObservedRunningTime="2026-07-31 01:52:50.884262202 +0000 UTC m=+950.521054900"
Jul 31 01:52:51.991090 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:51.991052    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:52:53.096510 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:53.096472    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:53.096909 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:53.096535    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:53.109060 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:53.109037    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:53.900022 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:53.899986    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vrff5"
Jul 31 01:52:59.806151 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:59.806122    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:59.806649 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:59.806170    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:59.818773 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:59.818733    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:52:59.929890 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:52:59.929863    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-krqgr"
Jul 31 01:54:02.796110 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:54:02.796076    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:54:13.097828 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:54:13.097790    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:54:26.104559 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:54:26.104525    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:56:04.800920 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:56:04.800880    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:56:14.188819 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:56:14.188784    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:57:00.875313 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:00.875281    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:57:00.876169 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:00.876138    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 01:57:10.093667 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:10.093635    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:57:16.994602 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:16.994568    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:57:32.395688 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:32.395651    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:57:39.389386 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:39.389351    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:57:48.493356 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:48.493326    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:57:57.092904 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:57:57.092827    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:58:10.392897 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:58:10.392862    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:58:15.596090 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:58:15.596057    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:58:20.692181 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:58:20.692146    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:58:42.593590 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:58:42.593551    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:58:53.787494 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:58:53.787459    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:59:16.197165 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:59:16.197127    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:59:26.385201 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:59:26.385111    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:59:32.797882 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:59:32.797841    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:59:41.897208 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:59:41.897174    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:59:52.500967 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:59:52.500928    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 01:59:58.500480 ip-10-0-140-87 kubenswrapper[2555]: I0731 01:59:58.500440    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:06.795978 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:06.795935    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:18.196925 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:18.196894    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:27.690629 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:27.690592    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:36.693261 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:36.693232    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:44.402475 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:44.402440    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:52.492574 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:52.492476    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:00:57.398834 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:00:57.398801    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:01:02.487222 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:01:02.487184    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:01:12.893333 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:01:12.893302    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:02:00.908379 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:02:00.908350    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:02:00.910730 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:02:00.910710    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:03:30.686611 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:03:30.686577    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:03:35.889242 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:03:35.889205    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:01.596362 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:01.596284    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:21.501133 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:21.501095    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:31.986969 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:31.986935    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:37.186489 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:37.186456    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:46.788878 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:46.788838    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:52.197033 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:52.197002    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:04:57.398097 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:04:57.398064    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:05:07.293693 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:05:07.293660    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:05:12.390298 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:05:12.390254    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:05:22.395605 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:05:22.395527    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:05:29.092278 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:05:29.092242    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:05:38.496669 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:05:38.496635    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:06:03.189630 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:03.189597    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:06:08.497408 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:08.497364    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:06:13.294525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.294491    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"]
Jul 31 02:06:13.298291 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.298271    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.300578 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.300557    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-9c693bc5-kserve-self-signed-certs\""
Jul 31 02:06:13.314073 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.314053    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"]
Jul 31 02:06:13.407949 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.407917    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tmp-dir\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.408120 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.407962    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sdpb\" (UniqueName: \"kubernetes.io/projected/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-kube-api-access-6sdpb\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.408120 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.407984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tls-certs\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.408120 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.408001    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-home\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.408120 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.408028    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-dshm\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.408120 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.408047    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-model-cache\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509062 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509031    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-dshm\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509062 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-model-cache\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509365 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509109    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tmp-dir\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509365 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509136    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sdpb\" (UniqueName: \"kubernetes.io/projected/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-kube-api-access-6sdpb\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509365 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tls-certs\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509365 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509172    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-home\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509557 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509514    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-model-cache\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509557 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509536    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-home\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.509632 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.509571    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tmp-dir\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.511473 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.511452    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-dshm\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.511716 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.511696    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tls-certs\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.516585 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.516562    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sdpb\" (UniqueName: \"kubernetes.io/projected/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-kube-api-access-6sdpb\") pod \"e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") " pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.607673 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.607605    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:13.737763 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:13.737725    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"]
Jul 31 02:06:13.739115 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:06:13.739080    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc98fc4b6_4450_4200_80cc_0af7a6ac85c8.slice/crio-97f0181e24166d2e814d086864d862899399d95b59a1c2ea04b6c833df931c9d WatchSource:0}: Error finding container 97f0181e24166d2e814d086864d862899399d95b59a1c2ea04b6c833df931c9d: Status 404 returned error can't find the container with id 97f0181e24166d2e814d086864d862899399d95b59a1c2ea04b6c833df931c9d
Jul 31 02:06:14.007297 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:14.007213    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" event={"ID":"c98fc4b6-4450-4200-80cc-0af7a6ac85c8","Type":"ContainerStarted","Data":"e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6"}
Jul 31 02:06:14.007297 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:14.007256    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" event={"ID":"c98fc4b6-4450-4200-80cc-0af7a6ac85c8","Type":"ContainerStarted","Data":"97f0181e24166d2e814d086864d862899399d95b59a1c2ea04b6c833df931c9d"}
Jul 31 02:06:14.022846 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:14.022773    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" podStartSLOduration=1.022740944 podStartE2EDuration="1.022740944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:06:14.02202948 +0000 UTC m=+1753.658822199" watchObservedRunningTime="2026-07-31 02:06:14.022740944 +0000 UTC m=+1753.659533663"
Jul 31 02:06:15.896140 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:15.896103    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:06:23.607734 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:23.607700    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:23.608163 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:23.607771    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:23.620410 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:23.620380    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:24.067929 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:24.067896    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:06:25.093626 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.093592    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"]
Jul 31 02:06:25.097626 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.097607    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.099973 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.099952    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-9c693bc5-kserve-self-signed-certs\""
Jul 31 02:06:25.106552 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.106524    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"]
Jul 31 02:06:25.109264 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.109241    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775bb\" (UniqueName: \"kubernetes.io/projected/d18e488d-0790-403f-89f5-1948015b5819-kube-api-access-775bb\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.109349 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.109309    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-tmp-dir\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.109349 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.109335    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18e488d-0790-403f-89f5-1948015b5819-tls-certs\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.109443 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.109383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-dshm\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.109443 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.109418    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-home\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.109528 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.109471    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-model-cache\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.209933 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.209893    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-home\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210131 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.209944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-model-cache\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210131 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.209987    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775bb\" (UniqueName: \"kubernetes.io/projected/d18e488d-0790-403f-89f5-1948015b5819-kube-api-access-775bb\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210131 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.210070    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-tmp-dir\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210131 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.210094    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18e488d-0790-403f-89f5-1948015b5819-tls-certs\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210355 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.210134    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-dshm\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210355 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.210327    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-home\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210460 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.210372    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-model-cache\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.210460 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.210410    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-tmp-dir\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.212563 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.212541    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-dshm\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.212710 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.212693    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18e488d-0790-403f-89f5-1948015b5819-tls-certs\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.219164 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.219143    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775bb\" (UniqueName: \"kubernetes.io/projected/d18e488d-0790-403f-89f5-1948015b5819-kube-api-access-775bb\") pod \"e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") " pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.408028 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.407929    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:25.538801 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:25.538775    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"]
Jul 31 02:06:25.540603 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:06:25.540580    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18e488d_0790_403f_89f5_1948015b5819.slice/crio-3fc4dfa5b3d9009190cd3a5fc593ba9865f8e69af661c6a44a22f6d6bbd6be25 WatchSource:0}: Error finding container 3fc4dfa5b3d9009190cd3a5fc593ba9865f8e69af661c6a44a22f6d6bbd6be25: Status 404 returned error can't find the container with id 3fc4dfa5b3d9009190cd3a5fc593ba9865f8e69af661c6a44a22f6d6bbd6be25
Jul 31 02:06:26.068436 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:26.068394    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s" event={"ID":"d18e488d-0790-403f-89f5-1948015b5819","Type":"ContainerStarted","Data":"71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a"}
Jul 31 02:06:26.068610 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:26.068442    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s" event={"ID":"d18e488d-0790-403f-89f5-1948015b5819","Type":"ContainerStarted","Data":"3fc4dfa5b3d9009190cd3a5fc593ba9865f8e69af661c6a44a22f6d6bbd6be25"}
Jul 31 02:06:26.086801 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:26.086727    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s" podStartSLOduration=1.086710215 podStartE2EDuration="1.086710215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:06:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:06:26.085918536 +0000 UTC m=+1765.722711256" watchObservedRunningTime="2026-07-31 02:06:26.086710215 +0000 UTC m=+1765.723502940"
Jul 31 02:06:28.402131 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:28.402094    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:06:35.408873 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:35.408836    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:35.408873 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:35.408880    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:35.421272 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:35.421251    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:06:36.130582 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:06:36.130555    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:07:00.942404 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:00.942378    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:07:00.944841 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:00.944817    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:07:08.851373 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:08.851337    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"]
Jul 31 02:07:10.496183 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:10.496144    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"]
Jul 31 02:07:11.187685 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:11.187653    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:07:23.086570 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:23.086532    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:07:23.870955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:23.870906    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" podUID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" containerName="main" containerID="cri-o://e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6" gracePeriod=45
Jul 31 02:07:24.112439 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.112416    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:07:24.246593 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246502    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-model-cache\") pod \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") "
Jul 31 02:07:24.246593 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246540    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sdpb\" (UniqueName: \"kubernetes.io/projected/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-kube-api-access-6sdpb\") pod \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") "
Jul 31 02:07:24.246593 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246583    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-home\") pod \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") "
Jul 31 02:07:24.246913 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246618    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tls-certs\") pod \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") "
Jul 31 02:07:24.246913 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246645    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tmp-dir\") pod \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") "
Jul 31 02:07:24.246913 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246661    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-dshm\") pod \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\" (UID: \"c98fc4b6-4450-4200-80cc-0af7a6ac85c8\") "
Jul 31 02:07:24.246913 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246863    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "c98fc4b6-4450-4200-80cc-0af7a6ac85c8" (UID: "c98fc4b6-4450-4200-80cc-0af7a6ac85c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:24.247054 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246913    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-home" (OuterVolumeSpecName: "home") pod "c98fc4b6-4450-4200-80cc-0af7a6ac85c8" (UID: "c98fc4b6-4450-4200-80cc-0af7a6ac85c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:24.247054 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.246943    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c98fc4b6-4450-4200-80cc-0af7a6ac85c8" (UID: "c98fc4b6-4450-4200-80cc-0af7a6ac85c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:24.248981 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.248959    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c98fc4b6-4450-4200-80cc-0af7a6ac85c8" (UID: "c98fc4b6-4450-4200-80cc-0af7a6ac85c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:07:24.249076 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.249052    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-dshm" (OuterVolumeSpecName: "dshm") pod "c98fc4b6-4450-4200-80cc-0af7a6ac85c8" (UID: "c98fc4b6-4450-4200-80cc-0af7a6ac85c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:24.249117 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.249066    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-kube-api-access-6sdpb" (OuterVolumeSpecName: "kube-api-access-6sdpb") pod "c98fc4b6-4450-4200-80cc-0af7a6ac85c8" (UID: "c98fc4b6-4450-4200-80cc-0af7a6ac85c8"). InnerVolumeSpecName "kube-api-access-6sdpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:07:24.348280 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.348243    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:24.348280 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.348274    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:24.348280 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.348290    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:24.348520 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.348303    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:24.348520 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.348313    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:24.348520 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.348325    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sdpb\" (UniqueName: \"kubernetes.io/projected/c98fc4b6-4450-4200-80cc-0af7a6ac85c8-kube-api-access-6sdpb\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:24.369535 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.369500    2555 generic.go:356] "Generic (PLEG): container finished" podID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" containerID="e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6" exitCode=0
Jul 31 02:07:24.369688 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.369547    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"
Jul 31 02:07:24.369688 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.369570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" event={"ID":"c98fc4b6-4450-4200-80cc-0af7a6ac85c8","Type":"ContainerDied","Data":"e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6"}
Jul 31 02:07:24.369688 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.369611    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" event={"ID":"c98fc4b6-4450-4200-80cc-0af7a6ac85c8","Type":"ContainerDied","Data":"97f0181e24166d2e814d086864d862899399d95b59a1c2ea04b6c833df931c9d"}
Jul 31 02:07:24.369688 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.369633    2555 scope.go:117] "RemoveContainer" containerID="e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6"
Jul 31 02:07:24.378949 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.378932    2555 scope.go:117] "RemoveContainer" containerID="e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6"
Jul 31 02:07:24.379220 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:07:24.379201    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6\": container with ID starting with e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6 not found: ID does not exist" containerID="e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6"
Jul 31 02:07:24.379267 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.379229    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6"} err="failed to get container status \"e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6\": rpc error: code = NotFound desc = could not find container \"e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6\": container with ID starting with e43d35e52428b2d5cbabc9d9a7dceaaabd2909b8a17649744ca717de0c5a26c6 not found: ID does not exist"
Jul 31 02:07:24.390032 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.390011    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"]
Jul 31 02:07:24.392991 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.392972    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4"]
Jul 31 02:07:24.931399 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:24.931361    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" path="/var/lib/kubelet/pods/c98fc4b6-4450-4200-80cc-0af7a6ac85c8/volumes"
Jul 31 02:07:25.515945 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.515880    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s" podUID="d18e488d-0790-403f-89f5-1948015b5819" containerName="main" containerID="cri-o://71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a" gracePeriod=45
Jul 31 02:07:25.758740 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.758706    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:07:25.860250 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860221    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-dshm\") pod \"d18e488d-0790-403f-89f5-1948015b5819\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") "
Jul 31 02:07:25.860454 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860284    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-tmp-dir\") pod \"d18e488d-0790-403f-89f5-1948015b5819\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") "
Jul 31 02:07:25.860454 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860360    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-775bb\" (UniqueName: \"kubernetes.io/projected/d18e488d-0790-403f-89f5-1948015b5819-kube-api-access-775bb\") pod \"d18e488d-0790-403f-89f5-1948015b5819\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") "
Jul 31 02:07:25.860454 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860386    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-model-cache\") pod \"d18e488d-0790-403f-89f5-1948015b5819\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") "
Jul 31 02:07:25.860454 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860446    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-home\") pod \"d18e488d-0790-403f-89f5-1948015b5819\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") "
Jul 31 02:07:25.860684 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860479    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18e488d-0790-403f-89f5-1948015b5819-tls-certs\") pod \"d18e488d-0790-403f-89f5-1948015b5819\" (UID: \"d18e488d-0790-403f-89f5-1948015b5819\") "
Jul 31 02:07:25.860684 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860617    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d18e488d-0790-403f-89f5-1948015b5819" (UID: "d18e488d-0790-403f-89f5-1948015b5819"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:25.860804 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860647    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-model-cache" (OuterVolumeSpecName: "model-cache") pod "d18e488d-0790-403f-89f5-1948015b5819" (UID: "d18e488d-0790-403f-89f5-1948015b5819"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:25.860804 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860759    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-home" (OuterVolumeSpecName: "home") pod "d18e488d-0790-403f-89f5-1948015b5819" (UID: "d18e488d-0790-403f-89f5-1948015b5819"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:25.860901 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860834    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:25.860901 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860853    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:25.860901 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.860866    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:25.862602 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.862573    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18e488d-0790-403f-89f5-1948015b5819-kube-api-access-775bb" (OuterVolumeSpecName: "kube-api-access-775bb") pod "d18e488d-0790-403f-89f5-1948015b5819" (UID: "d18e488d-0790-403f-89f5-1948015b5819"). InnerVolumeSpecName "kube-api-access-775bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:07:25.862698 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.862627    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-dshm" (OuterVolumeSpecName: "dshm") pod "d18e488d-0790-403f-89f5-1948015b5819" (UID: "d18e488d-0790-403f-89f5-1948015b5819"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:07:25.862898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.862875    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18e488d-0790-403f-89f5-1948015b5819-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d18e488d-0790-403f-89f5-1948015b5819" (UID: "d18e488d-0790-403f-89f5-1948015b5819"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:07:25.961334 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.961304    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d18e488d-0790-403f-89f5-1948015b5819-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:25.961334 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.961329    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d18e488d-0790-403f-89f5-1948015b5819-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:25.961334 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:25.961340    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-775bb\" (UniqueName: \"kubernetes.io/projected/d18e488d-0790-403f-89f5-1948015b5819-kube-api-access-775bb\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:07:26.381607 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.381566    2555 generic.go:356] "Generic (PLEG): container finished" podID="d18e488d-0790-403f-89f5-1948015b5819" containerID="71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a" exitCode=0
Jul 31 02:07:26.381800 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.381625    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s" event={"ID":"d18e488d-0790-403f-89f5-1948015b5819","Type":"ContainerDied","Data":"71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a"}
Jul 31 02:07:26.381800 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.381660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s" event={"ID":"d18e488d-0790-403f-89f5-1948015b5819","Type":"ContainerDied","Data":"3fc4dfa5b3d9009190cd3a5fc593ba9865f8e69af661c6a44a22f6d6bbd6be25"}
Jul 31 02:07:26.381800 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.381678    2555 scope.go:117] "RemoveContainer" containerID="71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a"
Jul 31 02:07:26.381800 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.381629    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"
Jul 31 02:07:26.393102 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.393080    2555 scope.go:117] "RemoveContainer" containerID="71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a"
Jul 31 02:07:26.393387 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:07:26.393369    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a\": container with ID starting with 71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a not found: ID does not exist" containerID="71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a"
Jul 31 02:07:26.393463 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.393394    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a"} err="failed to get container status \"71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a\": rpc error: code = NotFound desc = could not find container \"71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a\": container with ID starting with 71d2a32cd9195274760812eab2aa4812bf67dea94ebca5531f43734d83f7975a not found: ID does not exist"
Jul 31 02:07:26.404659 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.404632    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"]
Jul 31 02:07:26.408490 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.408470    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-9c693bc5-kserve-6cb7dc6499-87z8s"]
Jul 31 02:07:26.926551 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:26.926511    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18e488d-0790-403f-89f5-1948015b5819" path="/var/lib/kubelet/pods/d18e488d-0790-403f-89f5-1948015b5819/volumes"
Jul 31 02:07:29.057785 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:29.057727    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="llm/e2e-same-id-a-9c693bc5-kserve-68949694dc-l9jt4" podUID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 31 02:07:30.196012 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:30.195981    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:07:42.686293 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:42.686256    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:07:56.291631 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:07:56.291594    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:04.887062 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:04.887030    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:17.589474 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:17.589434    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:23.490613 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:23.490576    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:31.787314 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:31.787276    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:37.894790 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:37.894732    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:44.995152 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:44.995117    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:08:58.592185 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:08:58.592154    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:03.986760 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:03.986721    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:10.488900 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:10.488864    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:17.101847 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:17.101796    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:23.597557 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:23.597520    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:32.294478 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:32.294439    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:39.187188 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:39.187151    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:50.192131 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:50.192090    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:09:57.604790 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:09:57.604692    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:10:07.399740 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:10:07.399703    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:10:22.491399 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:10:22.491359    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:10:28.492195 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:10:28.492155    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:10:36.592839 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:10:36.592802    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:10:46.897148 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:10:46.897115    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:10:55.285925 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:10:55.285888    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:11:02.996980 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:11:02.996945    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:11:14.394258 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:11:14.394219    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:11:45.498220 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:11:45.498142    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:11:51.987065 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:11:51.987027    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:12:00.979579 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:12:00.979547    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:12:00.981932 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:12:00.981896    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:12:19.590702 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:12:19.590664    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:12:28.397108 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:12:28.397074    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:12:54.296148 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:12:54.296065    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:13:00.589893 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:13:00.589856    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:13:40.298230 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:13:40.298198    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:13:53.487386 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:13:53.487352    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:15:21.893569 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:15:21.893537    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:15:30.196762 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:15:30.196720    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:15:43.293805 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:15:43.293771    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:16:24.186921 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:16:24.186883    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:17:01.012188 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:17:01.012159    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:17:01.015393 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:17:01.015369    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:17:02.794927 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:17:02.794889    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:18:46.990864 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:18:46.990829    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:18:54.901883 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:18:54.901792    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:19:15.695432 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.695400    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"]
Jul 31 02:19:15.695925 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.695904    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" containerName="main"
Jul 31 02:19:15.696002 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.695929    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" containerName="main"
Jul 31 02:19:15.696002 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.695972    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d18e488d-0790-403f-89f5-1948015b5819" containerName="main"
Jul 31 02:19:15.696002 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.695982    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18e488d-0790-403f-89f5-1948015b5819" containerName="main"
Jul 31 02:19:15.696149 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.696080    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98fc4b6-4450-4200-80cc-0af7a6ac85c8" containerName="main"
Jul 31 02:19:15.696149 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.696093    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d18e488d-0790-403f-89f5-1948015b5819" containerName="main"
Jul 31 02:19:15.698975 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.698957    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.702557 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.702538    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a1d99bab\"/\"openshift-service-ca.crt\""
Jul 31 02:19:15.702680 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.702630    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a1d99bab\"/\"kube-root-ca.crt\""
Jul 31 02:19:15.702680 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.702643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a1d99bab\"/\"default-dockercfg-cbmsz\""
Jul 31 02:19:15.702680 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.702643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a1d99bab\"/\"e2e-lifecycle-model-a1d99bab-kserve-self-signed-certs\""
Jul 31 02:19:15.707533 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.707502    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"]
Jul 31 02:19:15.829250 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.829222    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfjkk\" (UniqueName: \"kubernetes.io/projected/57befcf0-ed69-4346-a75f-67be02804da7-kube-api-access-pfjkk\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.829417 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.829258    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-tmp-dir\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.829417 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.829276    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57befcf0-ed69-4346-a75f-67be02804da7-tls-certs\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.829417 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.829303    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-model-cache\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.829417 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.829365    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-home\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.829417 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.829399    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-dshm\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.930766 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.930719    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-home\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.930766 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.930765    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-dshm\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931006 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.930822    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfjkk\" (UniqueName: \"kubernetes.io/projected/57befcf0-ed69-4346-a75f-67be02804da7-kube-api-access-pfjkk\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931006 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.930842    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-tmp-dir\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931006 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.930857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57befcf0-ed69-4346-a75f-67be02804da7-tls-certs\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931006 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.930879    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-model-cache\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931271 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.931204    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-home\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931271 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.931217    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-tmp-dir\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.931271 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.931257    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-model-cache\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.933117 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.933086    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-dshm\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.933459 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.933440    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57befcf0-ed69-4346-a75f-67be02804da7-tls-certs\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:15.940115 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:15.940090    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfjkk\" (UniqueName: \"kubernetes.io/projected/57befcf0-ed69-4346-a75f-67be02804da7-kube-api-access-pfjkk\") pod \"e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") " pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:16.008898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:16.008828    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:16.148009 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:16.147913    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"]
Jul 31 02:19:17.017021 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:17.016988    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm" event={"ID":"57befcf0-ed69-4346-a75f-67be02804da7","Type":"ContainerStarted","Data":"3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d"}
Jul 31 02:19:17.017512 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:17.017031    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm" event={"ID":"57befcf0-ed69-4346-a75f-67be02804da7","Type":"ContainerStarted","Data":"09c0a9790face2ea75a6a91770bc926e3c986679e0ee8ba07e4f79278a99d650"}
Jul 31 02:19:17.035323 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:17.035273    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm" podStartSLOduration=2.035257284 podStartE2EDuration="2.035257284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:19:17.034937451 +0000 UTC m=+2536.671730174" watchObservedRunningTime="2026-07-31 02:19:17.035257284 +0000 UTC m=+2536.672050014"
Jul 31 02:19:18.100186 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:18.100153    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:19:26.009304 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:26.009268    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:26.009681 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:26.009325    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:26.021842 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:26.021811    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:26.072858 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:26.072828    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:19:31.096522 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:31.096490    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:19:54.588418 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:19:54.588382    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:20:00.396326 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:00.396294    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:20:05.745869 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:05.745834    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"]
Jul 31 02:20:20.765480 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:20.765418    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm" podUID="57befcf0-ed69-4346-a75f-67be02804da7" containerName="main" containerID="cri-o://3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d" gracePeriod=45
Jul 31 02:20:21.019731 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.019678    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:20:21.168281 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168247    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-home\") pod \"57befcf0-ed69-4346-a75f-67be02804da7\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") "
Jul 31 02:20:21.168461 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168329    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-model-cache\") pod \"57befcf0-ed69-4346-a75f-67be02804da7\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") "
Jul 31 02:20:21.168461 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168367    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57befcf0-ed69-4346-a75f-67be02804da7-tls-certs\") pod \"57befcf0-ed69-4346-a75f-67be02804da7\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") "
Jul 31 02:20:21.168461 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168424    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfjkk\" (UniqueName: \"kubernetes.io/projected/57befcf0-ed69-4346-a75f-67be02804da7-kube-api-access-pfjkk\") pod \"57befcf0-ed69-4346-a75f-67be02804da7\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") "
Jul 31 02:20:21.168461 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168451    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-tmp-dir\") pod \"57befcf0-ed69-4346-a75f-67be02804da7\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") "
Jul 31 02:20:21.168674 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168475    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-dshm\") pod \"57befcf0-ed69-4346-a75f-67be02804da7\" (UID: \"57befcf0-ed69-4346-a75f-67be02804da7\") "
Jul 31 02:20:21.168674 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168522    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-home" (OuterVolumeSpecName: "home") pod "57befcf0-ed69-4346-a75f-67be02804da7" (UID: "57befcf0-ed69-4346-a75f-67be02804da7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:21.168674 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168605    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-model-cache" (OuterVolumeSpecName: "model-cache") pod "57befcf0-ed69-4346-a75f-67be02804da7" (UID: "57befcf0-ed69-4346-a75f-67be02804da7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:21.168872 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168734    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57befcf0-ed69-4346-a75f-67be02804da7" (UID: "57befcf0-ed69-4346-a75f-67be02804da7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:21.168872 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168841    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:20:21.168872 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168859    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:20:21.168872 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.168872    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:20:21.170788 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.170766    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-dshm" (OuterVolumeSpecName: "dshm") pod "57befcf0-ed69-4346-a75f-67be02804da7" (UID: "57befcf0-ed69-4346-a75f-67be02804da7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:21.170901 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.170823    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57befcf0-ed69-4346-a75f-67be02804da7-kube-api-access-pfjkk" (OuterVolumeSpecName: "kube-api-access-pfjkk") pod "57befcf0-ed69-4346-a75f-67be02804da7" (UID: "57befcf0-ed69-4346-a75f-67be02804da7"). InnerVolumeSpecName "kube-api-access-pfjkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:20:21.170901 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.170857    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57befcf0-ed69-4346-a75f-67be02804da7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57befcf0-ed69-4346-a75f-67be02804da7" (UID: "57befcf0-ed69-4346-a75f-67be02804da7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:20:21.270010 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.269924    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57befcf0-ed69-4346-a75f-67be02804da7-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:20:21.270010 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.269954    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfjkk\" (UniqueName: \"kubernetes.io/projected/57befcf0-ed69-4346-a75f-67be02804da7-kube-api-access-pfjkk\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:20:21.270010 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.269967    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57befcf0-ed69-4346-a75f-67be02804da7-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:20:21.348594 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.348560    2555 generic.go:356] "Generic (PLEG): container finished" podID="57befcf0-ed69-4346-a75f-67be02804da7" containerID="3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d" exitCode=0
Jul 31 02:20:21.348791 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.348599    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"
Jul 31 02:20:21.348791 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.348660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm" event={"ID":"57befcf0-ed69-4346-a75f-67be02804da7","Type":"ContainerDied","Data":"3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d"}
Jul 31 02:20:21.348791 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.348701    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm" event={"ID":"57befcf0-ed69-4346-a75f-67be02804da7","Type":"ContainerDied","Data":"09c0a9790face2ea75a6a91770bc926e3c986679e0ee8ba07e4f79278a99d650"}
Jul 31 02:20:21.348791 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.348719    2555 scope.go:117] "RemoveContainer" containerID="3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d"
Jul 31 02:20:21.358121 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.358105    2555 scope.go:117] "RemoveContainer" containerID="3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d"
Jul 31 02:20:21.358353 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:20:21.358339    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d\": container with ID starting with 3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d not found: ID does not exist" containerID="3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d"
Jul 31 02:20:21.358400 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.358361    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d"} err="failed to get container status \"3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d\": rpc error: code = NotFound desc = could not find container \"3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d\": container with ID starting with 3626011706df629341d9439d4a8d2ca8089bcf97d360c68afdebed08a139029d not found: ID does not exist"
Jul 31 02:20:21.369996 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.369977    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"]
Jul 31 02:20:21.373518 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:21.373496    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a1d99bab/e2e-lifecycle-model-a1d99bab-kserve-555f56cb87-2dcmm"]
Jul 31 02:20:22.926432 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:22.926338    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57befcf0-ed69-4346-a75f-67be02804da7" path="/var/lib/kubelet/pods/57befcf0-ed69-4346-a75f-67be02804da7/volumes"
Jul 31 02:20:50.400973 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:20:50.400936    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:21:02.494182 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:21:02.494143    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:21:10.789673 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:21:10.789636    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:22:01.046304 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:22:01.046225    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:22:01.049840 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:22:01.049819    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:22:01.597996 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:22:01.597964    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:22:29.397696 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:22:29.397661    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:23:00.289545 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.289512    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"]
Jul 31 02:23:00.290050 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.289875    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57befcf0-ed69-4346-a75f-67be02804da7" containerName="main"
Jul 31 02:23:00.290050 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.289889    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="57befcf0-ed69-4346-a75f-67be02804da7" containerName="main"
Jul 31 02:23:00.290050 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.289978    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="57befcf0-ed69-4346-a75f-67be02804da7" containerName="main"
Jul 31 02:23:00.292940 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.292922    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.296341 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.296317    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8af864\"/\"default-dockercfg-xkbwh\""
Jul 31 02:23:00.296459 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.296338    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8af864\"/\"test-model-8af864-kserve-self-signed-certs\""
Jul 31 02:23:00.296459 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.296373    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8af864\"/\"openshift-service-ca.crt\""
Jul 31 02:23:00.296459 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.296379    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8af864\"/\"kube-root-ca.crt\""
Jul 31 02:23:00.302613 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.302594    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"]
Jul 31 02:23:00.426824 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.426787    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tmp-dir\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.426824 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.426829    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-home\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.427077 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.426857    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5d4\" (UniqueName: \"kubernetes.io/projected/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-kube-api-access-mp5d4\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.427077 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.426919    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-dshm\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.427077 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.427018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tls-certs\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.427077 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.427067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-model-cache\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528335 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528271    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tls-certs\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528611 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528356    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-model-cache\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528611 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528380    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tmp-dir\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528611 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528399    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-home\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528611 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5d4\" (UniqueName: \"kubernetes.io/projected/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-kube-api-access-mp5d4\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528611 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528461    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-dshm\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528915 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528892    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-model-cache\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528954 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528927    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-home\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.528954 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.528938    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tmp-dir\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.530866 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.530848    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-dshm\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.530938 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.530921    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tls-certs\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.536911 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.536889    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5d4\" (UniqueName: \"kubernetes.io/projected/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-kube-api-access-mp5d4\") pod \"test-model-8af864-kserve-6ffbc4bb95-f7wg6\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") " pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.601963 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.601925    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:00.739254 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:00.739229    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"]
Jul 31 02:23:00.740944 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:23:00.740915    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfd86d73_ff1c_42ce_a4bc_7fc5ee176006.slice/crio-7784388506c21a6766c52f1ba3fcc61e472adbf6d412756a7a1c371beda7b1c4 WatchSource:0}: Error finding container 7784388506c21a6766c52f1ba3fcc61e472adbf6d412756a7a1c371beda7b1c4: Status 404 returned error can't find the container with id 7784388506c21a6766c52f1ba3fcc61e472adbf6d412756a7a1c371beda7b1c4
Jul 31 02:23:01.168893 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:01.168856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6" event={"ID":"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006","Type":"ContainerStarted","Data":"08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071"}
Jul 31 02:23:01.168893 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:01.168900    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6" event={"ID":"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006","Type":"ContainerStarted","Data":"7784388506c21a6766c52f1ba3fcc61e472adbf6d412756a7a1c371beda7b1c4"}
Jul 31 02:23:01.191717 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:01.191670    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6" podStartSLOduration=1.191653206 podStartE2EDuration="1.191653206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:23:01.191371411 +0000 UTC m=+2760.828164132" watchObservedRunningTime="2026-07-31 02:23:01.191653206 +0000 UTC m=+2760.828445926"
Jul 31 02:23:03.603848 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:03.603808    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:23:10.602122 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:10.602066    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:10.602560 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:10.602219    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:10.614662 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:10.614634    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:11.232062 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:11.232035    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:23:22.502072 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.501993    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"]
Jul 31 02:23:22.505204 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.505188    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.507523 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.507502    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f88d9e\"/\"kube-root-ca.crt\""
Jul 31 02:23:22.508507 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.508476    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f88d9e\"/\"test-model-f88d9e-kserve-self-signed-certs\""
Jul 31 02:23:22.508595 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.508481    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f88d9e\"/\"openshift-service-ca.crt\""
Jul 31 02:23:22.508595 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.508511    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f88d9e\"/\"default-dockercfg-6xch8\""
Jul 31 02:23:22.512878 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.512573    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"]
Jul 31 02:23:22.512878 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.512767    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed881669-86ab-4d58-a157-ac20005ae4f7-tls-certs\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.512878 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.512821    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fclbz\" (UniqueName: \"kubernetes.io/projected/ed881669-86ab-4d58-a157-ac20005ae4f7-kube-api-access-fclbz\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.512878 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.512852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-home\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.513102 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.512961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-dshm\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.513102 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.513036    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-model-cache\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.513102 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.513062    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-tmp-dir\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.613684 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.613646    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-dshm\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.613955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.613698    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-model-cache\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.613955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.613714    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-tmp-dir\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.613955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.613740    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed881669-86ab-4d58-a157-ac20005ae4f7-tls-certs\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.613955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.613857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fclbz\" (UniqueName: \"kubernetes.io/projected/ed881669-86ab-4d58-a157-ac20005ae4f7-kube-api-access-fclbz\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.613955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.613909    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-home\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.614240 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.614105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-model-cache\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.614240 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.614186    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-tmp-dir\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.614317 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.614240    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-home\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.616111 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.616078    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-dshm\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.616322 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.616306    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed881669-86ab-4d58-a157-ac20005ae4f7-tls-certs\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.621727 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.621705    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fclbz\" (UniqueName: \"kubernetes.io/projected/ed881669-86ab-4d58-a157-ac20005ae4f7-kube-api-access-fclbz\") pod \"test-model-f88d9e-kserve-85d8db5f89-tmtl2\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") " pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.815571 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.815537    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:22.945105 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:22.945026    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"]
Jul 31 02:23:22.947911 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:23:22.947888    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded881669_86ab_4d58_a157_ac20005ae4f7.slice/crio-0a10b5ee8482c581f00d06930522bf39dc34c38017c4cabb93b0962f901da94f WatchSource:0}: Error finding container 0a10b5ee8482c581f00d06930522bf39dc34c38017c4cabb93b0962f901da94f: Status 404 returned error can't find the container with id 0a10b5ee8482c581f00d06930522bf39dc34c38017c4cabb93b0962f901da94f
Jul 31 02:23:23.280480 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:23.280388    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2" event={"ID":"ed881669-86ab-4d58-a157-ac20005ae4f7","Type":"ContainerStarted","Data":"fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b"}
Jul 31 02:23:23.280480 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:23.280438    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2" event={"ID":"ed881669-86ab-4d58-a157-ac20005ae4f7","Type":"ContainerStarted","Data":"0a10b5ee8482c581f00d06930522bf39dc34c38017c4cabb93b0962f901da94f"}
Jul 31 02:23:23.297248 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:23.297201    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2" podStartSLOduration=1.297187821 podStartE2EDuration="1.297187821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:23:23.296867753 +0000 UTC m=+2782.933660472" watchObservedRunningTime="2026-07-31 02:23:23.297187821 +0000 UTC m=+2782.933980538"
Jul 31 02:23:26.492176 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:26.492138    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:23:32.816526 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:32.816486    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:32.817137 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:32.816549    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:32.829132 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:32.829105    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:23:33.341342 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:23:33.341309    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:24:05.277433 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:05.277398    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"]
Jul 31 02:24:06.162236 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:06.162199    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"]
Jul 31 02:24:08.591779 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:08.591728    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:24:18.896534 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:18.896494    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:24:20.297505 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.297456    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6" podUID="dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" containerName="main" containerID="cri-o://08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071" gracePeriod=45
Jul 31 02:24:20.539206 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.539173    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:24:20.583007 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.582914    2555 generic.go:356] "Generic (PLEG): container finished" podID="dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" containerID="08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071" exitCode=0
Jul 31 02:24:20.583007 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.582967    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"
Jul 31 02:24:20.583007 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.582997    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6" event={"ID":"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006","Type":"ContainerDied","Data":"08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071"}
Jul 31 02:24:20.583289 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.583042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6" event={"ID":"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006","Type":"ContainerDied","Data":"7784388506c21a6766c52f1ba3fcc61e472adbf6d412756a7a1c371beda7b1c4"}
Jul 31 02:24:20.583289 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.583062    2555 scope.go:117] "RemoveContainer" containerID="08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071"
Jul 31 02:24:20.592191 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.592169    2555 scope.go:117] "RemoveContainer" containerID="08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071"
Jul 31 02:24:20.592452 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:24:20.592434    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071\": container with ID starting with 08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071 not found: ID does not exist" containerID="08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071"
Jul 31 02:24:20.592500 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.592462    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071"} err="failed to get container status \"08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071\": rpc error: code = NotFound desc = could not find container \"08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071\": container with ID starting with 08690ff0575163da39dde1877d72fc09e98530f74c2a83ff00b6079afdcd2071 not found: ID does not exist"
Jul 31 02:24:20.611828 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.611796    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tmp-dir\") pod \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") "
Jul 31 02:24:20.611965 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.611861    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-home\") pod \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") "
Jul 31 02:24:20.611965 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.611887    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-dshm\") pod \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") "
Jul 31 02:24:20.611965 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.611910    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tls-certs\") pod \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") "
Jul 31 02:24:20.611965 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.611946    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp5d4\" (UniqueName: \"kubernetes.io/projected/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-kube-api-access-mp5d4\") pod \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") "
Jul 31 02:24:20.612159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.611980    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-model-cache\") pod \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\" (UID: \"dfd86d73-ff1c-42ce-a4bc-7fc5ee176006\") "
Jul 31 02:24:20.612159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.612054    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" (UID: "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:20.612159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.612132    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-home" (OuterVolumeSpecName: "home") pod "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" (UID: "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:20.612280 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.612258    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" (UID: "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:20.612324 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.612302    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:20.612324 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.612315    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:20.614288 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.614268    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-dshm" (OuterVolumeSpecName: "dshm") pod "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" (UID: "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:20.614362 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.614310    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-kube-api-access-mp5d4" (OuterVolumeSpecName: "kube-api-access-mp5d4") pod "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" (UID: "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006"). InnerVolumeSpecName "kube-api-access-mp5d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:24:20.614399 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.614353    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" (UID: "dfd86d73-ff1c-42ce-a4bc-7fc5ee176006"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:24:20.712821 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.712740    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:20.712821 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.712813    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:20.712821 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.712826    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp5d4\" (UniqueName: \"kubernetes.io/projected/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-kube-api-access-mp5d4\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:20.713068 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.712835    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:20.904696 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.904659    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"]
Jul 31 02:24:20.908477 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.908446    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8af864/test-model-8af864-kserve-6ffbc4bb95-f7wg6"]
Jul 31 02:24:20.926988 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:20.926955    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" path="/var/lib/kubelet/pods/dfd86d73-ff1c-42ce-a4bc-7fc5ee176006/volumes"
Jul 31 02:24:21.182547 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.182412    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2" podUID="ed881669-86ab-4d58-a157-ac20005ae4f7" containerName="main" containerID="cri-o://fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b" gracePeriod=45
Jul 31 02:24:21.437503 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.437439    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:24:21.519311 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519273    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fclbz\" (UniqueName: \"kubernetes.io/projected/ed881669-86ab-4d58-a157-ac20005ae4f7-kube-api-access-fclbz\") pod \"ed881669-86ab-4d58-a157-ac20005ae4f7\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") "
Jul 31 02:24:21.519311 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519319    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-tmp-dir\") pod \"ed881669-86ab-4d58-a157-ac20005ae4f7\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") "
Jul 31 02:24:21.519592 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519364    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-model-cache\") pod \"ed881669-86ab-4d58-a157-ac20005ae4f7\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") "
Jul 31 02:24:21.519592 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519412    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-dshm\") pod \"ed881669-86ab-4d58-a157-ac20005ae4f7\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") "
Jul 31 02:24:21.519592 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519431    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-home\") pod \"ed881669-86ab-4d58-a157-ac20005ae4f7\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") "
Jul 31 02:24:21.519592 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519463    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed881669-86ab-4d58-a157-ac20005ae4f7-tls-certs\") pod \"ed881669-86ab-4d58-a157-ac20005ae4f7\" (UID: \"ed881669-86ab-4d58-a157-ac20005ae4f7\") "
Jul 31 02:24:21.519813 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519675    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed881669-86ab-4d58-a157-ac20005ae4f7" (UID: "ed881669-86ab-4d58-a157-ac20005ae4f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:21.519813 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519677    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed881669-86ab-4d58-a157-ac20005ae4f7" (UID: "ed881669-86ab-4d58-a157-ac20005ae4f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:21.519813 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.519689    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-home" (OuterVolumeSpecName: "home") pod "ed881669-86ab-4d58-a157-ac20005ae4f7" (UID: "ed881669-86ab-4d58-a157-ac20005ae4f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:21.521694 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.521666    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-dshm" (OuterVolumeSpecName: "dshm") pod "ed881669-86ab-4d58-a157-ac20005ae4f7" (UID: "ed881669-86ab-4d58-a157-ac20005ae4f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:21.521846 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.521708    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed881669-86ab-4d58-a157-ac20005ae4f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed881669-86ab-4d58-a157-ac20005ae4f7" (UID: "ed881669-86ab-4d58-a157-ac20005ae4f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:24:21.521846 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.521805    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed881669-86ab-4d58-a157-ac20005ae4f7-kube-api-access-fclbz" (OuterVolumeSpecName: "kube-api-access-fclbz") pod "ed881669-86ab-4d58-a157-ac20005ae4f7" (UID: "ed881669-86ab-4d58-a157-ac20005ae4f7"). InnerVolumeSpecName "kube-api-access-fclbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:24:21.590983 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.590946    2555 generic.go:356] "Generic (PLEG): container finished" podID="ed881669-86ab-4d58-a157-ac20005ae4f7" containerID="fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b" exitCode=0
Jul 31 02:24:21.591159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.590993    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"
Jul 31 02:24:21.591159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.591005    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2" event={"ID":"ed881669-86ab-4d58-a157-ac20005ae4f7","Type":"ContainerDied","Data":"fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b"}
Jul 31 02:24:21.591159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.591037    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2" event={"ID":"ed881669-86ab-4d58-a157-ac20005ae4f7","Type":"ContainerDied","Data":"0a10b5ee8482c581f00d06930522bf39dc34c38017c4cabb93b0962f901da94f"}
Jul 31 02:24:21.591159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.591054    2555 scope.go:117] "RemoveContainer" containerID="fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b"
Jul 31 02:24:21.601519 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.601499    2555 scope.go:117] "RemoveContainer" containerID="fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b"
Jul 31 02:24:21.601804 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:24:21.601777    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b\": container with ID starting with fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b not found: ID does not exist" containerID="fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b"
Jul 31 02:24:21.601914 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.601813    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b"} err="failed to get container status \"fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b\": rpc error: code = NotFound desc = could not find container \"fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b\": container with ID starting with fa34402aeafc93722f424fbb08c2a217c1a7fdb03a6f3bd1ebb69b405bb0861b not found: ID does not exist"
Jul 31 02:24:21.612968 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.612935    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"]
Jul 31 02:24:21.616002 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.615975    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f88d9e/test-model-f88d9e-kserve-85d8db5f89-tmtl2"]
Jul 31 02:24:21.620525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.620506    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:21.620525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.620527    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:21.620667 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.620539    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed881669-86ab-4d58-a157-ac20005ae4f7-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:21.620667 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.620552    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fclbz\" (UniqueName: \"kubernetes.io/projected/ed881669-86ab-4d58-a157-ac20005ae4f7-kube-api-access-fclbz\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:21.620667 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.620564    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:21.620667 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:21.620577    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed881669-86ab-4d58-a157-ac20005ae4f7-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:24:22.926647 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:22.926607    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed881669-86ab-4d58-a157-ac20005ae4f7" path="/var/lib/kubelet/pods/ed881669-86ab-4d58-a157-ac20005ae4f7/volumes"
Jul 31 02:24:36.490159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:36.490116    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:24:47.390397 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:24:47.390358    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:25:22.087279 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:25:22.087238    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:26:15.395395 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:26:15.395358    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:26:37.196110 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:26:37.196031    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:26:50.390345 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:26:50.390310    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:27:01.078182 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:01.078148    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:27:01.083206 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:01.083182    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:27:19.002058 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:19.002017    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:27:44.897013 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.896980    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"]
Jul 31 02:27:44.897483 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.897468    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" containerName="main"
Jul 31 02:27:44.897555 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.897487    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" containerName="main"
Jul 31 02:27:44.897555 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.897524    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed881669-86ab-4d58-a157-ac20005ae4f7" containerName="main"
Jul 31 02:27:44.897555 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.897534    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed881669-86ab-4d58-a157-ac20005ae4f7" containerName="main"
Jul 31 02:27:44.897710 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.897622    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd86d73-ff1c-42ce-a4bc-7fc5ee176006" containerName="main"
Jul 31 02:27:44.897710 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.897636    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed881669-86ab-4d58-a157-ac20005ae4f7" containerName="main"
Jul 31 02:27:44.900795 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.900773    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:44.904093 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.904067    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"default-dockercfg-drcd9\""
Jul 31 02:27:44.904093 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.904085    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"auth-test-model-2aed0b-kserve-self-signed-certs\""
Jul 31 02:27:44.904289 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.904091    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"openshift-service-ca.crt\""
Jul 31 02:27:44.904289 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.904069    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"kube-root-ca.crt\""
Jul 31 02:27:44.909677 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:44.909653    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"]
Jul 31 02:27:45.012606 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.012570    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-home\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.012606 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.012611    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-model-cache\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.012859 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.012637    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwpwc\" (UniqueName: \"kubernetes.io/projected/4b006d0b-3b94-47bb-bb0f-909b7f10a986-kube-api-access-vwpwc\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.012859 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.012712    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-dshm\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.012859 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.012793    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tmp-dir\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.012859 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.012833    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tls-certs\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.113651 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.113610    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwpwc\" (UniqueName: \"kubernetes.io/projected/4b006d0b-3b94-47bb-bb0f-909b7f10a986-kube-api-access-vwpwc\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.113882 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.113699    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-dshm\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.113882 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.113788    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tmp-dir\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.113882 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.113853    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tls-certs\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.114051 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.113903    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-home\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.114051 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.113932    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-model-cache\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.114202 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.114179    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tmp-dir\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.114270 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.114219    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-home\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.114270 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.114263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-model-cache\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.116179 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.116152    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-dshm\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.116424 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.116407    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tls-certs\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.122051 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.122023    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwpwc\" (UniqueName: \"kubernetes.io/projected/4b006d0b-3b94-47bb-bb0f-909b7f10a986-kube-api-access-vwpwc\") pod \"auth-test-model-2aed0b-kserve-6dd554ccf5-th42s\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") " pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.211868 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.211781    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:45.344349 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.344320    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"]
Jul 31 02:27:45.346342 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:27:45.346313    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b006d0b_3b94_47bb_bb0f_909b7f10a986.slice/crio-6e2c20d02201d32a0aadf28b6ac097b263a173ee793206221960e26e392d88c2 WatchSource:0}: Error finding container 6e2c20d02201d32a0aadf28b6ac097b263a173ee793206221960e26e392d88c2: Status 404 returned error can't find the container with id 6e2c20d02201d32a0aadf28b6ac097b263a173ee793206221960e26e392d88c2
Jul 31 02:27:45.654921 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.654887    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s" event={"ID":"4b006d0b-3b94-47bb-bb0f-909b7f10a986","Type":"ContainerStarted","Data":"7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5"}
Jul 31 02:27:45.655153 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.654933    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s" event={"ID":"4b006d0b-3b94-47bb-bb0f-909b7f10a986","Type":"ContainerStarted","Data":"6e2c20d02201d32a0aadf28b6ac097b263a173ee793206221960e26e392d88c2"}
Jul 31 02:27:45.672591 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:45.672535    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s" podStartSLOduration=1.672520017 podStartE2EDuration="1.672520017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:27:45.670931418 +0000 UTC m=+3045.307724141" watchObservedRunningTime="2026-07-31 02:27:45.672520017 +0000 UTC m=+3045.309312736"
Jul 31 02:27:47.590804 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:47.590767    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:27:55.212389 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:55.212310    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:55.212389 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:55.212352    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:55.224476 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:55.224456    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:55.720117 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:55.720090    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:27:59.801468 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.801433    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"]
Jul 31 02:27:59.804993 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.804975    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.808619 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.808578    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"openshift-service-ca.crt\""
Jul 31 02:27:59.808619 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.808593    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"auth-test-model-01a44c-kserve-self-signed-certs\""
Jul 31 02:27:59.808828 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.808702    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"kube-root-ca.crt\""
Jul 31 02:27:59.808828 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.808576    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"default-dockercfg-xw597\""
Jul 31 02:27:59.813183 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.813162    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"]
Jul 31 02:27:59.828827 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.828801    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-model-cache\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.828947 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.828838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-home\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.828947 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.828876    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwj7k\" (UniqueName: \"kubernetes.io/projected/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-kube-api-access-kwj7k\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.828947 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.828914    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-dshm\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.829070 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.828971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tls-certs\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.829070 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.828991    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tmp-dir\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.929466 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-model-cache\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.929466 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929474    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-home\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.929718 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwj7k\" (UniqueName: \"kubernetes.io/projected/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-kube-api-access-kwj7k\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.929950 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929924    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-home\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.930018 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929943    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-model-cache\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.930018 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929956    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-dshm\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.930018 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.929998    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tls-certs\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.930171 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.930019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tmp-dir\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.930357 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.930333    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tmp-dir\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.932186 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.932158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-dshm\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.932344 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.932324    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tls-certs\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:27:59.937106 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:27:59.937084    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwj7k\" (UniqueName: \"kubernetes.io/projected/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-kube-api-access-kwj7k\") pod \"auth-test-model-01a44c-kserve-79cf49c96c-p6s2p\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") " pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:28:00.119847 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:00.119737    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:28:00.257866 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:00.257842    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"]
Jul 31 02:28:00.259887 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:28:00.259857    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2113bd3e_0e2a_4b8f_a56e_a0f20036f19c.slice/crio-853a8efa164097fad1c6827a8f1bd9234fef82fe31c4cab394cb75ba35ae5f6d WatchSource:0}: Error finding container 853a8efa164097fad1c6827a8f1bd9234fef82fe31c4cab394cb75ba35ae5f6d: Status 404 returned error can't find the container with id 853a8efa164097fad1c6827a8f1bd9234fef82fe31c4cab394cb75ba35ae5f6d
Jul 31 02:28:00.734072 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:00.734032    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p" event={"ID":"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c","Type":"ContainerStarted","Data":"b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b"}
Jul 31 02:28:00.734072 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:00.734078    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p" event={"ID":"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c","Type":"ContainerStarted","Data":"853a8efa164097fad1c6827a8f1bd9234fef82fe31c4cab394cb75ba35ae5f6d"}
Jul 31 02:28:00.757353 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:00.757304    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p" podStartSLOduration=1.757287203 podStartE2EDuration="1.757287203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:28:00.755288569 +0000 UTC m=+3060.392081297" watchObservedRunningTime="2026-07-31 02:28:00.757287203 +0000 UTC m=+3060.394079921"
Jul 31 02:28:02.590278 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:02.590228    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:28:10.120822 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:10.120783    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:28:10.120822 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:10.120834    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:28:10.133148 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:10.133119    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:28:10.797810 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:10.797780    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:28:30.386293 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:30.386254    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:28:46.292955 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:46.292916    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:28:58.295068 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:28:58.295031    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:29:12.686082 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:29:12.686037    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:29:23.990326 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:29:23.990247    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:29:38.999132 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:29:38.999086    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:29:50.687863 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:29:50.687820    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:30:05.894720 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:30:05.894683    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:30:16.998916 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:30:16.998876    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:30:32.392085 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:30:32.392046    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:30:44.192427 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:30:44.192382    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:30:59.091143 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:30:59.091057    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:31:03.073688 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:03.073653    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"]
Jul 31 02:31:04.005162 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:04.005129    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"]
Jul 31 02:31:08.498554 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.498521    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"]
Jul 31 02:31:08.501880 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.501863    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.504271 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.504250    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"sub-test-model-2aed0b-kserve-self-signed-certs\""
Jul 31 02:31:08.511995 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.511973    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"]
Jul 31 02:31:08.575769 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.575718    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-dshm\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.575938 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.575829    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tmp-dir\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.575938 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.575849    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-home\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.575938 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.575865    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-model-cache\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.575938 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.575880    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tls-certs\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.576333 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.575936    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2br9q\" (UniqueName: \"kubernetes.io/projected/66c19598-0f73-4556-bd6e-e6b8dfc15a35-kube-api-access-2br9q\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.676789 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.676725    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tmp-dir\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.676960 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.676795    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-home\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.676960 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.676817    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-model-cache\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.676960 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.676837    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tls-certs\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.676960 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.676872    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2br9q\" (UniqueName: \"kubernetes.io/projected/66c19598-0f73-4556-bd6e-e6b8dfc15a35-kube-api-access-2br9q\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.676960 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.676946    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-dshm\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.677218 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.677163    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tmp-dir\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.677218 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.677188    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-model-cache\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.677340 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.677249    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-home\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.679298 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.679275    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-dshm\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.679464 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.679447    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tls-certs\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.685377 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.685355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2br9q\" (UniqueName: \"kubernetes.io/projected/66c19598-0f73-4556-bd6e-e6b8dfc15a35-kube-api-access-2br9q\") pod \"sub-test-model-2aed0b-kserve-7974679475-nzgm8\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") " pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.811491 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.811454    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:08.949384 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:08.949360    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"]
Jul 31 02:31:08.951515 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:31:08.951490    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66c19598_0f73_4556_bd6e_e6b8dfc15a35.slice/crio-f55befdc9deaaf949f470284aacfaef75700616a8dea3565ec49d8486e8a5115 WatchSource:0}: Error finding container f55befdc9deaaf949f470284aacfaef75700616a8dea3565ec49d8486e8a5115: Status 404 returned error can't find the container with id f55befdc9deaaf949f470284aacfaef75700616a8dea3565ec49d8486e8a5115
Jul 31 02:31:09.100630 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:09.100545    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:31:09.742139 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:09.742100    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" event={"ID":"66c19598-0f73-4556-bd6e-e6b8dfc15a35","Type":"ContainerStarted","Data":"adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018"}
Jul 31 02:31:09.742514 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:09.742149    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" event={"ID":"66c19598-0f73-4556-bd6e-e6b8dfc15a35","Type":"ContainerStarted","Data":"f55befdc9deaaf949f470284aacfaef75700616a8dea3565ec49d8486e8a5115"}
Jul 31 02:31:09.762190 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:09.762143    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" podStartSLOduration=1.76212792 podStartE2EDuration="1.76212792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:31:09.760409311 +0000 UTC m=+3249.397202032" watchObservedRunningTime="2026-07-31 02:31:09.76212792 +0000 UTC m=+3249.398920641"
Jul 31 02:31:15.087553 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:15.087518    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:31:18.094945 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.094862    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s" podUID="4b006d0b-3b94-47bb-bb0f-909b7f10a986" containerName="main" containerID="cri-o://7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5" gracePeriod=45
Jul 31 02:31:18.344555 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.344529    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:31:18.463789 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463682    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-home\") pod \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") "
Jul 31 02:31:18.463789 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463731    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwpwc\" (UniqueName: \"kubernetes.io/projected/4b006d0b-3b94-47bb-bb0f-909b7f10a986-kube-api-access-vwpwc\") pod \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") "
Jul 31 02:31:18.463789 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463778    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-model-cache\") pod \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") "
Jul 31 02:31:18.464094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463812    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tls-certs\") pod \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") "
Jul 31 02:31:18.464094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-dshm\") pod \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") "
Jul 31 02:31:18.464094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463867    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tmp-dir\") pod \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\" (UID: \"4b006d0b-3b94-47bb-bb0f-909b7f10a986\") "
Jul 31 02:31:18.464094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.463975    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-home" (OuterVolumeSpecName: "home") pod "4b006d0b-3b94-47bb-bb0f-909b7f10a986" (UID: "4b006d0b-3b94-47bb-bb0f-909b7f10a986"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:18.464094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.464081    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b006d0b-3b94-47bb-bb0f-909b7f10a986" (UID: "4b006d0b-3b94-47bb-bb0f-909b7f10a986"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:18.464369 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.464172    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b006d0b-3b94-47bb-bb0f-909b7f10a986" (UID: "4b006d0b-3b94-47bb-bb0f-909b7f10a986"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:18.464369 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.464201    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:18.464369 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.464227    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:18.466204 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.466180    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-dshm" (OuterVolumeSpecName: "dshm") pod "4b006d0b-3b94-47bb-bb0f-909b7f10a986" (UID: "4b006d0b-3b94-47bb-bb0f-909b7f10a986"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:18.466314 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.466244    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b006d0b-3b94-47bb-bb0f-909b7f10a986-kube-api-access-vwpwc" (OuterVolumeSpecName: "kube-api-access-vwpwc") pod "4b006d0b-3b94-47bb-bb0f-909b7f10a986" (UID: "4b006d0b-3b94-47bb-bb0f-909b7f10a986"). InnerVolumeSpecName "kube-api-access-vwpwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:31:18.466314 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.466270    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b006d0b-3b94-47bb-bb0f-909b7f10a986" (UID: "4b006d0b-3b94-47bb-bb0f-909b7f10a986"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:31:18.564724 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.564689    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:18.564930 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.564738    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:18.564930 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.564781    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwpwc\" (UniqueName: \"kubernetes.io/projected/4b006d0b-3b94-47bb-bb0f-909b7f10a986-kube-api-access-vwpwc\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:18.564930 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.564798    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b006d0b-3b94-47bb-bb0f-909b7f10a986-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:18.798875 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.798836    2555 generic.go:356] "Generic (PLEG): container finished" podID="4b006d0b-3b94-47bb-bb0f-909b7f10a986" containerID="7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5" exitCode=0
Jul 31 02:31:18.799038 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.798880    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"
Jul 31 02:31:18.799038 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.798928    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s" event={"ID":"4b006d0b-3b94-47bb-bb0f-909b7f10a986","Type":"ContainerDied","Data":"7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5"}
Jul 31 02:31:18.799038 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.798975    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s" event={"ID":"4b006d0b-3b94-47bb-bb0f-909b7f10a986","Type":"ContainerDied","Data":"6e2c20d02201d32a0aadf28b6ac097b263a173ee793206221960e26e392d88c2"}
Jul 31 02:31:18.799038 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.798993    2555 scope.go:117] "RemoveContainer" containerID="7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5"
Jul 31 02:31:18.808785 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.808770    2555 scope.go:117] "RemoveContainer" containerID="7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5"
Jul 31 02:31:18.809051 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:31:18.809033    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5\": container with ID starting with 7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5 not found: ID does not exist" containerID="7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5"
Jul 31 02:31:18.809103 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.809060    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5"} err="failed to get container status \"7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5\": rpc error: code = NotFound desc = could not find container \"7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5\": container with ID starting with 7a4d0163ce2ac6f239d6aa6a9fd194605f25096f1cda79430a6eaa9e9ee462a5 not found: ID does not exist"
Jul 31 02:31:18.811554 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.811536    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:18.811600 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.811574    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:18.820374 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.820349    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"]
Jul 31 02:31:18.824196 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.824173    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/auth-test-model-2aed0b-kserve-6dd554ccf5-th42s"]
Jul 31 02:31:18.824808 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.824789    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:18.925645 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:18.925604    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b006d0b-3b94-47bb-bb0f-909b7f10a986" path="/var/lib/kubelet/pods/4b006d0b-3b94-47bb-bb0f-909b7f10a986/volumes"
Jul 31 02:31:19.026111 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.026066    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p" podUID="2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" containerName="main" containerID="cri-o://b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b" gracePeriod=45
Jul 31 02:31:19.282376 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.282349    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:31:19.371270 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371180    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-model-cache\") pod \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") "
Jul 31 02:31:19.371270 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371217    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-home\") pod \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") "
Jul 31 02:31:19.371270 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371252    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwj7k\" (UniqueName: \"kubernetes.io/projected/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-kube-api-access-kwj7k\") pod \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") "
Jul 31 02:31:19.371525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371294    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-dshm\") pod \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") "
Jul 31 02:31:19.371525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371341    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tmp-dir\") pod \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") "
Jul 31 02:31:19.371525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371400    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tls-certs\") pod \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\" (UID: \"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c\") "
Jul 31 02:31:19.371525 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371490    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-home" (OuterVolumeSpecName: "home") pod "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" (UID: "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:19.371738 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371506    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-model-cache" (OuterVolumeSpecName: "model-cache") pod "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" (UID: "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:19.371738 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371632    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" (UID: "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:19.371738 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371733    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:19.371911 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371780    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:19.371911 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.371791    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:19.373728 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.373704    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" (UID: "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:31:19.374040 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.374012    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-dshm" (OuterVolumeSpecName: "dshm") pod "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" (UID: "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:31:19.374040 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.374017    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-kube-api-access-kwj7k" (OuterVolumeSpecName: "kube-api-access-kwj7k") pod "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" (UID: "2113bd3e-0e2a-4b8f-a56e-a0f20036f19c"). InnerVolumeSpecName "kube-api-access-kwj7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:31:19.473197 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.473144    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:19.473197 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.473191    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwj7k\" (UniqueName: \"kubernetes.io/projected/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-kube-api-access-kwj7k\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:19.473197 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.473202    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:31:19.806219 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.806187    2555 generic.go:356] "Generic (PLEG): container finished" podID="2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" containerID="b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b" exitCode=0
Jul 31 02:31:19.806406 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.806229    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"
Jul 31 02:31:19.806406 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.806269    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p" event={"ID":"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c","Type":"ContainerDied","Data":"b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b"}
Jul 31 02:31:19.806406 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.806315    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p" event={"ID":"2113bd3e-0e2a-4b8f-a56e-a0f20036f19c","Type":"ContainerDied","Data":"853a8efa164097fad1c6827a8f1bd9234fef82fe31c4cab394cb75ba35ae5f6d"}
Jul 31 02:31:19.806406 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.806339    2555 scope.go:117] "RemoveContainer" containerID="b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b"
Jul 31 02:31:19.816810 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.816737    2555 scope.go:117] "RemoveContainer" containerID="b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b"
Jul 31 02:31:19.817074 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:31:19.817056    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b\": container with ID starting with b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b not found: ID does not exist" containerID="b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b"
Jul 31 02:31:19.817148 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.817087    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b"} err="failed to get container status \"b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b\": rpc error: code = NotFound desc = could not find container \"b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b\": container with ID starting with b866c2adb835678499630e7f413d1ae93cf8df9930167f3d4670b5d8abb0780b not found: ID does not exist"
Jul 31 02:31:19.823279 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.823254    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:31:19.827674 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.827654    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"]
Jul 31 02:31:19.835969 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:19.835950    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/auth-test-model-01a44c-kserve-79cf49c96c-p6s2p"]
Jul 31 02:31:20.925503 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:20.925471    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" path="/var/lib/kubelet/pods/2113bd3e-0e2a-4b8f-a56e-a0f20036f19c/volumes"
Jul 31 02:31:40.397170 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397135    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"]
Jul 31 02:31:40.397566 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397463    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" containerName="main"
Jul 31 02:31:40.397566 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397474    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" containerName="main"
Jul 31 02:31:40.397566 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397504    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b006d0b-3b94-47bb-bb0f-909b7f10a986" containerName="main"
Jul 31 02:31:40.397566 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397509    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b006d0b-3b94-47bb-bb0f-909b7f10a986" containerName="main"
Jul 31 02:31:40.397707 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397578    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b006d0b-3b94-47bb-bb0f-909b7f10a986" containerName="main"
Jul 31 02:31:40.397707 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.397585    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2113bd3e-0e2a-4b8f-a56e-a0f20036f19c" containerName="main"
Jul 31 02:31:40.401654 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.401637    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.408331 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.408221    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"openshift-service-ca.crt\""
Jul 31 02:31:40.408331 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.408228    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"kube-root-ca.crt\""
Jul 31 02:31:40.408331 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.408266    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"sub-test-model-01a44c-kserve-self-signed-certs\""
Jul 31 02:31:40.408614 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.408594    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"default-dockercfg-xw597\""
Jul 31 02:31:40.417185 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.417161    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"]
Jul 31 02:31:40.457493 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.457456    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-home\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.457673 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.457504    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5fwb\" (UniqueName: \"kubernetes.io/projected/4676c9f7-75b2-4169-a0c9-5645ca266b43-kube-api-access-t5fwb\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.457673 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.457605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-model-cache\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.457673 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.457645    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-tmp-dir\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.457673 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.457666    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676c9f7-75b2-4169-a0c9-5645ca266b43-tls-certs\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.457889 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.457690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-dshm\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.558512 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-model-cache\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.558679 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-tmp-dir\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.558679 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676c9f7-75b2-4169-a0c9-5645ca266b43-tls-certs\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.558679 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-dshm\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.558679 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558615    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-home\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.558679 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5fwb\" (UniqueName: \"kubernetes.io/projected/4676c9f7-75b2-4169-a0c9-5645ca266b43-kube-api-access-t5fwb\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.559013 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.558986    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-tmp-dir\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.559089 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.559067    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-model-cache\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.559156 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.559129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-home\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.561171 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.561145    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-dshm\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.561335 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.561317    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676c9f7-75b2-4169-a0c9-5645ca266b43-tls-certs\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.568091 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.568066    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5fwb\" (UniqueName: \"kubernetes.io/projected/4676c9f7-75b2-4169-a0c9-5645ca266b43-kube-api-access-t5fwb\") pod \"sub-test-model-01a44c-kserve-5bd5498497-rrccv\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") " pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.710980 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.710891    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:40.846696 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.846665    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"]
Jul 31 02:31:40.848060 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:31:40.848023    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4676c9f7_75b2_4169_a0c9_5645ca266b43.slice/crio-c1693125bc326e5d06272a0d6609f1da138619bb82a5b35532ac3e5d36dedecf WatchSource:0}: Error finding container c1693125bc326e5d06272a0d6609f1da138619bb82a5b35532ac3e5d36dedecf: Status 404 returned error can't find the container with id c1693125bc326e5d06272a0d6609f1da138619bb82a5b35532ac3e5d36dedecf
Jul 31 02:31:40.926732 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:40.926696    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv" event={"ID":"4676c9f7-75b2-4169-a0c9-5645ca266b43","Type":"ContainerStarted","Data":"c1693125bc326e5d06272a0d6609f1da138619bb82a5b35532ac3e5d36dedecf"}
Jul 31 02:31:41.927056 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:41.927021    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv" event={"ID":"4676c9f7-75b2-4169-a0c9-5645ca266b43","Type":"ContainerStarted","Data":"0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d"}
Jul 31 02:31:41.943716 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:41.943662    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv" podStartSLOduration=1.94364704 podStartE2EDuration="1.94364704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:31:41.942085567 +0000 UTC m=+3281.578878289" watchObservedRunningTime="2026-07-31 02:31:41.94364704 +0000 UTC m=+3281.580439759"
Jul 31 02:31:42.993989 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:42.993956    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:31:50.711009 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:50.710966    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:50.711516 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:50.711021    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:50.723501 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:50.723461    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:31:50.984494 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:31:50.984408    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:32:01.112824 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:01.112792    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:32:01.121382 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:01.121358    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:32:16.489908 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:16.489872    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:32:28.298252 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:28.298172    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:32:39.894664 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:39.894626    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:32:44.650823 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:44.650785    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"]
Jul 31 02:32:45.678168 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:45.678134    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"]
Jul 31 02:32:50.387424 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:50.387391    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:32:59.670529 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:59.670483    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" podUID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" containerName="main" containerID="cri-o://adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018" gracePeriod=45
Jul 31 02:32:59.806774 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:59.806699    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" podUID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": dial tcp 10.132.0.51:8000: connect: connection refused"
Jul 31 02:32:59.926638 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:32:59.926577    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:33:00.062171 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062127    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-home\") pod \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") "
Jul 31 02:33:00.062375 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062197    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tmp-dir\") pod \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") "
Jul 31 02:33:00.062375 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062223    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tls-certs\") pod \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") "
Jul 31 02:33:00.062375 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062260    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-model-cache\") pod \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") "
Jul 31 02:33:00.062375 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062301    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2br9q\" (UniqueName: \"kubernetes.io/projected/66c19598-0f73-4556-bd6e-e6b8dfc15a35-kube-api-access-2br9q\") pod \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") "
Jul 31 02:33:00.062597 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062377    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-dshm\") pod \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\" (UID: \"66c19598-0f73-4556-bd6e-e6b8dfc15a35\") "
Jul 31 02:33:00.062597 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062445    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-home" (OuterVolumeSpecName: "home") pod "66c19598-0f73-4556-bd6e-e6b8dfc15a35" (UID: "66c19598-0f73-4556-bd6e-e6b8dfc15a35"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:00.062597 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062496    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "66c19598-0f73-4556-bd6e-e6b8dfc15a35" (UID: "66c19598-0f73-4556-bd6e-e6b8dfc15a35"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:00.062597 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062528    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-model-cache" (OuterVolumeSpecName: "model-cache") pod "66c19598-0f73-4556-bd6e-e6b8dfc15a35" (UID: "66c19598-0f73-4556-bd6e-e6b8dfc15a35"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:00.062828 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062646    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:00.062828 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062658    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:00.062828 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.062667    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:00.064582 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.064562    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-dshm" (OuterVolumeSpecName: "dshm") pod "66c19598-0f73-4556-bd6e-e6b8dfc15a35" (UID: "66c19598-0f73-4556-bd6e-e6b8dfc15a35"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:00.064657 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.064578    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "66c19598-0f73-4556-bd6e-e6b8dfc15a35" (UID: "66c19598-0f73-4556-bd6e-e6b8dfc15a35"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:33:00.064657 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.064592    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c19598-0f73-4556-bd6e-e6b8dfc15a35-kube-api-access-2br9q" (OuterVolumeSpecName: "kube-api-access-2br9q") pod "66c19598-0f73-4556-bd6e-e6b8dfc15a35" (UID: "66c19598-0f73-4556-bd6e-e6b8dfc15a35"). InnerVolumeSpecName "kube-api-access-2br9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:33:00.163614 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.163581    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2br9q\" (UniqueName: \"kubernetes.io/projected/66c19598-0f73-4556-bd6e-e6b8dfc15a35-kube-api-access-2br9q\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:00.163614 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.163609    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66c19598-0f73-4556-bd6e-e6b8dfc15a35-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:00.163614 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.163619    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66c19598-0f73-4556-bd6e-e6b8dfc15a35-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:00.334413 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.334374    2555 generic.go:356] "Generic (PLEG): container finished" podID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" containerID="adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018" exitCode=0
Jul 31 02:33:00.334620 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.334423    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"
Jul 31 02:33:00.334620 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.334458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" event={"ID":"66c19598-0f73-4556-bd6e-e6b8dfc15a35","Type":"ContainerDied","Data":"adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018"}
Jul 31 02:33:00.334620 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.334504    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8" event={"ID":"66c19598-0f73-4556-bd6e-e6b8dfc15a35","Type":"ContainerDied","Data":"f55befdc9deaaf949f470284aacfaef75700616a8dea3565ec49d8486e8a5115"}
Jul 31 02:33:00.334620 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.334523    2555 scope.go:117] "RemoveContainer" containerID="adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018"
Jul 31 02:33:00.351021 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.351002    2555 scope.go:117] "RemoveContainer" containerID="adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018"
Jul 31 02:33:00.351305 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:33:00.351287    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018\": container with ID starting with adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018 not found: ID does not exist" containerID="adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018"
Jul 31 02:33:00.351351 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.351315    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018"} err="failed to get container status \"adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018\": rpc error: code = NotFound desc = could not find container \"adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018\": container with ID starting with adbcb2c3971be3284c35e65ed4a66b53c3263ca595ccef3b84b428d0118ef018 not found: ID does not exist"
Jul 31 02:33:00.360609 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.360582    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"]
Jul 31 02:33:00.364699 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.364675    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/sub-test-model-2aed0b-kserve-7974679475-nzgm8"]
Jul 31 02:33:00.697774 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.697667    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv" podUID="4676c9f7-75b2-4169-a0c9-5645ca266b43" containerName="main" containerID="cri-o://0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d" gracePeriod=45
Jul 31 02:33:00.927441 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.927409    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" path="/var/lib/kubelet/pods/66c19598-0f73-4556-bd6e-e6b8dfc15a35/volumes"
Jul 31 02:33:00.946299 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:00.946276    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:33:01.073448 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073418    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5fwb\" (UniqueName: \"kubernetes.io/projected/4676c9f7-75b2-4169-a0c9-5645ca266b43-kube-api-access-t5fwb\") pod \"4676c9f7-75b2-4169-a0c9-5645ca266b43\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") "
Jul 31 02:33:01.073616 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073485    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-home\") pod \"4676c9f7-75b2-4169-a0c9-5645ca266b43\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") "
Jul 31 02:33:01.073616 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073503    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676c9f7-75b2-4169-a0c9-5645ca266b43-tls-certs\") pod \"4676c9f7-75b2-4169-a0c9-5645ca266b43\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") "
Jul 31 02:33:01.073616 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073546    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-model-cache\") pod \"4676c9f7-75b2-4169-a0c9-5645ca266b43\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") "
Jul 31 02:33:01.073616 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073577    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-dshm\") pod \"4676c9f7-75b2-4169-a0c9-5645ca266b43\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") "
Jul 31 02:33:01.073616 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073595    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-tmp-dir\") pod \"4676c9f7-75b2-4169-a0c9-5645ca266b43\" (UID: \"4676c9f7-75b2-4169-a0c9-5645ca266b43\") "
Jul 31 02:33:01.073910 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073738    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-home" (OuterVolumeSpecName: "home") pod "4676c9f7-75b2-4169-a0c9-5645ca266b43" (UID: "4676c9f7-75b2-4169-a0c9-5645ca266b43"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:01.073910 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073841    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-model-cache" (OuterVolumeSpecName: "model-cache") pod "4676c9f7-75b2-4169-a0c9-5645ca266b43" (UID: "4676c9f7-75b2-4169-a0c9-5645ca266b43"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:01.074022 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.073951    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4676c9f7-75b2-4169-a0c9-5645ca266b43" (UID: "4676c9f7-75b2-4169-a0c9-5645ca266b43"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:01.074098 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.074076    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:01.074098 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.074097    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:01.074205 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.074106    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:01.075898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.075878    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4676c9f7-75b2-4169-a0c9-5645ca266b43-kube-api-access-t5fwb" (OuterVolumeSpecName: "kube-api-access-t5fwb") pod "4676c9f7-75b2-4169-a0c9-5645ca266b43" (UID: "4676c9f7-75b2-4169-a0c9-5645ca266b43"). InnerVolumeSpecName "kube-api-access-t5fwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:33:01.076010 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.075916    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-dshm" (OuterVolumeSpecName: "dshm") pod "4676c9f7-75b2-4169-a0c9-5645ca266b43" (UID: "4676c9f7-75b2-4169-a0c9-5645ca266b43"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:33:01.076098 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.076079    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4676c9f7-75b2-4169-a0c9-5645ca266b43-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4676c9f7-75b2-4169-a0c9-5645ca266b43" (UID: "4676c9f7-75b2-4169-a0c9-5645ca266b43"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:33:01.174743 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.174703    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5fwb\" (UniqueName: \"kubernetes.io/projected/4676c9f7-75b2-4169-a0c9-5645ca266b43-kube-api-access-t5fwb\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:01.174743 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.174733    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676c9f7-75b2-4169-a0c9-5645ca266b43-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:01.174743 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.174758    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676c9f7-75b2-4169-a0c9-5645ca266b43-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:33:01.341132 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.341046    2555 generic.go:356] "Generic (PLEG): container finished" podID="4676c9f7-75b2-4169-a0c9-5645ca266b43" containerID="0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d" exitCode=0
Jul 31 02:33:01.341132 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.341088    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"
Jul 31 02:33:01.341344 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.341127    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv" event={"ID":"4676c9f7-75b2-4169-a0c9-5645ca266b43","Type":"ContainerDied","Data":"0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d"}
Jul 31 02:33:01.341344 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.341167    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv" event={"ID":"4676c9f7-75b2-4169-a0c9-5645ca266b43","Type":"ContainerDied","Data":"c1693125bc326e5d06272a0d6609f1da138619bb82a5b35532ac3e5d36dedecf"}
Jul 31 02:33:01.341344 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.341187    2555 scope.go:117] "RemoveContainer" containerID="0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d"
Jul 31 02:33:01.350316 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.350298    2555 scope.go:117] "RemoveContainer" containerID="0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d"
Jul 31 02:33:01.350580 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:33:01.350561    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d\": container with ID starting with 0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d not found: ID does not exist" containerID="0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d"
Jul 31 02:33:01.350647 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.350587    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d"} err="failed to get container status \"0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d\": rpc error: code = NotFound desc = could not find container \"0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d\": container with ID starting with 0f2a358745990d4230ea35ea601a8438144abea3a150bc996519bc4466fa976d not found: ID does not exist"
Jul 31 02:33:01.361810 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.361780    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"]
Jul 31 02:33:01.365577 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:01.365555    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/sub-test-model-01a44c-kserve-5bd5498497-rrccv"]
Jul 31 02:33:02.926485 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:02.926450    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4676c9f7-75b2-4169-a0c9-5645ca266b43" path="/var/lib/kubelet/pods/4676c9f7-75b2-4169-a0c9-5645ca266b43/volumes"
Jul 31 02:33:18.202558 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.202516    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"]
Jul 31 02:33:18.203075 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.203049    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" containerName="main"
Jul 31 02:33:18.203075 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.203067    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" containerName="main"
Jul 31 02:33:18.203208 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.203112    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4676c9f7-75b2-4169-a0c9-5645ca266b43" containerName="main"
Jul 31 02:33:18.203208 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.203122    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4676c9f7-75b2-4169-a0c9-5645ca266b43" containerName="main"
Jul 31 02:33:18.203308 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.203217    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c19598-0f73-4556-bd6e-e6b8dfc15a35" containerName="main"
Jul 31 02:33:18.203308 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.203234    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4676c9f7-75b2-4169-a0c9-5645ca266b43" containerName="main"
Jul 31 02:33:18.206064 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.206043    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.209776 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.209682    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"rate-test-model-2aed0b-kserve-self-signed-certs\""
Jul 31 02:33:18.209776 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.209725    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"kube-root-ca.crt\""
Jul 31 02:33:18.209776 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.209687    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"default-dockercfg-drcd9\""
Jul 31 02:33:18.209776 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.209731    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2aed0b\"/\"openshift-service-ca.crt\""
Jul 31 02:33:18.213663 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.213643    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"]
Jul 31 02:33:18.324668 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.324631    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-home\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.324668 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.324673    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tls-certs\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.324939 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.324710    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-dshm\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.324939 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.324835    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnk5w\" (UniqueName: \"kubernetes.io/projected/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-kube-api-access-fnk5w\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.324939 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.324875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tmp-dir\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.324939 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.324898    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-model-cache\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426400 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-dshm\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426598 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426436    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnk5w\" (UniqueName: \"kubernetes.io/projected/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-kube-api-access-fnk5w\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426598 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426477    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tmp-dir\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426598 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426507    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-model-cache\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426598 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-home\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426598 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426585    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tls-certs\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.426938 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426909    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tmp-dir\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.427005 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426950    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-model-cache\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.427005 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.426989    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-home\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.428840 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.428822    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-dshm\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.429250 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.429234    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tls-certs\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.434382 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.434363    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnk5w\" (UniqueName: \"kubernetes.io/projected/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-kube-api-access-fnk5w\") pod \"rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") " pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.516344 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.516245    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:18.654717 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:18.654686    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"]
Jul 31 02:33:18.656097 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:33:18.656066    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38a9b94f_531b_4ef4_b0f4_ef3e0967e7d5.slice/crio-a3389d0425a5ca7163cd5df1c07ed3625da47d84436e3d12840af70cb9cdcd06 WatchSource:0}: Error finding container a3389d0425a5ca7163cd5df1c07ed3625da47d84436e3d12840af70cb9cdcd06: Status 404 returned error can't find the container with id a3389d0425a5ca7163cd5df1c07ed3625da47d84436e3d12840af70cb9cdcd06
Jul 31 02:33:19.435628 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:19.435586    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj" event={"ID":"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5","Type":"ContainerStarted","Data":"2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f"}
Jul 31 02:33:19.436017 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:19.435641    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj" event={"ID":"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5","Type":"ContainerStarted","Data":"a3389d0425a5ca7163cd5df1c07ed3625da47d84436e3d12840af70cb9cdcd06"}
Jul 31 02:33:19.453672 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:19.453618    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj" podStartSLOduration=1.4535987559999999 podStartE2EDuration="1.453598756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:33:19.453100778 +0000 UTC m=+3379.089893497" watchObservedRunningTime="2026-07-31 02:33:19.453598756 +0000 UTC m=+3379.090391476"
Jul 31 02:33:20.991074 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:20.991038    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:33:28.516608 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:28.516560    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:28.517035 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:28.516621    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:28.529303 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:28.529278    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:29.504088 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:29.504058    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:33:57.100370 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.100282    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"]
Jul 31 02:33:57.103823 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.103805    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.107323 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.107296    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"openshift-service-ca.crt\""
Jul 31 02:33:57.107463 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.107353    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"default-dockercfg-xw597\""
Jul 31 02:33:57.107463 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.107401    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"kube-root-ca.crt\""
Jul 31 02:33:57.107463 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.107407    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01a44c\"/\"rate-test-model-01a44c-kserve-self-signed-certs\""
Jul 31 02:33:57.113545 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.113523    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"]
Jul 31 02:33:57.257304 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.257244    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrnm7\" (UniqueName: \"kubernetes.io/projected/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-kube-api-access-lrnm7\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.257499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.257309    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-model-cache\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.257499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.257345    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tls-certs\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.257499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.257404    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-home\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.257499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.257435    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-dshm\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.257499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.257493    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tmp-dir\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358239 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358131    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-home\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358239 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358185    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-dshm\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358239 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358228    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tmp-dir\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358239 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358249    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrnm7\" (UniqueName: \"kubernetes.io/projected/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-kube-api-access-lrnm7\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358518 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358270    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-model-cache\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358518 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tls-certs\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358633 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358607    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-home\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358675 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tmp-dir\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.358675 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.358660    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-model-cache\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.360841 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.360821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-dshm\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.361000 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.360983    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tls-certs\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.366573 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.366545    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrnm7\" (UniqueName: \"kubernetes.io/projected/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-kube-api-access-lrnm7\") pod \"rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") " pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.414742 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.414697    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:33:57.553774 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.553571    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"]
Jul 31 02:33:57.556725 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:33:57.556700    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a3bb4d6_6b08_4f1f_bb85_be8b75782bca.slice/crio-05871d3205f28e60e2b327087b23c3573e410500d1fca455558fd1f6a6638bc9 WatchSource:0}: Error finding container 05871d3205f28e60e2b327087b23c3573e410500d1fca455558fd1f6a6638bc9: Status 404 returned error can't find the container with id 05871d3205f28e60e2b327087b23c3573e410500d1fca455558fd1f6a6638bc9
Jul 31 02:33:57.647001 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.646963    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx" event={"ID":"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca","Type":"ContainerStarted","Data":"0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c"}
Jul 31 02:33:57.647196 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.647013    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx" event={"ID":"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca","Type":"ContainerStarted","Data":"05871d3205f28e60e2b327087b23c3573e410500d1fca455558fd1f6a6638bc9"}
Jul 31 02:33:57.665663 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:57.665613    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx" podStartSLOduration=0.665596912 podStartE2EDuration="665.596912ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:33:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:33:57.66418595 +0000 UTC m=+3417.300978688" watchObservedRunningTime="2026-07-31 02:33:57.665596912 +0000 UTC m=+3417.302389632"
Jul 31 02:33:59.699100 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:33:59.699060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:34:07.415589 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:34:07.415546    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:34:07.416045 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:34:07.415605    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:34:07.427978 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:34:07.427946    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:34:07.713310 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:34:07.713229    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:34:38.790046 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:34:38.790010    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:34:46.399098 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:34:46.399060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:35:03.493159 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:03.493122    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:35:09.085293 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:09.085254    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"]
Jul 31 02:35:10.093650 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:10.093614    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"]
Jul 31 02:35:12.113911 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:12.113873    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:35:24.105889 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.105766    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj" podUID="38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" containerName="main" containerID="cri-o://2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f" gracePeriod=45
Jul 31 02:35:24.358051 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.357995    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:35:24.434695 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.434663    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tls-certs\") pod \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") "
Jul 31 02:35:24.434898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.434727    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tmp-dir\") pod \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") "
Jul 31 02:35:24.434898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.434778    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnk5w\" (UniqueName: \"kubernetes.io/projected/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-kube-api-access-fnk5w\") pod \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") "
Jul 31 02:35:24.434898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.434824    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-dshm\") pod \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") "
Jul 31 02:35:24.434898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.434843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-home\") pod \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") "
Jul 31 02:35:24.434898 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.434859    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-model-cache\") pod \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\" (UID: \"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5\") "
Jul 31 02:35:24.435191 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.435028    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" (UID: "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:24.435191 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.435117    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:24.435191 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.435132    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" (UID: "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:24.435191 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.435148    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-home" (OuterVolumeSpecName: "home") pod "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" (UID: "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:24.437099 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.437073    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-dshm" (OuterVolumeSpecName: "dshm") pod "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" (UID: "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:24.437184 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.437094    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-kube-api-access-fnk5w" (OuterVolumeSpecName: "kube-api-access-fnk5w") pod "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" (UID: "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5"). InnerVolumeSpecName "kube-api-access-fnk5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:24.437184 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.437133    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" (UID: "38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:35:24.536203 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.536158    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:24.536203 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.536192    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:24.536203 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.536204    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:24.536453 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.536216    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:24.536453 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:24.536228    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnk5w\" (UniqueName: \"kubernetes.io/projected/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5-kube-api-access-fnk5w\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:25.102841 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.102792    2555 generic.go:356] "Generic (PLEG): container finished" podID="38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" containerID="2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f" exitCode=0
Jul 31 02:35:25.102841 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.102838    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"
Jul 31 02:35:25.102841 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.102838    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj" event={"ID":"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5","Type":"ContainerDied","Data":"2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f"}
Jul 31 02:35:25.103167 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.102896    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj" event={"ID":"38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5","Type":"ContainerDied","Data":"a3389d0425a5ca7163cd5df1c07ed3625da47d84436e3d12840af70cb9cdcd06"}
Jul 31 02:35:25.103167 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.102920    2555 scope.go:117] "RemoveContainer" containerID="2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f"
Jul 31 02:35:25.112984 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.112793    2555 scope.go:117] "RemoveContainer" containerID="2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f"
Jul 31 02:35:25.113247 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:35:25.113095    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f\": container with ID starting with 2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f not found: ID does not exist" containerID="2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f"
Jul 31 02:35:25.113247 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.113132    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f"} err="failed to get container status \"2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f\": rpc error: code = NotFound desc = could not find container \"2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f\": container with ID starting with 2cf7b3aba403ed828f064bccd5530028c1e2f44a8830048bd5fc3e037c191a8f not found: ID does not exist"
Jul 31 02:35:25.114043 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.114016    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx" podUID="6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" containerName="main" containerID="cri-o://0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c" gracePeriod=45
Jul 31 02:35:25.119832 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.119810    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"]
Jul 31 02:35:25.124245 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.124217    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2aed0b/rate-test-model-2aed0b-kserve-79697fc4b7-bgqdj"]
Jul 31 02:35:25.361943 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.361918    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:35:25.445462 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-model-cache\") pod \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") "
Jul 31 02:35:25.445462 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445476    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tmp-dir\") pod \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") "
Jul 31 02:35:25.445690 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445504    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-dshm\") pod \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") "
Jul 31 02:35:25.445690 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445572    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrnm7\" (UniqueName: \"kubernetes.io/projected/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-kube-api-access-lrnm7\") pod \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") "
Jul 31 02:35:25.445690 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445617    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tls-certs\") pod \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") "
Jul 31 02:35:25.445690 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445646    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-home\") pod \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\" (UID: \"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca\") "
Jul 31 02:35:25.445947 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445730    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" (UID: "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:25.445947 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445795    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" (UID: "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:25.446057 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445954    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:25.446057 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445969    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:25.446057 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.445968    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-home" (OuterVolumeSpecName: "home") pod "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" (UID: "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:25.447880 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.447853    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-dshm" (OuterVolumeSpecName: "dshm") pod "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" (UID: "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:35:25.447993 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.447890    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-kube-api-access-lrnm7" (OuterVolumeSpecName: "kube-api-access-lrnm7") pod "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" (UID: "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca"). InnerVolumeSpecName "kube-api-access-lrnm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:25.447993 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.447936    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" (UID: "6a3bb4d6-6b08-4f1f-bb85-be8b75782bca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:35:25.547166 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.547138    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrnm7\" (UniqueName: \"kubernetes.io/projected/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-kube-api-access-lrnm7\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:25.547166 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.547166    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:25.547360 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.547177    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:25.547360 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:25.547185    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:35:26.110094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.110055    2555 generic.go:356] "Generic (PLEG): container finished" podID="6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" containerID="0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c" exitCode=0
Jul 31 02:35:26.110278 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.110110    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx" event={"ID":"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca","Type":"ContainerDied","Data":"0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c"}
Jul 31 02:35:26.110278 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.110114    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"
Jul 31 02:35:26.110278 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.110142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx" event={"ID":"6a3bb4d6-6b08-4f1f-bb85-be8b75782bca","Type":"ContainerDied","Data":"05871d3205f28e60e2b327087b23c3573e410500d1fca455558fd1f6a6638bc9"}
Jul 31 02:35:26.110278 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.110159    2555 scope.go:117] "RemoveContainer" containerID="0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c"
Jul 31 02:35:26.120294 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.120121    2555 scope.go:117] "RemoveContainer" containerID="0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c"
Jul 31 02:35:26.120552 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:35:26.120445    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c\": container with ID starting with 0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c not found: ID does not exist" containerID="0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c"
Jul 31 02:35:26.120552 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.120470    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c"} err="failed to get container status \"0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c\": rpc error: code = NotFound desc = could not find container \"0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c\": container with ID starting with 0ed9272451a24c1f0cd966b2eed978b769bbeeb42f3de5c3cd12fac73f60a03c not found: ID does not exist"
Jul 31 02:35:26.133735 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.133707    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"]
Jul 31 02:35:26.138048 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.138025    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01a44c/rate-test-model-01a44c-kserve-5dfb485cdc-vw2qx"]
Jul 31 02:35:26.926414 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.926379    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" path="/var/lib/kubelet/pods/38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5/volumes"
Jul 31 02:35:26.926811 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:26.926795    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" path="/var/lib/kubelet/pods/6a3bb4d6-6b08-4f1f-bb85-be8b75782bca/volumes"
Jul 31 02:35:37.288954 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:35:37.288916    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:36:07.298519 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:07.298478    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:36:39.391151 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391113    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"]
Jul 31 02:36:39.391651 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391601    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" containerName="main"
Jul 31 02:36:39.391697 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391655    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" containerName="main"
Jul 31 02:36:39.391736 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391705    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" containerName="main"
Jul 31 02:36:39.391736 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391716    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" containerName="main"
Jul 31 02:36:39.391830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391818    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a9b94f-531b-4ef4-b0f4-ef3e0967e7d5" containerName="main"
Jul 31 02:36:39.391866 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.391838    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a3bb4d6-6b08-4f1f-bb85-be8b75782bca" containerName="main"
Jul 31 02:36:39.395146 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.395129    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.399047 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.398944    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e0efa5\"/\"kube-root-ca.crt\""
Jul 31 02:36:39.399047 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.398953    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e0efa5\"/\"ipp-route-e0efa5-kserve-self-signed-certs\""
Jul 31 02:36:39.399276 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.399083    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e0efa5\"/\"default-dockercfg-zd7lt\""
Jul 31 02:36:39.399695 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.399626    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e0efa5\"/\"openshift-service-ca.crt\""
Jul 31 02:36:39.402524 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.402505    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"]
Jul 31 02:36:39.487741 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.487702    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-dshm\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.487968 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.487790    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-home\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.487968 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.487826    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tmp-dir\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.487968 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.487889    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-model-cache\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.487968 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.487923    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tls-certs\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.487968 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.487961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gkn\" (UniqueName: \"kubernetes.io/projected/8eac7340-3e68-4c11-9d8c-78ea58755a4b-kube-api-access-x7gkn\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.588722 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.588686    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-dshm\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.588937 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.588737    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-home\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.588937 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.588794    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tmp-dir\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.588937 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.588830    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-model-cache\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.588937 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.588852    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tls-certs\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.588937 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.588874    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gkn\" (UniqueName: \"kubernetes.io/projected/8eac7340-3e68-4c11-9d8c-78ea58755a4b-kube-api-access-x7gkn\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.589236 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.589211    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-home\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.589307 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.589212    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-model-cache\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.589307 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.589267    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tmp-dir\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.591256 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.591223    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-dshm\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.591398 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.591378    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tls-certs\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.597080 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.597060    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gkn\" (UniqueName: \"kubernetes.io/projected/8eac7340-3e68-4c11-9d8c-78ea58755a4b-kube-api-access-x7gkn\") pod \"ipp-route-e0efa5-kserve-6c666f6587-bbjv7\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") " pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.706486 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.706399    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:39.841591 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:39.841563    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"]
Jul 31 02:36:39.843237 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:36:39.843211    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eac7340_3e68_4c11_9d8c_78ea58755a4b.slice/crio-4ac1e51c8f85a0576b375f1e8cffe03ff967d3b473e8b726c00f6b393f213f34 WatchSource:0}: Error finding container 4ac1e51c8f85a0576b375f1e8cffe03ff967d3b473e8b726c00f6b393f213f34: Status 404 returned error can't find the container with id 4ac1e51c8f85a0576b375f1e8cffe03ff967d3b473e8b726c00f6b393f213f34
Jul 31 02:36:40.503026 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:40.502981    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7" event={"ID":"8eac7340-3e68-4c11-9d8c-78ea58755a4b","Type":"ContainerStarted","Data":"4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef"}
Jul 31 02:36:40.503430 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:40.503034    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7" event={"ID":"8eac7340-3e68-4c11-9d8c-78ea58755a4b","Type":"ContainerStarted","Data":"4ac1e51c8f85a0576b375f1e8cffe03ff967d3b473e8b726c00f6b393f213f34"}
Jul 31 02:36:40.519118 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:40.519057    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7" podStartSLOduration=1.519035971 podStartE2EDuration="1.519035971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:36:40.518380846 +0000 UTC m=+3580.155173566" watchObservedRunningTime="2026-07-31 02:36:40.519035971 +0000 UTC m=+3580.155828691"
Jul 31 02:36:42.104224 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:42.104185    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:36:49.706883 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:49.706843    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:49.706883 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:49.706895    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:49.719726 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:49.719695    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:36:50.565880 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:36:50.565847    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:37:01.149555 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:01.149526    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:37:01.155819 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:01.155793    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:37:18.692958 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:18.692918    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:37:35.550884 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.550851    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"]
Jul 31 02:37:35.554274 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.554257    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.557092 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.557067    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9daafd-dockercfg-hfkwj\""
Jul 31 02:37:35.557231 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.557157    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9daafd\""
Jul 31 02:37:35.563933 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.563908    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"]
Jul 31 02:37:35.655079 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.655040    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca960a3-3f7e-4162-865d-ad4aede13f43-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.655079 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.655082    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmcks\" (UniqueName: \"kubernetes.io/projected/8ca960a3-3f7e-4162-865d-ad4aede13f43-kube-api-access-hmcks\") pod \"payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.756620 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.756579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca960a3-3f7e-4162-865d-ad4aede13f43-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.756620 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.756614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcks\" (UniqueName: \"kubernetes.io/projected/8ca960a3-3f7e-4162-865d-ad4aede13f43-kube-api-access-hmcks\") pod \"payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.757315 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.757288    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca960a3-3f7e-4162-865d-ad4aede13f43-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.764688 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.764661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmcks\" (UniqueName: \"kubernetes.io/projected/8ca960a3-3f7e-4162-865d-ad4aede13f43-kube-api-access-hmcks\") pod \"payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:35.866050 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:35.865960    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:36.005439 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:36.005411    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"]
Jul 31 02:37:36.007490 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:37:36.007464    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca960a3_3f7e_4162_865d_ad4aede13f43.slice/crio-e6f5c531a7053912563d92c194576f499b91cc58637f0c527b41aa392d473739 WatchSource:0}: Error finding container e6f5c531a7053912563d92c194576f499b91cc58637f0c527b41aa392d473739: Status 404 returned error can't find the container with id e6f5c531a7053912563d92c194576f499b91cc58637f0c527b41aa392d473739
Jul 31 02:37:36.009425 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:36.009406    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 02:37:36.797674 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:36.797623    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr" event={"ID":"8ca960a3-3f7e-4162-865d-ad4aede13f43","Type":"ContainerStarted","Data":"e6f5c531a7053912563d92c194576f499b91cc58637f0c527b41aa392d473739"}
Jul 31 02:37:37.804562 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:37.804527    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr" event={"ID":"8ca960a3-3f7e-4162-865d-ad4aede13f43","Type":"ContainerStarted","Data":"f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808"}
Jul 31 02:37:37.805074 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:37.804646    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:37.822082 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:37.822019    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr" podStartSLOduration=1.131535647 podStartE2EDuration="2.822002894s" totalImagesPullingTime="1.690467247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:37:37.819957959 +0000 UTC m=+3637.456750679" watchObservedRunningTime="2026-07-31 02:37:37.822002894 +0000 UTC m=+3637.458795682"
Jul 31 02:37:40.103298 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:40.103259    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:37:48.812364 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:48.812332    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:37:59.620952 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.620914    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"]
Jul 31 02:37:59.624473 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.624455    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:37:59.626905 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.626887    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4lh69\""
Jul 31 02:37:59.626991 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.626887    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 02:37:59.631349 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.631312    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"]
Jul 31 02:37:59.668936 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.668899    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16c15a2-cf40-4481-a047-96505c78a108-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc\" (UID: \"c16c15a2-cf40-4481-a047-96505c78a108\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:37:59.769707 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.769664    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16c15a2-cf40-4481-a047-96505c78a108-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc\" (UID: \"c16c15a2-cf40-4481-a047-96505c78a108\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:37:59.770417 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.770388    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16c15a2-cf40-4481-a047-96505c78a108-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc\" (UID: \"c16c15a2-cf40-4481-a047-96505c78a108\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:37:59.937354 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:37:59.937267    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:38:00.077631 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:00.077605    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"]
Jul 31 02:38:00.080477 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:38:00.080449    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16c15a2_cf40_4481_a047_96505c78a108.slice/crio-9c5d51a52223dc0b317bc24c52f00008fdabab09666fd47d450f45b0339717aa WatchSource:0}: Error finding container 9c5d51a52223dc0b317bc24c52f00008fdabab09666fd47d450f45b0339717aa: Status 404 returned error can't find the container with id 9c5d51a52223dc0b317bc24c52f00008fdabab09666fd47d450f45b0339717aa
Jul 31 02:38:00.928259 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:00.928222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc" event={"ID":"c16c15a2-cf40-4481-a047-96505c78a108","Type":"ContainerStarted","Data":"9c5d51a52223dc0b317bc24c52f00008fdabab09666fd47d450f45b0339717aa"}
Jul 31 02:38:02.939561 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:02.939471    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc" event={"ID":"c16c15a2-cf40-4481-a047-96505c78a108","Type":"ContainerStarted","Data":"d3a1e0ef0c601658b427f02999ac96f3cbf5cec54ec46a398a769870019aff4e"}
Jul 31 02:38:02.953714 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:02.953660    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc" podStartSLOduration=1.766637132 podStartE2EDuration="3.953644561s" totalImagesPullingTime="2.187007429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:38:02.952587401 +0000 UTC m=+3662.589380149" watchObservedRunningTime="2026-07-31 02:38:02.953644561 +0000 UTC m=+3662.590437303"
Jul 31 02:38:03.945869 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:03.945828    2555 generic.go:356] "Generic (PLEG): container finished" podID="c16c15a2-cf40-4481-a047-96505c78a108" containerID="d3a1e0ef0c601658b427f02999ac96f3cbf5cec54ec46a398a769870019aff4e" exitCode=0
Jul 31 02:38:03.946323 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:03.945913    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc" event={"ID":"c16c15a2-cf40-4481-a047-96505c78a108","Type":"ContainerDied","Data":"d3a1e0ef0c601658b427f02999ac96f3cbf5cec54ec46a398a769870019aff4e"}
Jul 31 02:38:05.083566 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.083538    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:38:05.220825 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.220709    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16c15a2-cf40-4481-a047-96505c78a108-maas-api-service-ca\") pod \"c16c15a2-cf40-4481-a047-96505c78a108\" (UID: \"c16c15a2-cf40-4481-a047-96505c78a108\") "
Jul 31 02:38:05.221094 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.221069    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c16c15a2-cf40-4481-a047-96505c78a108-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c16c15a2-cf40-4481-a047-96505c78a108" (UID: "c16c15a2-cf40-4481-a047-96505c78a108"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:38:05.321427 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.321390    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c16c15a2-cf40-4481-a047-96505c78a108-maas-api-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:38:05.957637 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.957607    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"
Jul 31 02:38:05.957832 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.957611    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc" event={"ID":"c16c15a2-cf40-4481-a047-96505c78a108","Type":"ContainerDied","Data":"9c5d51a52223dc0b317bc24c52f00008fdabab09666fd47d450f45b0339717aa"}
Jul 31 02:38:05.957832 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:05.957729    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c5d51a52223dc0b317bc24c52f00008fdabab09666fd47d450f45b0339717aa"
Jul 31 02:38:15.480571 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.480542    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"]
Jul 31 02:38:15.481044 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.480773    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr" podUID="8ca960a3-3f7e-4162-865d-ad4aede13f43" containerName="payload-pre-processing" containerID="cri-o://f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808" gracePeriod=30
Jul 31 02:38:15.610275 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.610241    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"]
Jul 31 02:38:15.613583 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.613555    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-9daafd-qwggc"]
Jul 31 02:38:15.732122 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.732058    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:38:15.808487 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.808450    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmcks\" (UniqueName: \"kubernetes.io/projected/8ca960a3-3f7e-4162-865d-ad4aede13f43-kube-api-access-hmcks\") pod \"8ca960a3-3f7e-4162-865d-ad4aede13f43\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") "
Jul 31 02:38:15.808683 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.808648    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca960a3-3f7e-4162-865d-ad4aede13f43-plugins-config-volume\") pod \"8ca960a3-3f7e-4162-865d-ad4aede13f43\" (UID: \"8ca960a3-3f7e-4162-865d-ad4aede13f43\") "
Jul 31 02:38:15.809048 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.809025    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ca960a3-3f7e-4162-865d-ad4aede13f43-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ca960a3-3f7e-4162-865d-ad4aede13f43" (UID: "8ca960a3-3f7e-4162-865d-ad4aede13f43"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:38:15.810917 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.810896    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca960a3-3f7e-4162-865d-ad4aede13f43-kube-api-access-hmcks" (OuterVolumeSpecName: "kube-api-access-hmcks") pod "8ca960a3-3f7e-4162-865d-ad4aede13f43" (UID: "8ca960a3-3f7e-4162-865d-ad4aede13f43"). InnerVolumeSpecName "kube-api-access-hmcks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:38:15.909956 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.909917    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca960a3-3f7e-4162-865d-ad4aede13f43-plugins-config-volume\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:38:15.909956 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:15.909945    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmcks\" (UniqueName: \"kubernetes.io/projected/8ca960a3-3f7e-4162-865d-ad4aede13f43-kube-api-access-hmcks\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:38:16.009589 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.009499    2555 generic.go:356] "Generic (PLEG): container finished" podID="8ca960a3-3f7e-4162-865d-ad4aede13f43" containerID="f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808" exitCode=0
Jul 31 02:38:16.009589 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.009547    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"
Jul 31 02:38:16.009842 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.009583    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr" event={"ID":"8ca960a3-3f7e-4162-865d-ad4aede13f43","Type":"ContainerDied","Data":"f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808"}
Jul 31 02:38:16.009842 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.009636    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr" event={"ID":"8ca960a3-3f7e-4162-865d-ad4aede13f43","Type":"ContainerDied","Data":"e6f5c531a7053912563d92c194576f499b91cc58637f0c527b41aa392d473739"}
Jul 31 02:38:16.009842 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.009653    2555 scope.go:117] "RemoveContainer" containerID="f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808"
Jul 31 02:38:16.019057 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.019035    2555 scope.go:117] "RemoveContainer" containerID="f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808"
Jul 31 02:38:16.019300 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:38:16.019283    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808\": container with ID starting with f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808 not found: ID does not exist" containerID="f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808"
Jul 31 02:38:16.019341 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.019309    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808"} err="failed to get container status \"f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808\": rpc error: code = NotFound desc = could not find container \"f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808\": container with ID starting with f251aa4ef30d51f3a22e542abda797078973838dd7bcda42cb0efc7fab602808 not found: ID does not exist"
Jul 31 02:38:16.032057 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.032028    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"]
Jul 31 02:38:16.039406 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.039375    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9daafd-65b695b4b4-bgkhr"]
Jul 31 02:38:16.926468 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.926435    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca960a3-3f7e-4162-865d-ad4aede13f43" path="/var/lib/kubelet/pods/8ca960a3-3f7e-4162-865d-ad4aede13f43/volumes"
Jul 31 02:38:16.926874 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:16.926764    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c16c15a2-cf40-4481-a047-96505c78a108" path="/var/lib/kubelet/pods/c16c15a2-cf40-4481-a047-96505c78a108/volumes"
Jul 31 02:38:18.991044 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:18.991012    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:38:25.771208 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771118    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"]
Jul 31 02:38:25.771830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771459    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca960a3-3f7e-4162-865d-ad4aede13f43" containerName="payload-pre-processing"
Jul 31 02:38:25.771830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771470    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca960a3-3f7e-4162-865d-ad4aede13f43" containerName="payload-pre-processing"
Jul 31 02:38:25.771830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771487    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16c15a2-cf40-4481-a047-96505c78a108" containerName="revoke-keys"
Jul 31 02:38:25.771830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771493    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16c15a2-cf40-4481-a047-96505c78a108" containerName="revoke-keys"
Jul 31 02:38:25.771830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771550    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca960a3-3f7e-4162-865d-ad4aede13f43" containerName="payload-pre-processing"
Jul 31 02:38:25.771830 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.771560    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c16c15a2-cf40-4481-a047-96505c78a108" containerName="revoke-keys"
Jul 31 02:38:25.775971 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.775946    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:25.779499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.779257    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4lh69\""
Jul 31 02:38:25.779499 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.779282    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 02:38:25.781478 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.781452    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"]
Jul 31 02:38:25.896618 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.896578    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d34e7a0-de7b-494c-ac19-a0595eff336e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8\" (UID: \"8d34e7a0-de7b-494c-ac19-a0595eff336e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:25.997180 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.997145    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d34e7a0-de7b-494c-ac19-a0595eff336e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8\" (UID: \"8d34e7a0-de7b-494c-ac19-a0595eff336e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:25.997854 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:25.997830    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d34e7a0-de7b-494c-ac19-a0595eff336e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8\" (UID: \"8d34e7a0-de7b-494c-ac19-a0595eff336e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:26.089176 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:26.089127    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:26.227796 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:26.227740    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"]
Jul 31 02:38:26.231493 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:38:26.231466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d34e7a0_de7b_494c_ac19_a0595eff336e.slice/crio-422670c6503dcfb19f7d12a1414e8e62953bee11c67e0aa7d839687a524fe348 WatchSource:0}: Error finding container 422670c6503dcfb19f7d12a1414e8e62953bee11c67e0aa7d839687a524fe348: Status 404 returned error can't find the container with id 422670c6503dcfb19f7d12a1414e8e62953bee11c67e0aa7d839687a524fe348
Jul 31 02:38:27.068793 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:27.068727    2555 generic.go:356] "Generic (PLEG): container finished" podID="8d34e7a0-de7b-494c-ac19-a0595eff336e" containerID="9cf7ab1cce7b51f5b6e67eac0ed5a4a96e5ff4441d6f7a478ccd1592f24a213a" exitCode=0
Jul 31 02:38:27.069192 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:27.068825    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8" event={"ID":"8d34e7a0-de7b-494c-ac19-a0595eff336e","Type":"ContainerDied","Data":"9cf7ab1cce7b51f5b6e67eac0ed5a4a96e5ff4441d6f7a478ccd1592f24a213a"}
Jul 31 02:38:27.069192 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:27.068878    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8" event={"ID":"8d34e7a0-de7b-494c-ac19-a0595eff336e","Type":"ContainerStarted","Data":"422670c6503dcfb19f7d12a1414e8e62953bee11c67e0aa7d839687a524fe348"}
Jul 31 02:38:28.203548 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:28.203522    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:28.316346 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:28.316312    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d34e7a0-de7b-494c-ac19-a0595eff336e-maas-api-service-ca\") pod \"8d34e7a0-de7b-494c-ac19-a0595eff336e\" (UID: \"8d34e7a0-de7b-494c-ac19-a0595eff336e\") "
Jul 31 02:38:28.316719 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:28.316688    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d34e7a0-de7b-494c-ac19-a0595eff336e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d34e7a0-de7b-494c-ac19-a0595eff336e" (UID: "8d34e7a0-de7b-494c-ac19-a0595eff336e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:38:28.417779 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:28.417660    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d34e7a0-de7b-494c-ac19-a0595eff336e-maas-api-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:38:29.080429 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:29.080402    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"
Jul 31 02:38:29.080605 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:29.080399    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8" event={"ID":"8d34e7a0-de7b-494c-ac19-a0595eff336e","Type":"ContainerDied","Data":"422670c6503dcfb19f7d12a1414e8e62953bee11c67e0aa7d839687a524fe348"}
Jul 31 02:38:29.080605 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:29.080524    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="422670c6503dcfb19f7d12a1414e8e62953bee11c67e0aa7d839687a524fe348"
Jul 31 02:38:38.889162 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:38.889129    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:38:41.366087 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:41.366051    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"]
Jul 31 02:38:41.368083 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:41.368059    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e0efa5-6pdg8"]
Jul 31 02:38:42.926438 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:42.926392    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d34e7a0-de7b-494c-ac19-a0595eff336e" path="/var/lib/kubelet/pods/8d34e7a0-de7b-494c-ac19-a0595eff336e/volumes"
Jul 31 02:38:46.739101 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:46.739054    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"]
Jul 31 02:38:47.898563 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:38:47.898528    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:39:01.760067 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:01.759949    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7" podUID="8eac7340-3e68-4c11-9d8c-78ea58755a4b" containerName="main" containerID="cri-o://4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef" gracePeriod=45
Jul 31 02:39:02.014812 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.014725    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:39:02.095010 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.094975    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-home\") pod \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") "
Jul 31 02:39:02.095226 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095026    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7gkn\" (UniqueName: \"kubernetes.io/projected/8eac7340-3e68-4c11-9d8c-78ea58755a4b-kube-api-access-x7gkn\") pod \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") "
Jul 31 02:39:02.095226 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095054    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-model-cache\") pod \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") "
Jul 31 02:39:02.095226 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095111    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tls-certs\") pod \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") "
Jul 31 02:39:02.095226 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095191    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-dshm\") pod \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") "
Jul 31 02:39:02.095451 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095236    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tmp-dir\") pod \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\" (UID: \"8eac7340-3e68-4c11-9d8c-78ea58755a4b\") "
Jul 31 02:39:02.095451 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095319    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-home" (OuterVolumeSpecName: "home") pod "8eac7340-3e68-4c11-9d8c-78ea58755a4b" (UID: "8eac7340-3e68-4c11-9d8c-78ea58755a4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:02.095451 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095341    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "8eac7340-3e68-4c11-9d8c-78ea58755a4b" (UID: "8eac7340-3e68-4c11-9d8c-78ea58755a4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:02.095623 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095509    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8eac7340-3e68-4c11-9d8c-78ea58755a4b" (UID: "8eac7340-3e68-4c11-9d8c-78ea58755a4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:02.095623 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095522    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-home\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:02.095623 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.095542    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-model-cache\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:02.097498 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.097472    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-dshm" (OuterVolumeSpecName: "dshm") pod "8eac7340-3e68-4c11-9d8c-78ea58755a4b" (UID: "8eac7340-3e68-4c11-9d8c-78ea58755a4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:02.097604 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.097501    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8eac7340-3e68-4c11-9d8c-78ea58755a4b" (UID: "8eac7340-3e68-4c11-9d8c-78ea58755a4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 02:39:02.097604 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.097531    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eac7340-3e68-4c11-9d8c-78ea58755a4b-kube-api-access-x7gkn" (OuterVolumeSpecName: "kube-api-access-x7gkn") pod "8eac7340-3e68-4c11-9d8c-78ea58755a4b" (UID: "8eac7340-3e68-4c11-9d8c-78ea58755a4b"). InnerVolumeSpecName "kube-api-access-x7gkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:39:02.196991 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.196955    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tls-certs\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:02.196991 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.196988    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-dshm\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:02.196991 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.196997    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eac7340-3e68-4c11-9d8c-78ea58755a4b-tmp-dir\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:02.197245 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.197006    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7gkn\" (UniqueName: \"kubernetes.io/projected/8eac7340-3e68-4c11-9d8c-78ea58755a4b-kube-api-access-x7gkn\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:02.258475 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.258438    2555 generic.go:356] "Generic (PLEG): container finished" podID="8eac7340-3e68-4c11-9d8c-78ea58755a4b" containerID="4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef" exitCode=0
Jul 31 02:39:02.258665 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.258488    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"
Jul 31 02:39:02.258665 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.258533    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7" event={"ID":"8eac7340-3e68-4c11-9d8c-78ea58755a4b","Type":"ContainerDied","Data":"4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef"}
Jul 31 02:39:02.258665 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.258581    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7" event={"ID":"8eac7340-3e68-4c11-9d8c-78ea58755a4b","Type":"ContainerDied","Data":"4ac1e51c8f85a0576b375f1e8cffe03ff967d3b473e8b726c00f6b393f213f34"}
Jul 31 02:39:02.258665 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.258605    2555 scope.go:117] "RemoveContainer" containerID="4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef"
Jul 31 02:39:02.269182 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.269162    2555 scope.go:117] "RemoveContainer" containerID="4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef"
Jul 31 02:39:02.269489 ip-10-0-140-87 kubenswrapper[2555]: E0731 02:39:02.269468    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef\": container with ID starting with 4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef not found: ID does not exist" containerID="4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef"
Jul 31 02:39:02.269539 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.269500    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef"} err="failed to get container status \"4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef\": rpc error: code = NotFound desc = could not find container \"4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef\": container with ID starting with 4be29935b1c30922b07c3f338a0bd31f403cedc20f3faa6ad4e9b0490a9931ef not found: ID does not exist"
Jul 31 02:39:02.280540 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.280502    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"]
Jul 31 02:39:02.284180 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.284146    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e0efa5/ipp-route-e0efa5-kserve-6c666f6587-bbjv7"]
Jul 31 02:39:02.925652 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:02.925618    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eac7340-3e68-4c11-9d8c-78ea58755a4b" path="/var/lib/kubelet/pods/8eac7340-3e68-4c11-9d8c-78ea58755a4b/volumes"
Jul 31 02:39:35.693669 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.693630    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"]
Jul 31 02:39:35.694173 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.693997    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d34e7a0-de7b-494c-ac19-a0595eff336e" containerName="revoke-keys"
Jul 31 02:39:35.694173 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.694009    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d34e7a0-de7b-494c-ac19-a0595eff336e" containerName="revoke-keys"
Jul 31 02:39:35.694173 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.694024    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eac7340-3e68-4c11-9d8c-78ea58755a4b" containerName="main"
Jul 31 02:39:35.694173 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.694030    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eac7340-3e68-4c11-9d8c-78ea58755a4b" containerName="main"
Jul 31 02:39:35.694173 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.694091    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d34e7a0-de7b-494c-ac19-a0595eff336e" containerName="revoke-keys"
Jul 31 02:39:35.694173 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.694104    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eac7340-3e68-4c11-9d8c-78ea58755a4b" containerName="main"
Jul 31 02:39:35.697178 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.697160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:35.699666 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.699630    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 02:39:35.699811 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.699678    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4lh69\""
Jul 31 02:39:35.704057 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.704037    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"]
Jul 31 02:39:35.796600 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.796564    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5627cef9-5854-4e99-8999-3e83f3c86aae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk\" (UID: \"5627cef9-5854-4e99-8999-3e83f3c86aae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:35.897809 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.897735    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5627cef9-5854-4e99-8999-3e83f3c86aae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk\" (UID: \"5627cef9-5854-4e99-8999-3e83f3c86aae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:35.898366 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:35.898346    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5627cef9-5854-4e99-8999-3e83f3c86aae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk\" (UID: \"5627cef9-5854-4e99-8999-3e83f3c86aae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:36.008458 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:36.008373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:36.147514 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:36.147487    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"]
Jul 31 02:39:36.149406 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:39:36.149377    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5627cef9_5854_4e99_8999_3e83f3c86aae.slice/crio-90a233b8df636d658498ff7f0503140285ed84e547ec8c85249aaa6a1e30f262 WatchSource:0}: Error finding container 90a233b8df636d658498ff7f0503140285ed84e547ec8c85249aaa6a1e30f262: Status 404 returned error can't find the container with id 90a233b8df636d658498ff7f0503140285ed84e547ec8c85249aaa6a1e30f262
Jul 31 02:39:36.438819 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:36.438779    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk" event={"ID":"5627cef9-5854-4e99-8999-3e83f3c86aae","Type":"ContainerStarted","Data":"90a233b8df636d658498ff7f0503140285ed84e547ec8c85249aaa6a1e30f262"}
Jul 31 02:39:37.446316 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:37.446282    2555 generic.go:356] "Generic (PLEG): container finished" podID="5627cef9-5854-4e99-8999-3e83f3c86aae" containerID="4f7640ff5b8a377138fb0f595c3c32d460a6272f96dcfc12684c6a886e784ff9" exitCode=0
Jul 31 02:39:37.446701 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:37.446364    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk" event={"ID":"5627cef9-5854-4e99-8999-3e83f3c86aae","Type":"ContainerDied","Data":"4f7640ff5b8a377138fb0f595c3c32d460a6272f96dcfc12684c6a886e784ff9"}
Jul 31 02:39:38.584642 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:38.584613    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:38.619764 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:38.619724    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5627cef9-5854-4e99-8999-3e83f3c86aae-maas-api-service-ca\") pod \"5627cef9-5854-4e99-8999-3e83f3c86aae\" (UID: \"5627cef9-5854-4e99-8999-3e83f3c86aae\") "
Jul 31 02:39:38.620070 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:38.620049    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5627cef9-5854-4e99-8999-3e83f3c86aae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5627cef9-5854-4e99-8999-3e83f3c86aae" (UID: "5627cef9-5854-4e99-8999-3e83f3c86aae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:39:38.721311 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:38.721222    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5627cef9-5854-4e99-8999-3e83f3c86aae-maas-api-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:39.459486 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:39.459455    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"
Jul 31 02:39:39.459666 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:39.459489    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk" event={"ID":"5627cef9-5854-4e99-8999-3e83f3c86aae","Type":"ContainerDied","Data":"90a233b8df636d658498ff7f0503140285ed84e547ec8c85249aaa6a1e30f262"}
Jul 31 02:39:39.459666 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:39.459541    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a233b8df636d658498ff7f0503140285ed84e547ec8c85249aaa6a1e30f262"
Jul 31 02:39:46.303420 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:46.303382    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"]
Jul 31 02:39:46.307934 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:46.307905    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3dc29c-4llgk"]
Jul 31 02:39:46.926254 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:46.926219    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5627cef9-5854-4e99-8999-3e83f3c86aae" path="/var/lib/kubelet/pods/5627cef9-5854-4e99-8999-3e83f3c86aae/volumes"
Jul 31 02:39:48.394829 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:48.394793    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:39:53.278414 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.278327    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"]
Jul 31 02:39:53.278962 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.278894    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5627cef9-5854-4e99-8999-3e83f3c86aae" containerName="revoke-keys"
Jul 31 02:39:53.278962 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.278916    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5627cef9-5854-4e99-8999-3e83f3c86aae" containerName="revoke-keys"
Jul 31 02:39:53.279079 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.278997    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5627cef9-5854-4e99-8999-3e83f3c86aae" containerName="revoke-keys"
Jul 31 02:39:53.282241 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.282219    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:53.284727 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.284708    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 02:39:53.284899 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.284878    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4lh69\""
Jul 31 02:39:53.289246 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.289220    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"]
Jul 31 02:39:53.350583 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.350541    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3bd104-9e38-40f2-b89d-cc5e2a50388f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd\" (UID: \"ec3bd104-9e38-40f2-b89d-cc5e2a50388f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:53.451666 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.451627    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3bd104-9e38-40f2-b89d-cc5e2a50388f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd\" (UID: \"ec3bd104-9e38-40f2-b89d-cc5e2a50388f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:53.452274 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.452253    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3bd104-9e38-40f2-b89d-cc5e2a50388f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd\" (UID: \"ec3bd104-9e38-40f2-b89d-cc5e2a50388f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:53.594279 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.594243    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:53.730726 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:53.730697    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"]
Jul 31 02:39:53.733230 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:39:53.733205    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3bd104_9e38_40f2_b89d_cc5e2a50388f.slice/crio-c99a09e68302a50e33cd59688385dd93b5725e5cb9e56fe7fe8dab216140a6e7 WatchSource:0}: Error finding container c99a09e68302a50e33cd59688385dd93b5725e5cb9e56fe7fe8dab216140a6e7: Status 404 returned error can't find the container with id c99a09e68302a50e33cd59688385dd93b5725e5cb9e56fe7fe8dab216140a6e7
Jul 31 02:39:54.546043 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:54.546004    2555 generic.go:356] "Generic (PLEG): container finished" podID="ec3bd104-9e38-40f2-b89d-cc5e2a50388f" containerID="fbdadfc74b3ea4367fd18fa95d400dd2c2e64e234847ec2143bb32ba5d264c75" exitCode=0
Jul 31 02:39:54.546464 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:54.546042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd" event={"ID":"ec3bd104-9e38-40f2-b89d-cc5e2a50388f","Type":"ContainerDied","Data":"fbdadfc74b3ea4367fd18fa95d400dd2c2e64e234847ec2143bb32ba5d264c75"}
Jul 31 02:39:54.546464 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:54.546115    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd" event={"ID":"ec3bd104-9e38-40f2-b89d-cc5e2a50388f","Type":"ContainerStarted","Data":"c99a09e68302a50e33cd59688385dd93b5725e5cb9e56fe7fe8dab216140a6e7"}
Jul 31 02:39:55.678769 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:55.678726    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:55.769971 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:55.769931    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3bd104-9e38-40f2-b89d-cc5e2a50388f-maas-api-service-ca\") pod \"ec3bd104-9e38-40f2-b89d-cc5e2a50388f\" (UID: \"ec3bd104-9e38-40f2-b89d-cc5e2a50388f\") "
Jul 31 02:39:55.770335 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:55.770309    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3bd104-9e38-40f2-b89d-cc5e2a50388f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec3bd104-9e38-40f2-b89d-cc5e2a50388f" (UID: "ec3bd104-9e38-40f2-b89d-cc5e2a50388f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:39:55.871638 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:55.871554    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3bd104-9e38-40f2-b89d-cc5e2a50388f-maas-api-service-ca\") on node \"ip-10-0-140-87.ec2.internal\" DevicePath \"\""
Jul 31 02:39:56.558890 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:56.558851    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"
Jul 31 02:39:56.559095 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:56.558848    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd" event={"ID":"ec3bd104-9e38-40f2-b89d-cc5e2a50388f","Type":"ContainerDied","Data":"c99a09e68302a50e33cd59688385dd93b5725e5cb9e56fe7fe8dab216140a6e7"}
Jul 31 02:39:56.559095 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:56.559006    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c99a09e68302a50e33cd59688385dd93b5725e5cb9e56fe7fe8dab216140a6e7"
Jul 31 02:39:57.695573 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:57.694721    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"]
Jul 31 02:39:57.703492 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:57.703457    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2aed0b-x9chd"]
Jul 31 02:39:58.925487 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:58.925452    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3bd104-9e38-40f2-b89d-cc5e2a50388f" path="/var/lib/kubelet/pods/ec3bd104-9e38-40f2-b89d-cc5e2a50388f/volumes"
Jul 31 02:39:59.787978 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:39:59.787945    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:40:18.019467 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:18.019418    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-z52jl"]
Jul 31 02:40:30.064344 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:30.064311    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-bgxps_e877e95f-3a9a-4d57-ac6d-266f328a53b3/copy-manifests/0.log"
Jul 31 02:40:30.084319 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:30.084286    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-bgxps_e877e95f-3a9a-4d57-ac6d-266f328a53b3/manager/0.log"
Jul 31 02:40:32.249764 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:32.249719    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xtrlw_9a1e9154-e7df-428d-9650-6dee626d8001/manager/0.log"
Jul 31 02:40:32.390211 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:32.390180    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-9gzpf_da0ea522-3f73-4662-b9fa-5d2284e43457/kuadrant-console-plugin/0.log"
Jul 31 02:40:32.655321 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:32.655289    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-z52jl_e0a5e7d0-575d-4e85-8b97-1f70c4072c2d/limitador/0.log"
Jul 31 02:40:33.633501 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:33.633464    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-qbqg2_501cd197-6590-437c-86b2-215b1a9e3f82/kube-auth-proxy/0.log"
Jul 31 02:40:34.943793 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:34.943761    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fw2rfv_a0d320a0-5609-496f-b825-e2feb7e8ee3e/main/0.log"
Jul 31 02:40:35.070833 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:35.070804    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vrff5_3eba067f-bcf1-4b31-a68d-02161ee7d110/main/0.log"
Jul 31 02:40:35.192248 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:35.192215    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-krqgr_351be459-e9a9-4dd6-9499-5d52c6c30c1c/main/0.log"
Jul 31 02:40:45.683860 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:45.683822    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gmwj6_9ae9d9f3-02b0-4a25-8e13-86bd8e84b8f1/global-pull-secret-syncer/0.log"
Jul 31 02:40:45.891653 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:45.891616    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dn759_6c1159aa-fadf-4c14-9e6d-1baa9e85ea43/konnectivity-agent/0.log"
Jul 31 02:40:46.103227 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:46.103201    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-87.ec2.internal_d10851091c63cdffce3d56c3115c661b/haproxy/0.log"
Jul 31 02:40:50.089437 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:50.089399    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xtrlw_9a1e9154-e7df-428d-9650-6dee626d8001/manager/0.log"
Jul 31 02:40:50.204260 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:50.204230    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-9gzpf_da0ea522-3f73-4662-b9fa-5d2284e43457/kuadrant-console-plugin/0.log"
Jul 31 02:40:50.461440 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:50.461361    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-z52jl_e0a5e7d0-575d-4e85-8b97-1f70c4072c2d/limitador/0.log"
Jul 31 02:40:52.823317 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:52.823276    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-dhxff_e9029b9d-9235-4a98-8cce-4a2cca4a320a/cluster-monitoring-operator/0.log"
Jul 31 02:40:53.181197 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:53.181109    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqcg_b5cbbbe8-f675-41ec-b5d9-ce4833212530/node-exporter/0.log"
Jul 31 02:40:53.252610 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:53.252574    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqcg_b5cbbbe8-f675-41ec-b5d9-ce4833212530/kube-rbac-proxy/0.log"
Jul 31 02:40:53.308934 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:53.308908    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gqcg_b5cbbbe8-f675-41ec-b5d9-ce4833212530/init-textfile/0.log"
Jul 31 02:40:53.705659 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:53.705633    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vfvx4_c3f9f362-9db0-43b9-8408-0ecad8907a4b/kube-rbac-proxy-main/0.log"
Jul 31 02:40:53.765671 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:53.765640    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vfvx4_c3f9f362-9db0-43b9-8408-0ecad8907a4b/kube-rbac-proxy-self/0.log"
Jul 31 02:40:53.870428 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:53.870395    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vfvx4_c3f9f362-9db0-43b9-8408-0ecad8907a4b/openshift-state-metrics/0.log"
Jul 31 02:40:54.339591 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.339557    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5gz78_a57dd607-f188-4005-8b8e-37a4f286eb6c/prometheus-operator/0.log"
Jul 31 02:40:54.395883 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.395830    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5gz78_a57dd607-f188-4005-8b8e-37a4f286eb6c/kube-rbac-proxy/0.log"
Jul 31 02:40:54.437979 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.437945    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"]
Jul 31 02:40:54.438310 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.438299    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3bd104-9e38-40f2-b89d-cc5e2a50388f" containerName="revoke-keys"
Jul 31 02:40:54.438353 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.438312    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3bd104-9e38-40f2-b89d-cc5e2a50388f" containerName="revoke-keys"
Jul 31 02:40:54.438399 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.438391    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3bd104-9e38-40f2-b89d-cc5e2a50388f" containerName="revoke-keys"
Jul 31 02:40:54.441470 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.441448    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.447067 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.447041    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tsc55\"/\"kube-root-ca.crt\""
Jul 31 02:40:54.448120 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.448104    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tsc55\"/\"default-dockercfg-p9l6w\""
Jul 31 02:40:54.448202 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.448121    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tsc55\"/\"openshift-service-ca.crt\""
Jul 31 02:40:54.464758 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.464714    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"]
Jul 31 02:40:54.588597 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.588559    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-lib-modules\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.588597 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.588600    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47lk\" (UniqueName: \"kubernetes.io/projected/c333019f-eb17-4e13-a2b6-6bbebe8364e1-kube-api-access-t47lk\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.588856 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.588675    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-sys\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.588856 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.588713    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-proc\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.588856 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.588761    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-podres\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690125 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690037    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-sys\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690125 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690083    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-proc\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690343 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690166    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-proc\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690343 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690196    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-sys\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690343 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-podres\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690343 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690282    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-lib-modules\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690343 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690309    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47lk\" (UniqueName: \"kubernetes.io/projected/c333019f-eb17-4e13-a2b6-6bbebe8364e1-kube-api-access-t47lk\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690579 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690384    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-podres\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.690579 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.690434    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c333019f-eb17-4e13-a2b6-6bbebe8364e1-lib-modules\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.705441 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.705405    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47lk\" (UniqueName: \"kubernetes.io/projected/c333019f-eb17-4e13-a2b6-6bbebe8364e1-kube-api-access-t47lk\") pod \"perf-node-gather-daemonset-6mlrc\" (UID: \"c333019f-eb17-4e13-a2b6-6bbebe8364e1\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.751605 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.751573    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:54.906904 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:54.906876    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"]
Jul 31 02:40:54.908892 ip-10-0-140-87 kubenswrapper[2555]: W0731 02:40:54.908859    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc333019f_eb17_4e13_a2b6_6bbebe8364e1.slice/crio-388774dc10d4c045f2e4dcc2d72140023889d724b32203dbc21fa9d46ee3e4f1 WatchSource:0}: Error finding container 388774dc10d4c045f2e4dcc2d72140023889d724b32203dbc21fa9d46ee3e4f1: Status 404 returned error can't find the container with id 388774dc10d4c045f2e4dcc2d72140023889d724b32203dbc21fa9d46ee3e4f1
Jul 31 02:40:55.883517 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:55.883482    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc" event={"ID":"c333019f-eb17-4e13-a2b6-6bbebe8364e1","Type":"ContainerStarted","Data":"081d702422dc5a8ebd01bc0573296fcf23d17f411709c3a13a85c48374a11db8"}
Jul 31 02:40:55.883702 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:55.883539    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:40:55.883702 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:55.883564    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc" event={"ID":"c333019f-eb17-4e13-a2b6-6bbebe8364e1","Type":"ContainerStarted","Data":"388774dc10d4c045f2e4dcc2d72140023889d724b32203dbc21fa9d46ee3e4f1"}
Jul 31 02:40:56.238660 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:56.238568    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-75p5g_a274a59c-e2a0-473f-bfdb-a11dd656ce11/networking-console-plugin/0.log"
Jul 31 02:40:56.930136 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:56.930107    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/1.log"
Jul 31 02:40:56.940880 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:56.940850    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-bl74l_b1ff5872-e369-4173-9422-74b878a1504c/console-operator/2.log"
Jul 31 02:40:59.208721 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:59.208684    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9427d_fa135198-565e-4fd8-914a-218340ba89b4/dns/0.log"
Jul 31 02:40:59.246296 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:59.246258    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9427d_fa135198-565e-4fd8-914a-218340ba89b4/kube-rbac-proxy/0.log"
Jul 31 02:40:59.335912 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:40:59.335883    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gshz6_a9ea1983-2c83-4f97-8fe4-acffae008bad/dns-node-resolver/0.log"
Jul 31 02:41:00.054785 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:00.054736    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p4ww7_65faecef-fc92-4664-9cd9-2a331197b8da/node-ca/0.log"
Jul 31 02:41:01.309320 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:01.309288    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-qbqg2_501cd197-6590-437c-86b2-215b1a9e3f82/kube-auth-proxy/0.log"
Jul 31 02:41:01.899834 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:01.899805    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc"
Jul 31 02:41:01.921726 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:01.921673    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-6mlrc" podStartSLOduration=7.921656679 podStartE2EDuration="7.921656679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 02:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:40:55.911939322 +0000 UTC m=+3835.548732052" watchObservedRunningTime="2026-07-31 02:41:01.921656679 +0000 UTC m=+3841.558449443"
Jul 31 02:41:02.396062 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:02.396034    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qd64g_843a29e7-e3bf-40fb-8e81-ca8a7c64bc10/serve-healthcheck-canary/0.log"
Jul 31 02:41:03.333698 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:03.333673    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxf6q_5b9ab97d-f1bd-4980-a6a6-c5456365bc54/kube-rbac-proxy/0.log"
Jul 31 02:41:03.376061 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:03.376011    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxf6q_5b9ab97d-f1bd-4980-a6a6-c5456365bc54/exporter/0.log"
Jul 31 02:41:03.416656 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:03.416627    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxf6q_5b9ab97d-f1bd-4980-a6a6-c5456365bc54/extractor/0.log"
Jul 31 02:41:05.698680 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:05.698629    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-qbqg2_501cd197-6590-437c-86b2-215b1a9e3f82/kube-auth-proxy/0.log"
Jul 31 02:41:07.136796 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:07.136765    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-bgxps_e877e95f-3a9a-4d57-ac6d-266f328a53b3/manager/0.log"
Jul 31 02:41:07.190351 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:07.190325    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-bgxps_e877e95f-3a9a-4d57-ac6d-266f328a53b3/copy-manifests/0.log"
Jul 31 02:41:07.483934 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:07.483845    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-qbqg2_501cd197-6590-437c-86b2-215b1a9e3f82/kube-auth-proxy/0.log"
Jul 31 02:41:08.737454 ip-10-0-140-87 kubenswrapper[2555]: I0731 02:41:08.737400    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8657cf6695-svqxt_ac9b592c-5cff-4d9c-83ca-99e4a49aa517/manager/0.log"