Jul 24 18:38:17.936117 ip-10-0-128-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 18:38:17.936126 ip-10-0-128-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 18:38:17.936133 ip-10-0-128-234 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 18:38:17.936413 ip-10-0-128-234 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 18:38:27.995204 ip-10-0-128-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 18:38:27.995224 ip-10-0-128-234 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 55d08303738b4fda8a103a8fb01d9f47 --
Jul 24 18:40:06.337274 ip-10-0-128-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 18:40:06.726328 ip-10-0-128-234 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:40:06.726328 ip-10-0-128-234 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 18:40:06.726328 ip-10-0-128-234 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:40:06.726328 ip-10-0-128-234 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 18:40:06.726328 ip-10-0-128-234 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:40:06.727961 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.727887    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 18:40:06.734722 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734702    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:06.734722 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734719    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:06.734722 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734723    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:06.734722 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734726    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734730    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734733    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734736    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734739    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734742    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734745    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734748    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734750    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734754    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734757    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734759    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734762    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734765    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734768    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734770    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734772    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734775    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734777    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734780    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:06.734879 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734783    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734785    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734788    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734791    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734793    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734796    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734799    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734802    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734807    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734810    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734812    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734815    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734818    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734821    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734824    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734826    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734829    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734832    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734834    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734836    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:06.735381 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734839    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734841    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734844    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734846    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734849    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734852    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734854    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734857    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734859    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734862    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734866    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734869    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734872    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734876    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734879    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734881    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734886    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734889    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734892    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734894    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:06.735875 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734898    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734901    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734903    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734906    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734909    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734912    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734915    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734917    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734920    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734923    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734925    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734928    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734930    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734933    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734936    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734938    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734941    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734943    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734948    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:06.736372 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734951    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734954    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734958    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734961    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734963    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734966    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734969    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734971    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734974    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734977    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734980    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734982    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734985    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734988    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734992    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734995    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.734999    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735693    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735700    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735704    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:06.736836 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735706    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735709    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735712    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735715    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735717    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735720    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735723    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735726    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735728    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735731    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735733    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735736    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735739    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735742    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735746    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735748    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735751    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735753    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735756    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735758    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:06.737338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735761    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735765    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735769    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735772    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735775    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735777    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735780    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735782    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735785    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735788    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735790    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735793    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735795    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735798    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735801    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735803    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735806    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735808    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735811    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:06.737841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735815    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735818    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735821    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735824    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735827    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735832    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735835    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735837    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735840    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735843    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735846    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735850    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735853    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735855    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735858    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735860    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735863    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735865    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735868    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735871    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:06.738339 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735873    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735876    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735879    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735881    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735884    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735887    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735891    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735893    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735896    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735898    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735901    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735904    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735906    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735908    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735911    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735913    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735916    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735920    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735922    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735925    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:06.738819 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735928    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735931    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735933    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735936    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735938    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735941    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735943    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735946    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735948    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735951    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735953    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735956    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735959    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735961    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735966    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735969    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.735971    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736324    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736329    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736332    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:06.739338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736335    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736337    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736341    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736344    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736347    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736349    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736353    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736356    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736359    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736363    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736365    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736368    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736371    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736374    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736377    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736380    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736383    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736385    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736388    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736391    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:06.739841 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736393    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736396    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736398    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736409    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736413    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736416    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736419    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736422    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736425    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736428    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736430    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736433    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736435    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736438    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736440    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736443    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736445    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736448    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736450    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:06.740338 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736452    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736455    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736459    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736462    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736464    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736467    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736469    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736478    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736481    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736484    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736486    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736489    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736491    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736494    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736496    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736499    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736501    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736504    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736506    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736509    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:06.740898 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736511    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736514    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736517    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736519    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736522    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736524    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736527    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736529    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736532    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736534    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736537    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736539    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736542    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736544    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736550    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736552    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736556    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736559    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736562    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736564    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:06.741429 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736567    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736570    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736572    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736575    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736577    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736580    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736582    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736585    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736587    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736590    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736592    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736596    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736598    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736601    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736604    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736606    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.736609    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736686    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736696    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736705    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736710    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 18:40:06.741922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736716    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736721    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736728    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736733    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736736    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736740    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736744    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736748    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736751    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736754    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736757    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736760    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736763    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736766    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736774    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736777    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736780    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736783    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736786    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736790    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736793    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736796    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736799    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736802    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 18:40:06.742440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736805    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736808    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736811    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736814    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736818    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736821    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736824    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736827    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736830    2584 flags.go:64] FLAG: --enable-server="true"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736833    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736836    2584 flags.go:64] FLAG: --event-burst="100"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736839    2584 flags.go:64] FLAG: --event-qps="50"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736842    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736846    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736849    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736853    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736856    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736859    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736861    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736864    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736867    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736870    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736873    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736876    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736879    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 18:40:06.743059 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736881    2584 flags.go:64] FLAG: --feature-gates=""
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736885    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736888    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736892    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736895    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736898    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736901    2584 flags.go:64] FLAG: --help="false"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736904    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-128-234.ec2.internal"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736907    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736910    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736913    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736916    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736920    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736923    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736925    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736928    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736931    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736934    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736937    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736940    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736943    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736946    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736949    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736952    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 18:40:06.743677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736955    2584 flags.go:64] FLAG: --lock-file=""
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736958    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736960    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736963    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736968    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736972    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736974    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736977    2584 flags.go:64] FLAG: --logging-format="text"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736980    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736983    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736986    2584 flags.go:64] FLAG: --manifest-url=""
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736991    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736995    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.736998    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737002    2584 flags.go:64] FLAG: --max-pods="110"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737005    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737008    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737010    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737013    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737016    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737044    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737056    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737063    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737066    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737069    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 18:40:06.744283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737072    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737075    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737080    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737083    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737086    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737089    2584 flags.go:64] FLAG: --port="10250"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737093    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737096    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0724518ed25853cda"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737099    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737102    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737104    2584 flags.go:64] FLAG: --register-node="true"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737107    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737111    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737114    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737117    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737120    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737123    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737126    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737129    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737133    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737136    2584 flags.go:64] FLAG: --runonce="false"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737139    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737142    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737145    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737148    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 18:40:06.744897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737151    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737154    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737157    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737160    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737163    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737166    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737168    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737171    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737174    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737177    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737180    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737185    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737188    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737191    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737195    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737197    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737200    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737203    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737206    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737209    2584 flags.go:64] FLAG: --v="2"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737212    2584 flags.go:64] FLAG: --version="false"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737216    2584 flags.go:64] FLAG: --vmodule=""
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737220    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737223    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737332    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:06.745570 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737335    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737340    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737344    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737348    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737352    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737355    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737358    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737361    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737364    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737367    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737371    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737373    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737376    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737379    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737381    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737384    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737386    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737389    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737392    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737394    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:06.746234 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737397    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737400    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737402    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737404    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737407    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737410    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737412    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737415    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737417    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737421    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737423    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737426    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737429    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737432    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737435    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737438    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737440    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737443    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737446    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:06.746721 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737448    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737452    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737457    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737460    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737462    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737465    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737468    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737470    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737473    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737476    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737478    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737481    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737483    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737486    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737488    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737491    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737493    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737496    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737499    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737501    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:06.747209 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737503    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737506    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737508    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737511    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737514    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737516    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737520    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737523    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737525    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737528    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737530    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737533    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737535    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737538    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737542    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737545    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737548    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737550    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737553    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737555    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:06.747707 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737558    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737561    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737563    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737566    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737568    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737571    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737574    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737577    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737579    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737582    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737584    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737587    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737590    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737592    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737595    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737598    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737602    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737605    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:06.748233 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.737610    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.737618    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.744303    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.744318    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.745093    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.745104    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745177    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745182    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745186    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745189    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745192    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745195    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745199    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745201    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745205    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:06.748682 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745207    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745210    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745212    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745215    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745218    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745220    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745223    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745226    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745229    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745231    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745234    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745236    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745239    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745241    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745244    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745247    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745249    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745252    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745254    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745257    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:06.749075 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745261    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745266    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745269    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745272    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745276    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745279    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745283    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745285    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745288    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745291    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745293    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745296    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745299    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745301    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745304    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745306    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745309    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745311    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:06.749554 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745314    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745317    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745319    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745322    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745325    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745327    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745330    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745332    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745335    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745337    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745340    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745342    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745345    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745347    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745351    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745354    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745356    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745359    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745362    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745364    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:06.749985 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745366    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745369    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745372    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745375    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745377    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745379    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745382    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745384    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745387    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745403    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745408    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745411    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745414    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745417    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745420    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745423    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745426    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745428    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745431    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745433    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:06.750502 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745436    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745438    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745441    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745443    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745446    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745449    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745452    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745455    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745458    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745462    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745466    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745469    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.745473    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745600    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745605    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:40:06.750983 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745608    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745611    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745614    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745616    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745619    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745622    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745624    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745627    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745631    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745635    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745638    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745641    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745643    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745646    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745649    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745651    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745654    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745656    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745659    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:40:06.751376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745662    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745666    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745669    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745672    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745675    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745678    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745682    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745691    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745694    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745697    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745700    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745703    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745705    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745708    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745711    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745713    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745716    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745719    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745721    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:40:06.751833 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745724    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745726    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745729    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745732    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745734    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745736    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745739    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745742    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745744    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745747    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745749    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745752    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745754    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745757    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745759    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745762    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745764    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745767    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745770    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745772    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:40:06.752325 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745775    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745783    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745785    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745788    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745791    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745793    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745795    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745798    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745800    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745803    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745805    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745808    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745810    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745813    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745815    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745818    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745820    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745823    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745825    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745828    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:40:06.752811 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745831    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745833    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745835    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745838    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745840    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745843    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745845    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745848    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745850    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745853    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745856    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745858    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745861    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745863    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745871    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745874    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745876    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745879    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:40:06.753341 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:06.745881    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.745886    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.745996    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.748048    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.749403    2584 server.go:1019] "Starting client certificate rotation"
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.749502    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.749532    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 18:40:06.753837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.751964    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 18:40:06.755244 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.755224    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 18:40:06.768140 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.768123    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 24 18:40:06.770423 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.770410    2584 log.go:25] "Validated CRI v1 image API"
Jul 24 18:40:06.771819 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.771800    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 18:40:06.773854 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.773834    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d69a4c21-3c6c-4bb2-8680-c48ab5e1516e:/dev/nvme0n1p4 f247fa5a-d37f-435e-867c-a601447636d1:/dev/nvme0n1p3]
Jul 24 18:40:06.773922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.773853    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 18:40:06.778053 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.778037    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 18:40:06.778755 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.778659    2584 manager.go:216] Machine: {Timestamp:2026-07-24 18:40:06.777453574 +0000 UTC m=+0.321340765 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099915 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d245c22aab20c1b7dece93ddd4d1 SystemUUID:ec29d245-c22a-ab20-c1b7-dece93ddd4d1 BootID:55d08303-738b-4fda-8a10-3a8fb01d9f47 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:61:cd:0f:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:61:cd:0f:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:0d:0c:22:2b:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 18:40:06.778755 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.778753    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 18:40:06.778837 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.778822    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 18:40:06.779871 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.779844    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 18:40:06.780043 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.779873    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 18:40:06.780542 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.780531    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 18:40:06.780582 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.780544    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 18:40:06.780582 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.780551    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 18:40:06.781196 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.781185    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 18:40:06.782249 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.782239    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 18:40:06.785054 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785043    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 18:40:06.785172 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785162    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 18:40:06.785201 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785193    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 18:40:06.785233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785206    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 18:40:06.785233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785227    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 18:40:06.785289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785244    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 24 18:40:06.785289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785255    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 18:40:06.785633 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785621    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 18:40:06.785676 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.785640    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 18:40:06.787520 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.787501    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 18:40:06.792363 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.792346    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 18:40:06.792440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.792393    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 18:40:06.794181 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794166    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 18:40:06.794181 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794183    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794189    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794194    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794206    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794213    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794221    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794226    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794233    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794238    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794254    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 18:40:06.794314 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794259    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 18:40:06.794946 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794933    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 18:40:06.794946 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.794944    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 18:40:06.796042 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.796005    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 18:40:06.796130 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.796108    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 18:40:06.798142 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.798129    2584 server.go:1268] "Started kubelet"
Jul 24 18:40:06.798231 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.798202    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 18:40:06.798288 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.798224    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 18:40:06.798335 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.798313    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 18:40:06.798818 ip-10-0-128-234 systemd[1]: Started Kubernetes Kubelet.
Jul 24 18:40:06.800278 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.800259    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 18:40:06.800941 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.800618    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 18:40:06.804253 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.804233    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 18:40:06.805349 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.805333    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 18:40:06.806258 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.805372    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18c54dd5863fbb61  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-07-24 18:40:06.797966177 +0000 UTC m=+0.341853367,LastTimestamp:2026-07-24 18:40:06.797966177 +0000 UTC m=+0.341853367,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Jul 24 18:40:06.808646 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.808615    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9ndc"
Jul 24 18:40:06.810114 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.810098    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 18:40:06.810180 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.810114    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 18:40:06.810245 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.810208    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:06.811070 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811053    2584 factory.go:55] Registering systemd factory
Jul 24 18:40:06.811160 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811074    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 24 18:40:06.811207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811164    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 18:40:06.811207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811164    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 18:40:06.811207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811199    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 18:40:06.811333 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811318    2584 factory.go:153] Registering CRI-O factory
Jul 24 18:40:06.811333 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811322    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 18:40:06.811333 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811331    2584 factory.go:223] Registration of the crio container factory successfully
Jul 24 18:40:06.811440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811384    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 18:40:06.811440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811333    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 18:40:06.811440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811405    2584 factory.go:103] Registering Raw factory
Jul 24 18:40:06.811440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.811429    2584 manager.go:1196] Started watching for new ooms in manager
Jul 24 18:40:06.812421 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.812305    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 18:40:06.812421 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.812330    2584 manager.go:349] Starting recovery of all containers
Jul 24 18:40:06.813487 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.812488    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 18:40:06.817398 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.817378    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9ndc"
Jul 24 18:40:06.824231 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.824217    2584 manager.go:354] Recovery completed
Jul 24 18:40:06.829400 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.829387    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:06.831101 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831086    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:06.831170 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831113    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:06.831170 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831122    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:06.831590 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831572    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 18:40:06.831590 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831589    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 18:40:06.831692 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831577    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:06.831692 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.831605    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 18:40:06.833611 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.833596    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:06.833697 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.833654    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:06.833697 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.833673    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:06.834965 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.834950    2584 policy_none.go:49] "None policy: Start"
Jul 24 18:40:06.835041 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.834971    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 18:40:06.835041 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.834981    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 18:40:06.837146 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.837132    2584 policy_none.go:47] "Start"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.874594    2584 manager.go:337] "Starting Device Plugin manager"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.874751    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.874763    2584 server.go:87] "Starting device plugin registration server"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.875010    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.875039    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.875131    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.875262    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.875272    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.875654    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 18:40:06.891905 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.875698    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:06.940196 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.940174    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 18:40:06.941388 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.941372    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 18:40:06.941482 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.941406    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 18:40:06.941482 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.941426    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 18:40:06.941482 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.941463    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 18:40:06.944085 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.944069    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:06.975928 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.975911    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:06.976701 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.976659    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:06.976701 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.976688    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:06.976876 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.976702    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:06.976876 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.976732    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-234.ec2.internal"
Jul 24 18:40:06.983472 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:06.983457    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-234.ec2.internal"
Jul 24 18:40:06.983555 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:06.983478    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-234.ec2.internal\": node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.007258 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.007237    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.042214 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.042191    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"]
Jul 24 18:40:07.042287 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.042248    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:07.046676 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.046663    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:07.046756 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.046690    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:07.046756 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.046703    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:07.048879 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.048865    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:07.048979 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.048958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.049041 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.048986    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:07.049554 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.049541    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:07.049621 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.049564    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:07.049621 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.049574    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:07.050273 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.050259    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:07.050341 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.050288    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:07.050341 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.050304    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:07.051610 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.051597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.051685 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.051622    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:40:07.052351 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.052336    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:40:07.052423 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.052355    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:40:07.052423 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.052364    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:40:07.066519 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.066503    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.070419 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.070405    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.108220 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.108202    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.112999 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.112985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eeb63a7995c65f627b1939795d22c4d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"6eeb63a7995c65f627b1939795d22c4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.113067 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.113009    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eeb63a7995c65f627b1939795d22c4d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"6eeb63a7995c65f627b1939795d22c4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.113067 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.113036    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3223b98fdb2defd61f890e3a6a17d0f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"c3223b98fdb2defd61f890e3a6a17d0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.208931 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.208913    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.213230 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.213214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eeb63a7995c65f627b1939795d22c4d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"6eeb63a7995c65f627b1939795d22c4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.213281 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.213239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eeb63a7995c65f627b1939795d22c4d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"6eeb63a7995c65f627b1939795d22c4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.213281 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.213266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3223b98fdb2defd61f890e3a6a17d0f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"c3223b98fdb2defd61f890e3a6a17d0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.213353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.213303    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eeb63a7995c65f627b1939795d22c4d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"6eeb63a7995c65f627b1939795d22c4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.213353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.213304    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c3223b98fdb2defd61f890e3a6a17d0f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"c3223b98fdb2defd61f890e3a6a17d0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.213353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.213324    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eeb63a7995c65f627b1939795d22c4d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"6eeb63a7995c65f627b1939795d22c4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.309648 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.309602    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.370065 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.370046    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.374938 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.374867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:07.410490 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.410469    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.510889 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.510857    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.610715 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.610662    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:07.611034 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.611005    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:07.668548 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:07.668526    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:07.711546 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:07.711530    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:09.374874 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.374856    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 18:40:09.375220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.374960    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 18:40:09.375220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.374991    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 18:40:09.375220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.375011    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 18:40:09.438396 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:09.438374    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:09.450575 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.450551    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 18:35:08 +0000 UTC" deadline="2028-01-02 11:22:14.868020645 +0000 UTC"
Jul 24 18:40:09.450575 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.450572    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12640h42m5.41745081s"
Jul 24 18:40:09.539145 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:09.539093    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 24 18:40:09.585273 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.585254    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:09.599376 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:09.599348    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3223b98fdb2defd61f890e3a6a17d0f.slice/crio-31e666c50f93fcdb87085be8cd35280543581ba76f457b966667660a90440a51 WatchSource:0}: Error finding container 31e666c50f93fcdb87085be8cd35280543581ba76f457b966667660a90440a51: Status 404 returned error can't find the container with id 31e666c50f93fcdb87085be8cd35280543581ba76f457b966667660a90440a51
Jul 24 18:40:09.599845 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:09.599819    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eeb63a7995c65f627b1939795d22c4d.slice/crio-e91d7e9dcfcb103e5f33be7324cb011952daa4e1c3e3544ac9549bc3dec8ee1c WatchSource:0}: Error finding container e91d7e9dcfcb103e5f33be7324cb011952daa4e1c3e3544ac9549bc3dec8ee1c: Status 404 returned error can't find the container with id e91d7e9dcfcb103e5f33be7324cb011952daa4e1c3e3544ac9549bc3dec8ee1c
Jul 24 18:40:09.605201 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.605187    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:40:09.636998 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.636971    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:09.648877 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.648858    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 18:40:09.649860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.649849    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 24 18:40:09.661688 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:09.661671    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 18:40:10.206015 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.205970    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:10.412341 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.412311    2584 apiserver.go:52] "Watching apiserver"
Jul 24 18:40:10.421687 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.421659    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 18:40:10.422971 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.422939    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc","openshift-dns/node-resolver-6g8zt","openshift-multus/multus-w5khr","openshift-network-operator/iptables-alerter-tz24q","openshift-ovn-kubernetes/ovnkube-node-kcvb7","kube-system/global-pull-secret-syncer-8p2g2","kube-system/konnectivity-agent-k7h9t","openshift-cluster-node-tuning-operator/tuned-24tcz","openshift-image-registry/node-ca-h67c8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-fbmrr","openshift-multus/network-metrics-daemon-z85kl","openshift-network-diagnostics/network-check-target-r66w7"]
Jul 24 18:40:10.425373 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.425352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.425475 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.425433    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:10.427479 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.427442    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:10.427589 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.427515    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:10.429669 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.429642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.432481 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.432167    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.432481 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.432359    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.432481 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.432478    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ndjxl\""
Jul 24 18:40:10.432696 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.432606    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.435533 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.435512    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.435808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.435790    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 18:40:10.435951 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.435938    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 18:40:10.436177 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.436158    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6mkv9\""
Jul 24 18:40:10.436236 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.436194    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.436711 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.436694    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.436799 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.436774    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 18:40:10.439415 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.439158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.439415 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.439342    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.439732 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.439713    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 18:40:10.439844 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.439825    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t9kcx\""
Jul 24 18:40:10.442680 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.441607    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 18:40:10.442680 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.442225    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.442680 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.442649    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kzx84\""
Jul 24 18:40:10.442680 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.442651    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 18:40:10.442912 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.442808    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.443340 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.443282    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 18:40:10.444501 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.444482    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:10.445299 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.444601    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:10.445299 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.444981    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.445299 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.444994    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 18:40:10.445299 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.445045    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.446628 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.446610    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.446853 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.446835    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6mb7s\""
Jul 24 18:40:10.447021 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.447002    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.448289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448209    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-socket-dir-parent\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448240    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-systemd-units\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovnkube-config\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448287    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-os-release\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brhln\" (UniqueName: \"kubernetes.io/projected/69443bb4-e2f2-46e5-8de9-862a316347b9-kube-api-access-brhln\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-kubelet\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448356    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-systemd\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-env-overrides\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448402    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j46l\" (UniqueName: \"kubernetes.io/projected/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-kube-api-access-9j46l\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdlq\" (UniqueName: \"kubernetes.io/projected/e88c7e1b-b36d-4832-b697-5fc853aeac4e-kube-api-access-mmdlq\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-multus-certs\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448492    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-run-netns\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448514    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-log-socket\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448536    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-system-cni-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-cni-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-hostroot\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448652    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-etc-kubernetes\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfqdj\" (UniqueName: \"kubernetes.io/projected/c25d5aec-fb62-4d91-889d-083638106e22-kube-api-access-rfqdj\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448730    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69443bb4-e2f2-46e5-8de9-862a316347b9-host-slash\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448755    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-etc-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.448784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448780    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovn-node-metrics-cert\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448805    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84e84626-467b-4a32-88cd-e8f163e4d239-tmp-dir\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-k8s-cni-cncf-io\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448856    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.448854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-cni-multus\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449085    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-kubelet\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449107    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99185c08-404e-46af-9db0-6cf2685a34af-dbus\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449129    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-var-lib-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449151    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449202    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99185c08-404e-46af-9db0-6cf2685a34af-kubelet-config\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84e84626-467b-4a32-88cd-e8f163e4d239-hosts-file\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-ovn\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449317    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-cni-netd\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-netns\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449371    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c25d5aec-fb62-4d91-889d-083638106e22-multus-daemon-config\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-slash\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-node-log\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjg4k\" (UniqueName: \"kubernetes.io/projected/84e84626-467b-4a32-88cd-e8f163e4d239-kube-api-access-cjg4k\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449492    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-cnibin\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c25d5aec-fb62-4d91-889d-083638106e22-cni-binary-copy\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-cni-bin\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449556    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-conf-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449581    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69443bb4-e2f2-46e5-8de9-862a316347b9-iptables-alerter-script\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449602    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-cni-bin\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.449654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.449641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovnkube-script-lib\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.450464 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.450445    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 18:40:10.450927 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.450605    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.451740 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.451106    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6jdzp\""
Jul 24 18:40:10.451740 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.451280    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 18:40:10.451740 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.451298    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.451740 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.451496    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.454250 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.453285    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.454250 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.454022    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 18:40:10.454250 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.454070    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wzgcf\""
Jul 24 18:40:10.454437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.454262    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 18:40:10.454437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.454392    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 18:40:10.455323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.455304    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.455993 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.455862    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lnnm4\""
Jul 24 18:40:10.455993 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.455930    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 18:40:10.456180 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.455994    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 18:40:10.457799 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.457782    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 18:40:10.457973 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.457791    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 18:40:10.458227 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.458207    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jlsnt\""
Jul 24 18:40:10.472774 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.472748    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bhhf7"
Jul 24 18:40:10.480751 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.480736    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bhhf7"
Jul 24 18:40:10.538588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.538562    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 18:40:10.550128 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-netns\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.550243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysctl-conf\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.550243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550201    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-netns\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.550576 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxtc\" (UniqueName: \"kubernetes.io/projected/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-kube-api-access-tcxtc\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.550632 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.550632 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550600    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-slash\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.550632 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-node-log\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-cnibin\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550651    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-cni-bin\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550701    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-slash\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550711    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-cnibin\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550704    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-cni-bin\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-node-log\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.550792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-run\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550810    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-lib-modules\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550840    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-registration-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550882    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-os-release\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550920    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69443bb4-e2f2-46e5-8de9-862a316347b9-iptables-alerter-script\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.550970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-cni-bin\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-socket-dir-parent\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551035    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551040    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-cni-bin\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-device-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8pz\" (UniqueName: \"kubernetes.io/projected/94612fef-a392-4883-bf20-f6833abfc633-kube-api-access-2v8pz\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovnkube-config\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-kubelet\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-systemd\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551174 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-env-overrides\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551194    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-socket-dir-parent\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j46l\" (UniqueName: \"kubernetes.io/projected/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-kube-api-access-9j46l\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551250    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-systemd\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-multus-certs\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551327    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-etc-kubernetes\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-kubelet\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551349    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-tmp\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551403    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-multus-certs\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-run-netns\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.551417    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-log-socket\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551462    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-run-netns\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551540    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-etc-kubernetes\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.551538    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69443bb4-e2f2-46e5-8de9-862a316347b9-iptables-alerter-script\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.551770 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.551542    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:40:11.051515884 +0000 UTC m=+2.969367410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:10.552281 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552050    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovnkube-config\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.552281 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-log-socket\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.552281 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552182    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-env-overrides\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.552391 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552333    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-cni-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.552439 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-cni-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.552489 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-hostroot\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.552489 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfqdj\" (UniqueName: \"kubernetes.io/projected/c25d5aec-fb62-4d91-889d-083638106e22-kube-api-access-rfqdj\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.552570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-host\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.552570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552532    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-etc-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.552570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552562    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovn-node-metrics-cert\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.552707 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84e84626-467b-4a32-88cd-e8f163e4d239-tmp-dir\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.552707 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-kubelet\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.552707 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552659    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-conf-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.552707 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552687    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-var-lib-kubelet\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.552868 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:10.552868 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99185c08-404e-46af-9db0-6cf2685a34af-dbus\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.552868 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552773    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.552868 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552803    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.552868 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysconfig\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.552868 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-serviceca\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552892    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552922    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-ovn\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.552976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c25d5aec-fb62-4d91-889d-083638106e22-multus-daemon-config\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553005    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-etc-selinux\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553034    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-sys-fs\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.553097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-cnibin\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjg4k\" (UniqueName: \"kubernetes.io/projected/84e84626-467b-4a32-88cd-e8f163e4d239-kube-api-access-cjg4k\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99185c08-404e-46af-9db0-6cf2685a34af-dbus\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c25d5aec-fb62-4d91-889d-083638106e22-cni-binary-copy\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553211    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-sys\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553240    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-tuned\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-socket-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553309    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovnkube-script-lib\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-system-cni-dir\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-systemd-units\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.553430 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-os-release\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-host\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brhln\" (UniqueName: \"kubernetes.io/projected/69443bb4-e2f2-46e5-8de9-862a316347b9-kube-api-access-brhln\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdlq\" (UniqueName: \"kubernetes.io/projected/e88c7e1b-b36d-4832-b697-5fc853aeac4e-kube-api-access-mmdlq\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-modprobe-d\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6761a61a-dc33-4cc2-8ae8-d81c932c884a-agent-certs\") pod \"konnectivity-agent-k7h9t\" (UID: \"6761a61a-dc33-4cc2-8ae8-d81c932c884a\") " pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fl6t\" (UniqueName: \"kubernetes.io/projected/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-kube-api-access-8fl6t\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553651    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-system-cni-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c25d5aec-fb62-4d91-889d-083638106e22-cni-binary-copy\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553736    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-hostroot\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69443bb4-e2f2-46e5-8de9-862a316347b9-host-slash\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-k8s-cni-cncf-io\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-cni-multus\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-etc-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553841    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysctl-d\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553865    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-kubernetes\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.553923 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-var-lib-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.553993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99185c08-404e-46af-9db0-6cf2685a34af-kubelet-config\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84e84626-467b-4a32-88cd-e8f163e4d239-hosts-file\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-systemd\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckr84\" (UniqueName: \"kubernetes.io/projected/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-kube-api-access-ckr84\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6761a61a-dc33-4cc2-8ae8-d81c932c884a-konnectivity-ca\") pod \"konnectivity-agent-k7h9t\" (UID: \"6761a61a-dc33-4cc2-8ae8-d81c932c884a\") " pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-cni-netd\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554163    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554243    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-cni-netd\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.554328    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.554378    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:40:11.054362374 +0000 UTC m=+2.972213886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:10.554651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554455    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-ovn\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.555049 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.554888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c25d5aec-fb62-4d91-889d-083638106e22-multus-daemon-config\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555224 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555206    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69443bb4-e2f2-46e5-8de9-862a316347b9-host-slash\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.555488 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-run-k8s-cni-cncf-io\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555584 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-cni-multus\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555584 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.555584 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555572    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/84e84626-467b-4a32-88cd-e8f163e4d239-hosts-file\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.555792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555656    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-os-release\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555658    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-var-lib-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.555792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555710    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99185c08-404e-46af-9db0-6cf2685a34af-kubelet-config\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:10.555792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555726    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84e84626-467b-4a32-88cd-e8f163e4d239-tmp-dir\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.555995 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555798    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-multus-conf-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555995 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555808    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-run-openvswitch\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.555995 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555854    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-host-var-lib-kubelet\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555995 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c25d5aec-fb62-4d91-889d-083638106e22-system-cni-dir\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.555995 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.555950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-systemd-units\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.556364 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.556311    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovnkube-script-lib\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.558381 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.558364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-ovn-node-metrics-cert\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.562884 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.562833    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j46l\" (UniqueName: \"kubernetes.io/projected/4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5-kube-api-access-9j46l\") pod \"ovnkube-node-kcvb7\" (UID: \"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.564935 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.564893    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brhln\" (UniqueName: \"kubernetes.io/projected/69443bb4-e2f2-46e5-8de9-862a316347b9-kube-api-access-brhln\") pod \"iptables-alerter-tz24q\" (UID: \"69443bb4-e2f2-46e5-8de9-862a316347b9\") " pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.565256 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.565199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdlq\" (UniqueName: \"kubernetes.io/projected/e88c7e1b-b36d-4832-b697-5fc853aeac4e-kube-api-access-mmdlq\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:10.566073 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.566034    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjg4k\" (UniqueName: \"kubernetes.io/projected/84e84626-467b-4a32-88cd-e8f163e4d239-kube-api-access-cjg4k\") pod \"node-resolver-6g8zt\" (UID: \"84e84626-467b-4a32-88cd-e8f163e4d239\") " pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.566147 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.566135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfqdj\" (UniqueName: \"kubernetes.io/projected/c25d5aec-fb62-4d91-889d-083638106e22-kube-api-access-rfqdj\") pod \"multus-w5khr\" (UID: \"c25d5aec-fb62-4d91-889d-083638106e22\") " pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.571708 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.571673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"6eeb63a7995c65f627b1939795d22c4d","Type":"ContainerStarted","Data":"e91d7e9dcfcb103e5f33be7324cb011952daa4e1c3e3544ac9549bc3dec8ee1c"}
Jul 24 18:40:10.572739 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.572720    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"c3223b98fdb2defd61f890e3a6a17d0f","Type":"ContainerStarted","Data":"31e666c50f93fcdb87085be8cd35280543581ba76f457b966667660a90440a51"}
Jul 24 18:40:10.654881 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-host\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655013 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-modprobe-d\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655013 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6761a61a-dc33-4cc2-8ae8-d81c932c884a-agent-certs\") pod \"konnectivity-agent-k7h9t\" (UID: \"6761a61a-dc33-4cc2-8ae8-d81c932c884a\") " pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.655013 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fl6t\" (UniqueName: \"kubernetes.io/projected/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-kube-api-access-8fl6t\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.655013 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654960    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysctl-d\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655013 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-host\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655013 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.654982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-kubernetes\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655021    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-systemd\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckr84\" (UniqueName: \"kubernetes.io/projected/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-kube-api-access-ckr84\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-modprobe-d\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655112    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysctl-d\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-systemd\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6761a61a-dc33-4cc2-8ae8-d81c932c884a-konnectivity-ca\") pod \"konnectivity-agent-k7h9t\" (UID: \"6761a61a-dc33-4cc2-8ae8-d81c932c884a\") " pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysctl-conf\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655198    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-kubernetes\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxtc\" (UniqueName: \"kubernetes.io/projected/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-kube-api-access-tcxtc\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655233    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655262    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-run\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655283    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-lib-modules\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-registration-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysctl-conf\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.655332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-os-release\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-device-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-os-release\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8pz\" (UniqueName: \"kubernetes.io/projected/94612fef-a392-4883-bf20-f6833abfc633-kube-api-access-2v8pz\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655443    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-registration-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-tmp\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-device-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-host\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655538    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-host\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-var-lib-kubelet\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655397    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-run\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655590    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-var-lib-kubelet\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysconfig\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655701    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6761a61a-dc33-4cc2-8ae8-d81c932c884a-konnectivity-ca\") pod \"konnectivity-agent-k7h9t\" (UID: \"6761a61a-dc33-4cc2-8ae8-d81c932c884a\") " pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.656032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655813    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-lib-modules\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-serviceca\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-sysconfig\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655946    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-etc-selinux\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.655975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-sys-fs\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656001    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-cnibin\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656026    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656050    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-etc-selinux\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-sys\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656117    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-sys-fs\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-tuned\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-socket-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656189    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-system-cni-dir\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.656808 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656252    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-system-cni-dir\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.657560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656122    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-sys\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.657560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94612fef-a392-4883-bf20-f6833abfc633-cnibin\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.657560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656299    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-socket-dir\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.657560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656439    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.657560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94612fef-a392-4883-bf20-f6833abfc633-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.657560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.656889    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-serviceca\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.657944 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.657571    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6761a61a-dc33-4cc2-8ae8-d81c932c884a-agent-certs\") pod \"konnectivity-agent-k7h9t\" (UID: \"6761a61a-dc33-4cc2-8ae8-d81c932c884a\") " pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.657944 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.657877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-tmp\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.658170 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.658141    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-etc-tuned\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.661952 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.661930    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:10.662111 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.661956    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:10.662111 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.661971    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:10.662111 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:10.662033    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:11.162017366 +0000 UTC m=+3.079868889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:10.663529 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.663484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fl6t\" (UniqueName: \"kubernetes.io/projected/505b7920-54bc-4ea2-8a2b-c5f1d3d8679d-kube-api-access-8fl6t\") pod \"aws-ebs-csi-driver-node-klrxc\" (UID: \"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.663615 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.663569    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxtc\" (UniqueName: \"kubernetes.io/projected/c12be58e-5ecc-4abb-b3e4-e039a6bfdc01-kube-api-access-tcxtc\") pod \"node-ca-h67c8\" (UID: \"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01\") " pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.663871 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.663853    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8pz\" (UniqueName: \"kubernetes.io/projected/94612fef-a392-4883-bf20-f6833abfc633-kube-api-access-2v8pz\") pod \"multus-additional-cni-plugins-fbmrr\" (UID: \"94612fef-a392-4883-bf20-f6833abfc633\") " pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:10.664306 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.664288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckr84\" (UniqueName: \"kubernetes.io/projected/061004be-bf0b-41f5-bbaa-4fa54a9ab0b3-kube-api-access-ckr84\") pod \"tuned-24tcz\" (UID: \"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3\") " pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.743843 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.743776    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6g8zt"
Jul 24 18:40:10.751349 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.751331    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5khr"
Jul 24 18:40:10.760880 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.760862    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tz24q"
Jul 24 18:40:10.765595 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.765579    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:10.771315 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.771295    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24tcz"
Jul 24 18:40:10.775915 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.775897    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc"
Jul 24 18:40:10.781452 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.781437    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h67c8"
Jul 24 18:40:10.787019 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.787002    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:10.791591 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:10.791577    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbmrr"
Jul 24 18:40:11.058082 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.057992    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:11.058243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.058133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:11.058243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.058192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:11.058354 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.058295    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:11.058354 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.058310    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:11.058449 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.058387    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:40:12.058361282 +0000 UTC m=+3.976212799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:11.058449 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.058411    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:40:12.058394236 +0000 UTC m=+3.976245743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:11.259703 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.259661    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:11.259881 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.259825    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:11.259881 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.259852    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:11.259881 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.259864    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:11.260040 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.259931    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:12.259911899 +0000 UTC m=+4.177763409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:11.480636 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:11.480608    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505b7920_54bc_4ea2_8a2b_c5f1d3d8679d.slice/crio-d3a947587338cfbaf7472a1ff801dcdd4c956fba8509dfd6c88fe51ea32563e7 WatchSource:0}: Error finding container d3a947587338cfbaf7472a1ff801dcdd4c956fba8509dfd6c88fe51ea32563e7: Status 404 returned error can't find the container with id d3a947587338cfbaf7472a1ff801dcdd4c956fba8509dfd6c88fe51ea32563e7
Jul 24 18:40:11.483700 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.483670    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:35:10 +0000 UTC" deadline="2028-02-09 21:19:10.851736631 +0000 UTC"
Jul 24 18:40:11.483700 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.483699    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13562h38m59.368041691s"
Jul 24 18:40:11.485526 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:11.485500    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12be58e_5ecc_4abb_b3e4_e039a6bfdc01.slice/crio-aa4d14d7d93d63fa5cc14419b37778afdf839f8466868fb7f867fa3508ba4c94 WatchSource:0}: Error finding container aa4d14d7d93d63fa5cc14419b37778afdf839f8466868fb7f867fa3508ba4c94: Status 404 returned error can't find the container with id aa4d14d7d93d63fa5cc14419b37778afdf839f8466868fb7f867fa3508ba4c94
Jul 24 18:40:11.486124 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:11.486106    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061004be_bf0b_41f5_bbaa_4fa54a9ab0b3.slice/crio-9f28d13c41045d887e7c7cfbaa9a015436160ee98b4a1b6977bfd4d66e76d523 WatchSource:0}: Error finding container 9f28d13c41045d887e7c7cfbaa9a015436160ee98b4a1b6977bfd4d66e76d523: Status 404 returned error can't find the container with id 9f28d13c41045d887e7c7cfbaa9a015436160ee98b4a1b6977bfd4d66e76d523
Jul 24 18:40:11.487037 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:11.486995    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94612fef_a392_4883_bf20_f6833abfc633.slice/crio-0e8b854d13105ea1ba95b98f6117166c949377c70bf750f2b9fb5bd0ef7b65be WatchSource:0}: Error finding container 0e8b854d13105ea1ba95b98f6117166c949377c70bf750f2b9fb5bd0ef7b65be: Status 404 returned error can't find the container with id 0e8b854d13105ea1ba95b98f6117166c949377c70bf750f2b9fb5bd0ef7b65be
Jul 24 18:40:11.567948 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.567904    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:11.568050 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.567904    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:11.568050 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.568035    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:11.568173 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:11.568137    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:11.577608 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.577584    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h67c8" event={"ID":"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01","Type":"ContainerStarted","Data":"aa4d14d7d93d63fa5cc14419b37778afdf839f8466868fb7f867fa3508ba4c94"}
Jul 24 18:40:11.578582 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.578561    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc" event={"ID":"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d","Type":"ContainerStarted","Data":"d3a947587338cfbaf7472a1ff801dcdd4c956fba8509dfd6c88fe51ea32563e7"}
Jul 24 18:40:11.582393 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.582360    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"61c9009037eddbeac4aff9a534816c2a63300c809f07670f69b0de68a749dbc5"}
Jul 24 18:40:11.584480 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.584461    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tz24q" event={"ID":"69443bb4-e2f2-46e5-8de9-862a316347b9","Type":"ContainerStarted","Data":"6174da7f26571c4c815e917d8784cda44d7f112e37abc1052965cb2939c1c485"}
Jul 24 18:40:11.585396 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.585376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k7h9t" event={"ID":"6761a61a-dc33-4cc2-8ae8-d81c932c884a","Type":"ContainerStarted","Data":"d6d7790cdb652589bcc862b778069c7923ef6492411287fc69e629094c2d7cd8"}
Jul 24 18:40:11.586283 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.586265    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6g8zt" event={"ID":"84e84626-467b-4a32-88cd-e8f163e4d239","Type":"ContainerStarted","Data":"f40f6392ad3d226b3266d8770162302a46400aff1d8cb2bb74c3e97cf51624f8"}
Jul 24 18:40:11.587249 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.587231    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5khr" event={"ID":"c25d5aec-fb62-4d91-889d-083638106e22","Type":"ContainerStarted","Data":"c5a86f9a8ddfd032c1df27917696ed7fc025b1000162f51d1653ec085e76ecfe"}
Jul 24 18:40:11.592816 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.592795    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerStarted","Data":"0e8b854d13105ea1ba95b98f6117166c949377c70bf750f2b9fb5bd0ef7b65be"}
Jul 24 18:40:11.593812 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:11.593793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24tcz" event={"ID":"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3","Type":"ContainerStarted","Data":"9f28d13c41045d887e7c7cfbaa9a015436160ee98b4a1b6977bfd4d66e76d523"}
Jul 24 18:40:12.067824 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.067450    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:12.067983 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.067824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:12.067983 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.067955    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:12.068117 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.068012    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:40:14.06799522 +0000 UTC m=+5.985846727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:12.068182 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.068153    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:12.068233 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.068198    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:40:14.068184911 +0000 UTC m=+5.986036430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:12.091721 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.091695    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:40:12.269922 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.269889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:12.270142 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.270124    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:12.270210 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.270148    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:12.270210 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.270161    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:12.270313 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.270214    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:14.270197041 +0000 UTC m=+6.188048549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:12.484127 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.484009    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:35:10 +0000 UTC" deadline="2028-03-16 03:31:50.225187625 +0000 UTC"
Jul 24 18:40:12.484127 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.484101    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14408h51m37.741112336s"
Jul 24 18:40:12.568357 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.568327    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:12.568505 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:12.568470    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:12.614150 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.614003    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"6eeb63a7995c65f627b1939795d22c4d","Type":"ContainerDied","Data":"5580e19b8d215c5e3858af038af2daa7a4f6c2f9fc9df81118ad20cc75195062"}
Jul 24 18:40:12.614150 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.614044    2584 generic.go:356] "Generic (PLEG): container finished" podID="6eeb63a7995c65f627b1939795d22c4d" containerID="5580e19b8d215c5e3858af038af2daa7a4f6c2f9fc9df81118ad20cc75195062" exitCode=0
Jul 24 18:40:12.624792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.624336    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"c3223b98fdb2defd61f890e3a6a17d0f","Type":"ContainerStarted","Data":"cace2357e2e3da086d3f0e7abc76f2b71c71dfebaef0e8c70695eca79c2044ac"}
Jul 24 18:40:12.665117 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:12.663897    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" podStartSLOduration=3.663875817 podStartE2EDuration="3.663875817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:12.663547976 +0000 UTC m=+4.581399502" watchObservedRunningTime="2026-07-24 18:40:12.663875817 +0000 UTC m=+4.581727343"
Jul 24 18:40:13.568549 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:13.568505    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:13.569008 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:13.568633    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:13.569104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:13.569025    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:13.569172 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:13.569143    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:13.640139 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:13.640108    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"6eeb63a7995c65f627b1939795d22c4d","Type":"ContainerStarted","Data":"ebdaa24da01f6487b410763906e3a078259e9c097ebbd8730ddae0c5b584019f"}
Jul 24 18:40:14.081455 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:14.081414    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:14.081613 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:14.081482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:14.081701 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.081624    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:14.081701 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.081685    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:40:18.081666985 +0000 UTC m=+9.999518494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:14.082092 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.082074    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:14.082187 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.082129    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:40:18.082112396 +0000 UTC m=+9.999963905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:14.283543 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:14.282944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:14.283543 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.283125    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:14.283543 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.283146    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:14.283543 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.283159    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:14.283543 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.283214    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:18.283197117 +0000 UTC m=+10.201048634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:14.571097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:14.570570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:14.571097 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:14.570697    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:15.567898 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:15.567821    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:15.568090 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:15.567948    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:15.568367 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:15.568185    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:15.568367 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:15.568306    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:16.568191 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:16.567688    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:16.568191 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:16.567822    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:17.568479 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:17.568406    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:17.568917 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:17.568511    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:17.568917 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:17.568832    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:17.569028 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:17.568932    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:18.111718 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:18.111682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:18.111888 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:18.111752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:18.111888 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.111856    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:18.111989 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.111927    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:40:26.111906101 +0000 UTC m=+18.029757609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:18.111989 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.111865    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:18.111989 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.111988    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:40:26.111970456 +0000 UTC m=+18.029821963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:18.313067 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:18.313019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:18.313239 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.313224    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:18.313302 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.313249    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:18.313302 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.313263    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:18.313409 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.313325    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:26.313306102 +0000 UTC m=+18.231157609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:18.506623 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.506461    2584 log.go:32] "ImageFsInfo from image service failed" err="rpc error: code = Unknown desc = get image fs info unable to get usage for /var/lib/containers/storage/overlay-images: get disk usage for path /var/lib/containers/storage/overlay-images: lstat /var/lib/containers/storage/overlay-images/.tmp-images.json1119243082: no such file or directory"
Jul 24 18:40:18.506623 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.506537    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get imageFs stats: missing image stats: <nil>"
Jul 24 18:40:18.569637 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:18.569603    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:18.570093 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:18.569720    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:19.568527 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:19.568452    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:19.568527 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:19.568492    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:19.568743 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:19.568581    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:19.568803 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:19.568737    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:20.567884 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:20.567857    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:20.568364 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:20.567955    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:21.567697 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:21.567662    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:21.567860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:21.567662    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:21.567860 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:21.567783    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:21.568296 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:21.567860    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:22.568084 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:22.568002    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:22.568493 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:22.568146    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:23.568594 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:23.568553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:23.568968 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:23.568690    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:23.568968 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:23.568755    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:23.568968 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:23.568847    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:24.568709 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:24.568675    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:24.569151 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:24.568801    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:25.568227 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:25.568140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:25.568452 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:25.568267    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:25.568452 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:25.568334    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:25.568531 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:25.568461    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:26.182207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:26.182120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:26.182207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:26.182192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:26.182688 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.182296    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:26.182688 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.182298    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:26.182688 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.182358    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:40:42.182340509 +0000 UTC m=+34.100192029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:26.182688 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.182378    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:40:42.182367208 +0000 UTC m=+34.100218710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:26.383028 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:26.382983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:26.383206 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.383141    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:26.383206 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.383165    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:26.383206 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.383176    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:26.383337 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.383226    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:40:42.383210694 +0000 UTC m=+34.301062203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:26.571155 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:26.571080    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:26.571286 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:26.571185    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:27.568362 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:27.568327    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:27.568851 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:27.568367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:27.568851 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:27.568445    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:27.568851 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:27.568581    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:28.568406 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:28.568378    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:28.568834 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:28.568456    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:29.568334 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:29.568303    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:29.568492 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:29.568430    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:29.568863 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:29.568487    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:29.568863 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:29.568599    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:30.568843 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.568463    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:30.569558 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:30.568931    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:30.673091 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.673027    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"ac612a963808efd7e75b745010eda5adcec16dc27b01aef0354ff070226e26bc"}
Jul 24 18:40:30.673168 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.673114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"6623e43920fdea811c8396b3d58ea1db2a3a2f53e5f2f3180a568e1392250ffb"}
Jul 24 18:40:30.673168 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.673159    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"024b7ba96cd8e849b6a5a733a63890b449ec1c1f26cd92e598198a94b4a24aa2"}
Jul 24 18:40:30.673243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.673197    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"f6948667d0473f7be46b78d8d9c28d5c3849627ead9d7e5882f0c2b26dd40d6d"}
Jul 24 18:40:30.673243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.673238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"a6f7e3508605315de70a21c98301f75c215384a8842be9e6ba54080991ef2fce"}
Jul 24 18:40:30.674331 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.674310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k7h9t" event={"ID":"6761a61a-dc33-4cc2-8ae8-d81c932c884a","Type":"ContainerStarted","Data":"95338e928b5f78019cf7f1c81e4d7118ddc980062927395ac74b2545f07e3b01"}
Jul 24 18:40:30.677005 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.676980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6g8zt" event={"ID":"84e84626-467b-4a32-88cd-e8f163e4d239","Type":"ContainerStarted","Data":"f8477a75070d61a83d5aac2e0eb1677b94007eed714c698ccb9428ae67954f95"}
Jul 24 18:40:30.679344 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.679310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5khr" event={"ID":"c25d5aec-fb62-4d91-889d-083638106e22","Type":"ContainerStarted","Data":"3db7b7a138a4710b40421585038296efc62e7be415fca5a1e0a3261c36c34732"}
Jul 24 18:40:30.680976 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.680946    2584 generic.go:356] "Generic (PLEG): container finished" podID="94612fef-a392-4883-bf20-f6833abfc633" containerID="c2da347deed91dcae3eb93a6f48e3394e2785dda6a6aec8291e9f87e49866350" exitCode=0
Jul 24 18:40:30.681095 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.681028    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerDied","Data":"c2da347deed91dcae3eb93a6f48e3394e2785dda6a6aec8291e9f87e49866350"}
Jul 24 18:40:30.684795 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.684771    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24tcz" event={"ID":"061004be-bf0b-41f5-bbaa-4fa54a9ab0b3","Type":"ContainerStarted","Data":"66dca03de12ed6c3571bb697b575bd5bb21b64531d594f70b7d9e03b87343055"}
Jul 24 18:40:30.689237 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.689049    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h67c8" event={"ID":"c12be58e-5ecc-4abb-b3e4-e039a6bfdc01","Type":"ContainerStarted","Data":"ed0f827f742a73ee64937744c7a56a9067c019470f1ffd9dd1eb93e032c3afe6"}
Jul 24 18:40:30.690315 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.690272    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k7h9t" podStartSLOduration=8.298336196 podStartE2EDuration="22.690256697s" totalImagesPullingTime="14.391920501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:30.690140759 +0000 UTC m=+22.607992285" watchObservedRunningTime="2026-07-24 18:40:30.690256697 +0000 UTC m=+22.608108213"
Jul 24 18:40:30.691364 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.690507    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" podStartSLOduration=21.690498255 podStartE2EDuration="21.690498255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:13.659107126 +0000 UTC m=+5.576958664" watchObservedRunningTime="2026-07-24 18:40:30.690498255 +0000 UTC m=+22.608349781"
Jul 24 18:40:30.691636 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.691613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc" event={"ID":"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d","Type":"ContainerStarted","Data":"2f7980f14b9275c0af4d562195c66cfc38cd71ce6ff09aa8f52a707059107c7c"}
Jul 24 18:40:30.742311 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.742269    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6g8zt" podStartSLOduration=4.187079584 podStartE2EDuration="22.742252943s" totalImagesPullingTime="18.555173359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:30.72517966 +0000 UTC m=+22.643031182" watchObservedRunningTime="2026-07-24 18:40:30.742252943 +0000 UTC m=+22.660104469"
Jul 24 18:40:30.742426 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.742352    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w5khr" podStartSLOduration=4.131582166 podStartE2EDuration="22.742345159s" totalImagesPullingTime="18.610762993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:30.742003146 +0000 UTC m=+22.659854668" watchObservedRunningTime="2026-07-24 18:40:30.742345159 +0000 UTC m=+22.660196684"
Jul 24 18:40:30.761350 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.761317    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-24tcz" podStartSLOduration=4.195505375 podStartE2EDuration="22.761302006s" totalImagesPullingTime="18.565796631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:30.760822765 +0000 UTC m=+22.678674292" watchObservedRunningTime="2026-07-24 18:40:30.761302006 +0000 UTC m=+22.679153533"
Jul 24 18:40:30.777883 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:30.777190    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h67c8" podStartSLOduration=4.212385094 podStartE2EDuration="22.777178095s" totalImagesPullingTime="18.564793001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:30.777096796 +0000 UTC m=+22.694948321" watchObservedRunningTime="2026-07-24 18:40:30.777178095 +0000 UTC m=+22.695029624"
Jul 24 18:40:31.482996 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.482965    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 18:40:31.512219 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.512087    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T18:40:31.482983616Z","UUID":"d243d6e9-0b61-442a-879b-874e1466a5fc","Handler":null,"Name":"","Endpoint":""}
Jul 24 18:40:31.514142 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.514121    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 18:40:31.514243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.514155    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 18:40:31.568316 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.568270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:31.568406 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.568272    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:31.568406 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:31.568376    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:31.568482 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:31.568422    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:31.695776 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.695744    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tz24q" event={"ID":"69443bb4-e2f2-46e5-8de9-862a316347b9","Type":"ContainerStarted","Data":"9912614de010e64351666216651acf40a02e91caf3c3241afc36c7d918efa201"}
Jul 24 18:40:31.697645 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.697591    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc" event={"ID":"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d","Type":"ContainerStarted","Data":"5c4e9bf7f7bf967aa8cf3e38799b16b8f6acdab0ca3846c6ace7b3f555a4a9f7"}
Jul 24 18:40:31.700913 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.700890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"90c3422828b9341d046110103198d4b2d367bd7e956e3d195583126f8501cddf"}
Jul 24 18:40:31.710863 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:31.710829    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tz24q" podStartSLOduration=5.153045159 podStartE2EDuration="23.710815168s" totalImagesPullingTime="18.557770009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:31.710209063 +0000 UTC m=+23.628060587" watchObservedRunningTime="2026-07-24 18:40:31.710815168 +0000 UTC m=+23.628666693"
Jul 24 18:40:32.568483 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:32.568450    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:32.568914 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:32.568567    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:32.989233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:32.989201    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:32.990088 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:32.989956    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:33.568300 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.568126    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:33.568576 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.568174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:33.568576 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:33.568372    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:33.568576 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:33.568527    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:33.707305 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.707271    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc" event={"ID":"505b7920-54bc-4ea2-8a2b-c5f1d3d8679d","Type":"ContainerStarted","Data":"e51dbdedd0a4f45946b7577ab79c5633cf10ae9a34173402d2e218266aeb4acd"}
Jul 24 18:40:33.710984 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.710958    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"603a1cd753110436e0a0aa4a79346d390ea53b0668b46c1eb62fdb684c289f27"}
Jul 24 18:40:33.711141 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.711049    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:33.711591 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.711574    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k7h9t"
Jul 24 18:40:33.728256 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:33.728214    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrxc" podStartSLOduration=4.913304189 podStartE2EDuration="25.728200081s" totalImagesPullingTime="20.814895892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:33.727569744 +0000 UTC m=+25.645421270" watchObservedRunningTime="2026-07-24 18:40:33.728200081 +0000 UTC m=+25.646051609"
Jul 24 18:40:34.568232 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:34.568205    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:34.568701 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:34.568324    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:35.567979 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:35.567959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:35.568083 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:35.567959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:35.568126 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:35.568075    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:35.568161 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:35.568145    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:35.718685 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:35.718658    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" event={"ID":"4ecf7ae7-5b32-4471-89ed-fe5dfe8fddc5","Type":"ContainerStarted","Data":"2e761efafcb427f3248c26c38d2023a17aef386680c14254185326b910e1cd1f"}
Jul 24 18:40:35.719289 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:35.718904    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:35.749165 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:35.749120    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7" podStartSLOduration=9.121600863 podStartE2EDuration="27.749107743s" totalImagesPullingTime="18.62750688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:35.749005455 +0000 UTC m=+27.666856991" watchObservedRunningTime="2026-07-24 18:40:35.749107743 +0000 UTC m=+27.666959269"
Jul 24 18:40:36.567970 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.567801    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:36.568115 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:36.568040    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:36.722567 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.722539    2584 generic.go:356] "Generic (PLEG): container finished" podID="94612fef-a392-4883-bf20-f6833abfc633" containerID="c50e94787dd5dfbf40a96c1323e3e51cd7a1be902123a9b11226e4bf33ef7b06" exitCode=0
Jul 24 18:40:36.722918 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.722620    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerDied","Data":"c50e94787dd5dfbf40a96c1323e3e51cd7a1be902123a9b11226e4bf33ef7b06"}
Jul 24 18:40:36.723107 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.723082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:36.723234 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.723154    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:36.737609 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.737592    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:36.737876 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:36.737864    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:40:37.568310 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.568238    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:37.568502 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:37.568360    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:37.568502 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.568410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:37.568623 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:37.568508    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:37.822285 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.822229    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z85kl"]
Jul 24 18:40:37.822628 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.822333    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:37.822628 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:37.822420    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:37.825072 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.825033    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p2g2"]
Jul 24 18:40:37.825189 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.825175    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:37.825326 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:37.825303    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:37.825691 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.825652    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r66w7"]
Jul 24 18:40:37.825792 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:37.825759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:37.825870 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:37.825844    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:38.728836 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:38.728649    2584 generic.go:356] "Generic (PLEG): container finished" podID="94612fef-a392-4883-bf20-f6833abfc633" containerID="60fff014b0d657821aa7c73445e866dcd768ab285d2cd88caabd81a35cdc4d2b" exitCode=0
Jul 24 18:40:38.728983 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:38.728732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerDied","Data":"60fff014b0d657821aa7c73445e866dcd768ab285d2cd88caabd81a35cdc4d2b"}
Jul 24 18:40:39.567870 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:39.567826    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:39.568280 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:39.567944    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:39.568280 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:39.567993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:39.568280 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:39.568103    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:39.568415 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:39.568398    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:39.568497 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:39.568481    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:40.735295 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:40.735263    2584 generic.go:356] "Generic (PLEG): container finished" podID="94612fef-a392-4883-bf20-f6833abfc633" containerID="8f83f2f28e4f75753908cac234b46d0296402ef48aed49e9b6a0ea518513617a" exitCode=0
Jul 24 18:40:40.735845 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:40.735306    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerDied","Data":"8f83f2f28e4f75753908cac234b46d0296402ef48aed49e9b6a0ea518513617a"}
Jul 24 18:40:41.567952 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:41.567874    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:41.567952 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:41.567916    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:41.568187 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:41.567994    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:41.568312 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:41.568277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:41.568416 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:41.568381    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:41.568478 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:41.568453    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:42.204256 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:42.204217    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:42.204803 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:42.204264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:42.204803 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.204366    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:42.204803 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.204424    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret podName:99185c08-404e-46af-9db0-6cf2685a34af nodeName:}" failed. No retries permitted until 2026-07-24 18:41:14.204405849 +0000 UTC m=+66.122257373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret") pod "global-pull-secret-syncer-8p2g2" (UID: "99185c08-404e-46af-9db0-6cf2685a34af") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:40:42.204803 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.204366    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:42.204803 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.204485    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:41:14.204471945 +0000 UTC m=+66.122323454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:40:42.405758 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:42.405725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:42.405921 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.405850    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:40:42.405921 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.405866    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:40:42.405921 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.405875    2584 projected.go:196] Error preparing data for projected volume kube-api-access-mtzcw for pod openshift-network-diagnostics/network-check-target-r66w7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:42.406083 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:42.405925    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw podName:3aff4f2d-b7e2-4a25-8e97-498643f0f3f7 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:14.405907275 +0000 UTC m=+66.323758801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtzcw" (UniqueName: "kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw") pod "network-check-target-r66w7" (UID: "3aff4f2d-b7e2-4a25-8e97-498643f0f3f7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:40:43.568578 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.568544    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:43.568978 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.568654    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:43.568978 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:43.568670    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z85kl" podUID="e88c7e1b-b36d-4832-b697-5fc853aeac4e"
Jul 24 18:40:43.568978 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.568687    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:43.568978 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:43.568779    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p2g2" podUID="99185c08-404e-46af-9db0-6cf2685a34af"
Jul 24 18:40:43.568978 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:43.568877    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r66w7" podUID="3aff4f2d-b7e2-4a25-8e97-498643f0f3f7"
Jul 24 18:40:43.870678 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.870650    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeReady"
Jul 24 18:40:43.870860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.870782    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 18:40:43.915518 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.915444    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hq7d8"]
Jul 24 18:40:43.917906 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.917886    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vllf4"]
Jul 24 18:40:43.918043 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.918021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:43.919791 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.919769    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:43.920889 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.920864    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 18:40:43.921168 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.921147    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 18:40:43.921261 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.921228    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwwl2\""
Jul 24 18:40:43.922604 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.922584    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 18:40:43.922604 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.922600    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 18:40:43.922761 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.922665    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zw859\""
Jul 24 18:40:43.922913 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.922885    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 18:40:43.929188 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.929166    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hq7d8"]
Jul 24 18:40:43.932798 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:43.932779    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vllf4"]
Jul 24 18:40:44.017696 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.017663    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52s74\" (UniqueName: \"kubernetes.io/projected/b2ac3053-85af-4a76-b6ad-14738a999ed5-kube-api-access-52s74\") pod \"ingress-canary-vllf4\" (UID: \"b2ac3053-85af-4a76-b6ad-14738a999ed5\") " pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.017849 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.017711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smzs\" (UniqueName: \"kubernetes.io/projected/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-kube-api-access-6smzs\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.017849 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.017784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-config-volume\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.017849 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.017815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2ac3053-85af-4a76-b6ad-14738a999ed5-cert\") pod \"ingress-canary-vllf4\" (UID: \"b2ac3053-85af-4a76-b6ad-14738a999ed5\") " pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.017987 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.017849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-tmp-dir\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.017987 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.017872    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.119167 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-config-volume\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.119167 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2ac3053-85af-4a76-b6ad-14738a999ed5-cert\") pod \"ingress-canary-vllf4\" (UID: \"b2ac3053-85af-4a76-b6ad-14738a999ed5\") " pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.119380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119194    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-tmp-dir\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.119380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.119380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52s74\" (UniqueName: \"kubernetes.io/projected/b2ac3053-85af-4a76-b6ad-14738a999ed5-kube-api-access-52s74\") pod \"ingress-canary-vllf4\" (UID: \"b2ac3053-85af-4a76-b6ad-14738a999ed5\") " pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.119380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smzs\" (UniqueName: \"kubernetes.io/projected/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-kube-api-access-6smzs\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.119559 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:44.119381    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:44.119559 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:44.119450    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls podName:672be5d8-e78c-48f2-8b1d-076fa1a61c2b nodeName:}" failed. No retries permitted until 2026-07-24 18:40:44.619428048 +0000 UTC m=+36.537279556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls") pod "dns-default-hq7d8" (UID: "672be5d8-e78c-48f2-8b1d-076fa1a61c2b") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:44.119647 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119595    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-tmp-dir\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.119977 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.119954    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-config-volume\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.123853 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.123802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2ac3053-85af-4a76-b6ad-14738a999ed5-cert\") pod \"ingress-canary-vllf4\" (UID: \"b2ac3053-85af-4a76-b6ad-14738a999ed5\") " pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.127912 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.127889    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smzs\" (UniqueName: \"kubernetes.io/projected/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-kube-api-access-6smzs\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.128434 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.128415    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52s74\" (UniqueName: \"kubernetes.io/projected/b2ac3053-85af-4a76-b6ad-14738a999ed5-kube-api-access-52s74\") pod \"ingress-canary-vllf4\" (UID: \"b2ac3053-85af-4a76-b6ad-14738a999ed5\") " pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.237688 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.237656    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vllf4"
Jul 24 18:40:44.623638 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.623602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:44.624163 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:44.623741    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:44.624163 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:44.623802    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls podName:672be5d8-e78c-48f2-8b1d-076fa1a61c2b nodeName:}" failed. No retries permitted until 2026-07-24 18:40:45.62378559 +0000 UTC m=+37.541637094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls") pod "dns-default-hq7d8" (UID: "672be5d8-e78c-48f2-8b1d-076fa1a61c2b") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:44.830154 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:44.829993    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vllf4"]
Jul 24 18:40:44.833873 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:40:44.833840    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ac3053_85af_4a76_b6ad_14738a999ed5.slice/crio-ae41258fcba66ecd3e960c44a6a2273324dcd68147f04a548a2f0b31bf1c310e WatchSource:0}: Error finding container ae41258fcba66ecd3e960c44a6a2273324dcd68147f04a548a2f0b31bf1c310e: Status 404 returned error can't find the container with id ae41258fcba66ecd3e960c44a6a2273324dcd68147f04a548a2f0b31bf1c310e
Jul 24 18:40:45.567861 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.567825    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:40:45.568037 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.567869    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:40:45.568037 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.567869    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:40:45.572242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.572041    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 18:40:45.572242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.572080    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bhdg2\""
Jul 24 18:40:45.572242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.572097    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 18:40:45.572242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.572144    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8czh\""
Jul 24 18:40:45.572242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.572239    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 18:40:45.572536 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.572355    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 18:40:45.632293 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.632271    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:45.632628 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:45.632413    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:45.632628 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:45.632476    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls podName:672be5d8-e78c-48f2-8b1d-076fa1a61c2b nodeName:}" failed. No retries permitted until 2026-07-24 18:40:47.632459062 +0000 UTC m=+39.550310576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls") pod "dns-default-hq7d8" (UID: "672be5d8-e78c-48f2-8b1d-076fa1a61c2b") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:45.750221 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.750194    2584 generic.go:356] "Generic (PLEG): container finished" podID="94612fef-a392-4883-bf20-f6833abfc633" containerID="39d9e0b1879269cd1641c0db746c8142f8ba74acaa3446d4ea199d3dedada060" exitCode=0
Jul 24 18:40:45.750343 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.750279    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerDied","Data":"39d9e0b1879269cd1641c0db746c8142f8ba74acaa3446d4ea199d3dedada060"}
Jul 24 18:40:45.751571 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:45.751401    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vllf4" event={"ID":"b2ac3053-85af-4a76-b6ad-14738a999ed5","Type":"ContainerStarted","Data":"ae41258fcba66ecd3e960c44a6a2273324dcd68147f04a548a2f0b31bf1c310e"}
Jul 24 18:40:46.757563 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:46.757352    2584 generic.go:356] "Generic (PLEG): container finished" podID="94612fef-a392-4883-bf20-f6833abfc633" containerID="fbb49691ffe45e7a12ec12edd6a8a62a3070ea4a418101fb05e291efc29972e0" exitCode=0
Jul 24 18:40:46.757947 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:46.757425    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerDied","Data":"fbb49691ffe45e7a12ec12edd6a8a62a3070ea4a418101fb05e291efc29972e0"}
Jul 24 18:40:47.647864 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:47.647843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:47.648003 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:47.647983    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:47.648115 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:47.648040    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls podName:672be5d8-e78c-48f2-8b1d-076fa1a61c2b nodeName:}" failed. No retries permitted until 2026-07-24 18:40:51.648023582 +0000 UTC m=+43.565875086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls") pod "dns-default-hq7d8" (UID: "672be5d8-e78c-48f2-8b1d-076fa1a61c2b") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:47.763190 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:47.763153    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" event={"ID":"94612fef-a392-4883-bf20-f6833abfc633","Type":"ContainerStarted","Data":"ae9470a445b110b95e5e4cc78cfe022b1d6dedd2d5477e8b1f1db848f9ec8932"}
Jul 24 18:40:47.764566 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:47.764547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vllf4" event={"ID":"b2ac3053-85af-4a76-b6ad-14738a999ed5","Type":"ContainerStarted","Data":"f214ead75fb776927aeb122076abda30f28f03ae13d421d4b3ba35dd65fefd28"}
Jul 24 18:40:47.787840 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:47.787799    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbmrr" podStartSLOduration=10.070414719 podStartE2EDuration="39.787787759s" totalImagesPullingTime="29.71737304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:47.786244285 +0000 UTC m=+39.704095809" watchObservedRunningTime="2026-07-24 18:40:47.787787759 +0000 UTC m=+39.705639284"
Jul 24 18:40:47.801907 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:47.801870    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vllf4" podStartSLOduration=2.042341503 podStartE2EDuration="4.801859078s" totalImagesPullingTime="2.759517575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:40:47.801344601 +0000 UTC m=+39.719196126" watchObservedRunningTime="2026-07-24 18:40:47.801859078 +0000 UTC m=+39.719710635"
Jul 24 18:40:51.672895 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:51.672859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:51.673350 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:51.672961    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:51.673350 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:51.673010    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls podName:672be5d8-e78c-48f2-8b1d-076fa1a61c2b nodeName:}" failed. No retries permitted until 2026-07-24 18:40:59.672998171 +0000 UTC m=+51.590849675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls") pod "dns-default-hq7d8" (UID: "672be5d8-e78c-48f2-8b1d-076fa1a61c2b") : secret "dns-default-metrics-tls" not found
Jul 24 18:40:59.723183 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:40:59.723153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:40:59.723633 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:59.723266    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 18:40:59.723633 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:40:59.723323    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls podName:672be5d8-e78c-48f2-8b1d-076fa1a61c2b nodeName:}" failed. No retries permitted until 2026-07-24 18:41:15.72331026 +0000 UTC m=+67.641161763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls") pod "dns-default-hq7d8" (UID: "672be5d8-e78c-48f2-8b1d-076fa1a61c2b") : secret "dns-default-metrics-tls" not found
Jul 24 18:41:00.794807 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.794776    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5884c859b7-9s7wm"]
Jul 24 18:41:00.809167 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.809141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5884c859b7-9s7wm"]
Jul 24 18:41:00.809284 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.809244    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.812078 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812032    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 18:41:00.812197 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812044    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 18:41:00.812197 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812130    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 18:41:00.812478 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812460    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 18:41:00.812562 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812511    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 18:41:00.812562 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812540    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2hfq7\""
Jul 24 18:41:00.812680 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.812534    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 18:41:00.831091 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.831053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-stats-auth\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.831192 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.831137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.831192 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.831171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.831297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.831197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nq8w\" (UniqueName: \"kubernetes.io/projected/eee7d57c-578f-4a71-9396-997f51897678-kube-api-access-9nq8w\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.831297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.831283    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-default-certificate\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.914598 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.914581    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5454ffdbc4-7846l"]
Jul 24 18:41:00.931594 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.931573    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.931594 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.931599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.931732 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.931619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nq8w\" (UniqueName: \"kubernetes.io/projected/eee7d57c-578f-4a71-9396-997f51897678-kube-api-access-9nq8w\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.931732 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:00.931718    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 18:41:00.931798 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:00.931750    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:01.431732727 +0000 UTC m=+53.349584249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : configmap references non-existent config key: service-ca.crt
Jul 24 18:41:00.931798 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:00.931768    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:01.431760267 +0000 UTC m=+53.349611770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : secret "router-metrics-certs-default" not found
Jul 24 18:41:00.931869 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.931840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-default-certificate\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.931909 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.931877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-stats-auth\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.936215 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.936192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-stats-auth\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.936298 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.936212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-default-certificate\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.941026 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.941006    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5454ffdbc4-7846l"]
Jul 24 18:41:00.941122 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.941096    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:00.943573 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.943557    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 18:41:00.944085 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.944053    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 18:41:00.944274 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.944104    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 18:41:00.944383 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.944334    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tlbzw\""
Jul 24 18:41:00.952048 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.952024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nq8w\" (UniqueName: \"kubernetes.io/projected/eee7d57c-578f-4a71-9396-997f51897678-kube-api-access-9nq8w\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:00.952814 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:00.952797    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 18:41:01.032305 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-ca-trust-extracted\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032406 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032312    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032406 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032332    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-image-registry-private-configuration\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032406 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-certificates\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032501 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-trusted-ca\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032501 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-installation-pull-secrets\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032501 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032487    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tfw\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-kube-api-access-p9tfw\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.032590 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.032528    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-bound-sa-token\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.132872 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.132846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-ca-trust-extracted\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.132993 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.132881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.132993 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.132899    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-image-registry-private-configuration\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.132993 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.132981    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 18:41:01.133143 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.132998    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5454ffdbc4-7846l: secret "image-registry-tls" not found
Jul 24 18:41:01.133143 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133026    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-certificates\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.133143 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.133044    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls podName:a6fa0350-9e9b-4361-8c55-05c8f9a5a564 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:01.633029767 +0000 UTC m=+53.550881269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls") pod "image-registry-5454ffdbc4-7846l" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564") : secret "image-registry-tls" not found
Jul 24 18:41:01.133143 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133102    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-trusted-ca\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.133380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-installation-pull-secrets\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.133380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133172    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tfw\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-kube-api-access-p9tfw\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.133380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-bound-sa-token\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.133380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133291    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-ca-trust-extracted\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.133631 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.133607    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-certificates\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.134096 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.134076    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-trusted-ca\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.135590 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.135558    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-image-registry-private-configuration\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.135677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.135621    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-installation-pull-secrets\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.141465 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.141440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-bound-sa-token\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.141709 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.141689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tfw\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-kube-api-access-p9tfw\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.436460 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.436383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:01.436460 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.436415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:01.436672 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.436573    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:02.436553079 +0000 UTC m=+54.354404586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : configmap references non-existent config key: service-ca.crt
Jul 24 18:41:01.436672 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.436590    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 18:41:01.436672 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.436638    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:02.436625175 +0000 UTC m=+54.354476677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : secret "router-metrics-certs-default" not found
Jul 24 18:41:01.637770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:01.637739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:01.637916 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.637876    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 18:41:01.637916 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.637893    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5454ffdbc4-7846l: secret "image-registry-tls" not found
Jul 24 18:41:01.637995 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:01.637950    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls podName:a6fa0350-9e9b-4361-8c55-05c8f9a5a564 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:02.637934871 +0000 UTC m=+54.555786377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls") pod "image-registry-5454ffdbc4-7846l" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564") : secret "image-registry-tls" not found
Jul 24 18:41:02.444809 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:02.444769    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:02.444809 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:02.444812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:02.445247 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:02.444921    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 18:41:02.445247 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:02.444946    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:04.444927097 +0000 UTC m=+56.362778600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : configmap references non-existent config key: service-ca.crt
Jul 24 18:41:02.445247 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:02.444968    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:04.444960862 +0000 UTC m=+56.362812366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : secret "router-metrics-certs-default" not found
Jul 24 18:41:02.646485 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:02.646431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:02.646677 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:02.646597    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 18:41:02.646677 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:02.646609    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5454ffdbc4-7846l: secret "image-registry-tls" not found
Jul 24 18:41:02.646677 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:02.646651    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls podName:a6fa0350-9e9b-4361-8c55-05c8f9a5a564 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:04.646639484 +0000 UTC m=+56.564490987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls") pod "image-registry-5454ffdbc4-7846l" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564") : secret "image-registry-tls" not found
Jul 24 18:41:04.459924 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:04.459890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:04.459924 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:04.459926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:04.460409 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:04.460040    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 18:41:04.460409 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:04.460042    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:08.460025428 +0000 UTC m=+60.377876931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : configmap references non-existent config key: service-ca.crt
Jul 24 18:41:04.460409 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:04.460130    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:08.460109111 +0000 UTC m=+60.377960624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : secret "router-metrics-certs-default" not found
Jul 24 18:41:04.662353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:04.662319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:04.662469 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:04.662416    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 18:41:04.662469 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:04.662426    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5454ffdbc4-7846l: secret "image-registry-tls" not found
Jul 24 18:41:04.662469 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:04.662462    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls podName:a6fa0350-9e9b-4361-8c55-05c8f9a5a564 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:08.662451936 +0000 UTC m=+60.580303439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls") pod "image-registry-5454ffdbc4-7846l" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564") : secret "image-registry-tls" not found
Jul 24 18:41:05.806858 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.806819    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kpcm9"]
Jul 24 18:41:05.809501 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.809487    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.813592 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.813570    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 18:41:05.813727 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.813613    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 18:41:05.813727 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.813618    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 18:41:05.818849 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.818821    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 18:41:05.818961 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.818823    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bkk8\""
Jul 24 18:41:05.840407 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.840386    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpcm9"]
Jul 24 18:41:05.871269 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.871243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c975f2-1b02-464d-9c3c-6fd0afb03efa-data-volume\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.871350 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.871335    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.871399 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.871359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2tz\" (UniqueName: \"kubernetes.io/projected/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-api-access-4z2tz\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.871399 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.871377    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93c975f2-1b02-464d-9c3c-6fd0afb03efa-crio-socket\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.871464 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.871401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972178 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972257 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972182    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2tz\" (UniqueName: \"kubernetes.io/projected/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-api-access-4z2tz\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972257 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972200    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93c975f2-1b02-464d-9c3c-6fd0afb03efa-crio-socket\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972257 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972371 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:05.972307    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:05.972371 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:05.972314    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:05.972371 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972341    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c975f2-1b02-464d-9c3c-6fd0afb03efa-data-volume\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972496 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:05.972374    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:06.472351959 +0000 UTC m=+58.390203469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:05.972496 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972315    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93c975f2-1b02-464d-9c3c-6fd0afb03efa-crio-socket\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.972496 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:05.972466    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:06.472437558 +0000 UTC m=+58.390289063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:05.972644 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.972600    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93c975f2-1b02-464d-9c3c-6fd0afb03efa-data-volume\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:05.994913 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:05.994893    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2tz\" (UniqueName: \"kubernetes.io/projected/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-api-access-4z2tz\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:06.475403 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:06.475373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:06.475532 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:06.475411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:06.475532 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:06.475509    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:06.475532 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:06.475515    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:06.475648 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:06.475581    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:07.475562348 +0000 UTC m=+59.393413855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:06.475648 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:06.475596    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:07.475589764 +0000 UTC m=+59.393441267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:07.482880 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:07.482847    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:07.483267 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:07.482888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:07.483267 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:07.482973    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:07.483267 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:07.482997    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:07.483267 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:07.483037    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:09.483019833 +0000 UTC m=+61.400871354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:07.483267 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:07.483052    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:09.48304525 +0000 UTC m=+61.400896752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:07.566682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:07.566655    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6g8zt_84e84626-467b-4a32-88cd-e8f163e4d239/dns-node-resolver/0.log"
Jul 24 18:41:08.489987 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:08.489953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:08.489987 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:08.489985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:08.490487 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:08.490149    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:16.490125277 +0000 UTC m=+68.407976793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : configmap references non-existent config key: service-ca.crt
Jul 24 18:41:08.490487 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:08.490162    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 18:41:08.490487 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:08.490202    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs podName:eee7d57c-578f-4a71-9396-997f51897678 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:16.490188295 +0000 UTC m=+68.408039802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs") pod "router-default-5884c859b7-9s7wm" (UID: "eee7d57c-578f-4a71-9396-997f51897678") : secret "router-metrics-certs-default" not found
Jul 24 18:41:08.693567 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:08.693535    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:08.693708 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:08.693647    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 18:41:08.693708 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:08.693658    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5454ffdbc4-7846l: secret "image-registry-tls" not found
Jul 24 18:41:08.693708 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:08.693700    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls podName:a6fa0350-9e9b-4361-8c55-05c8f9a5a564 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:16.693688203 +0000 UTC m=+68.611539705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls") pod "image-registry-5454ffdbc4-7846l" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564") : secret "image-registry-tls" not found
Jul 24 18:41:08.749202 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:08.749142    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcvb7"
Jul 24 18:41:08.969198 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:08.969173    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h67c8_c12be58e-5ecc-4abb-b3e4-e039a6bfdc01/node-ca/0.log"
Jul 24 18:41:09.499169 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:09.499130    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:09.499169 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:09.499174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:09.499577 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:09.499242    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:09.499577 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:09.499259    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:09.499577 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:09.499284    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:13.49927143 +0000 UTC m=+65.417122934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:09.499577 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:09.499301    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:13.499290135 +0000 UTC m=+65.417141638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:09.766947 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:09.766885    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vllf4_b2ac3053-85af-4a76-b6ad-14738a999ed5/serve-healthcheck-canary/0.log"
Jul 24 18:41:13.529294 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:13.529261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:13.529294 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:13.529297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:13.529800 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:13.529366    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 18:41:13.529800 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:13.529415    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:21.529402222 +0000 UTC m=+73.447253729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : configmap "kube-rbac-proxy" not found
Jul 24 18:41:13.529800 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:13.529418    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:13.529800 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:13.529479    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls podName:93c975f2-1b02-464d-9c3c-6fd0afb03efa nodeName:}" failed. No retries permitted until 2026-07-24 18:41:21.529462413 +0000 UTC m=+73.447313933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpcm9" (UID: "93c975f2-1b02-464d-9c3c-6fd0afb03efa") : secret "insights-runtime-extractor-tls" not found
Jul 24 18:41:14.235160 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.235128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:41:14.235318 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.235181    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:41:14.238010 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.237983    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 18:41:14.238240 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.238224    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 18:41:14.246372 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:14.246357    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 18:41:14.246411 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:14.246407    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs podName:e88c7e1b-b36d-4832-b697-5fc853aeac4e nodeName:}" failed. No retries permitted until 2026-07-24 18:42:18.246393612 +0000 UTC m=+130.164245115 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs") pod "network-metrics-daemon-z85kl" (UID: "e88c7e1b-b36d-4832-b697-5fc853aeac4e") : secret "metrics-daemon-secret" not found
Jul 24 18:41:14.248358 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.248335    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99185c08-404e-46af-9db0-6cf2685a34af-original-pull-secret\") pod \"global-pull-secret-syncer-8p2g2\" (UID: \"99185c08-404e-46af-9db0-6cf2685a34af\") " pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:41:14.393127 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.393104    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p2g2"
Jul 24 18:41:14.437202 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.437074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:41:14.440213 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.440191    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 18:41:14.450339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.450314    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 18:41:14.461514 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.461492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtzcw\" (UniqueName: \"kubernetes.io/projected/3aff4f2d-b7e2-4a25-8e97-498643f0f3f7-kube-api-access-mtzcw\") pod \"network-check-target-r66w7\" (UID: \"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7\") " pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:41:14.511365 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.511315    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p2g2"]
Jul 24 18:41:14.514206 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:14.514182    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99185c08_404e_46af_9db0_6cf2685a34af.slice/crio-3dc0af76ceff8d4f834736a5b95ca190c4fb24f3878b94f5440dcc2bf093202c WatchSource:0}: Error finding container 3dc0af76ceff8d4f834736a5b95ca190c4fb24f3878b94f5440dcc2bf093202c: Status 404 returned error can't find the container with id 3dc0af76ceff8d4f834736a5b95ca190c4fb24f3878b94f5440dcc2bf093202c
Jul 24 18:41:14.682228 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.682205    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bhdg2\""
Jul 24 18:41:14.689968 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.689951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:41:14.823684 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.823651    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r66w7"]
Jul 24 18:41:14.823812 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:14.823713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p2g2" event={"ID":"99185c08-404e-46af-9db0-6cf2685a34af","Type":"ContainerStarted","Data":"3dc0af76ceff8d4f834736a5b95ca190c4fb24f3878b94f5440dcc2bf093202c"}
Jul 24 18:41:14.826180 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:14.826153    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aff4f2d_b7e2_4a25_8e97_498643f0f3f7.slice/crio-57d65232c7d1c83144f5d4473d5ddf67dd5a5541209215242c0ce1ac60e900bc WatchSource:0}: Error finding container 57d65232c7d1c83144f5d4473d5ddf67dd5a5541209215242c0ce1ac60e900bc: Status 404 returned error can't find the container with id 57d65232c7d1c83144f5d4473d5ddf67dd5a5541209215242c0ce1ac60e900bc
Jul 24 18:41:15.758211 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:15.758171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:41:15.760730 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:15.760704    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672be5d8-e78c-48f2-8b1d-076fa1a61c2b-metrics-tls\") pod \"dns-default-hq7d8\" (UID: \"672be5d8-e78c-48f2-8b1d-076fa1a61c2b\") " pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:41:15.828168 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:15.828132    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r66w7" event={"ID":"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7","Type":"ContainerStarted","Data":"57d65232c7d1c83144f5d4473d5ddf67dd5a5541209215242c0ce1ac60e900bc"}
Jul 24 18:41:16.033153 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.033030    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwwl2\""
Jul 24 18:41:16.041239 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.041212    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:41:16.188635 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.188606    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hq7d8"]
Jul 24 18:41:16.192296 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:16.192267    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672be5d8_e78c_48f2_8b1d_076fa1a61c2b.slice/crio-6b7cc5e44443e9f0431ac5f12ed53ac89d08847a000f83730e9df76c655309bf WatchSource:0}: Error finding container 6b7cc5e44443e9f0431ac5f12ed53ac89d08847a000f83730e9df76c655309bf: Status 404 returned error can't find the container with id 6b7cc5e44443e9f0431ac5f12ed53ac89d08847a000f83730e9df76c655309bf
Jul 24 18:41:16.564209 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.564153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:16.564209 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.564201    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:16.564958 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.564908    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eee7d57c-578f-4a71-9396-997f51897678-service-ca-bundle\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:16.567169 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.567144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee7d57c-578f-4a71-9396-997f51897678-metrics-certs\") pod \"router-default-5884c859b7-9s7wm\" (UID: \"eee7d57c-578f-4a71-9396-997f51897678\") " pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:16.721645 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.721616    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2hfq7\""
Jul 24 18:41:16.729486 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.729455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:16.765974 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.765905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:16.768451 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.768401    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"image-registry-5454ffdbc4-7846l\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") " pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:16.833535 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.833500    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq7d8" event={"ID":"672be5d8-e78c-48f2-8b1d-076fa1a61c2b","Type":"ContainerStarted","Data":"6b7cc5e44443e9f0431ac5f12ed53ac89d08847a000f83730e9df76c655309bf"}
Jul 24 18:41:16.856443 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.856418    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tlbzw\""
Jul 24 18:41:16.864999 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.864789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:16.886772 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:16.886687    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5884c859b7-9s7wm"]
Jul 24 18:41:16.891331 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:16.891295    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee7d57c_578f_4a71_9396_997f51897678.slice/crio-4f3225518cc1ff7932b2a8738a4463eedeeee3ce16a60498ec25a4439e70213a WatchSource:0}: Error finding container 4f3225518cc1ff7932b2a8738a4463eedeeee3ce16a60498ec25a4439e70213a: Status 404 returned error can't find the container with id 4f3225518cc1ff7932b2a8738a4463eedeeee3ce16a60498ec25a4439e70213a
Jul 24 18:41:17.030116 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.029907    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5454ffdbc4-7846l"]
Jul 24 18:41:17.034167 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:17.034127    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6fa0350_9e9b_4361_8c55_05c8f9a5a564.slice/crio-e9bf2e213a2e63c057b9794b708244c0ee0ee6f5e57ba10d918da8d7e81f5ce3 WatchSource:0}: Error finding container e9bf2e213a2e63c057b9794b708244c0ee0ee6f5e57ba10d918da8d7e81f5ce3: Status 404 returned error can't find the container with id e9bf2e213a2e63c057b9794b708244c0ee0ee6f5e57ba10d918da8d7e81f5ce3
Jul 24 18:41:17.838591 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.838551    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5884c859b7-9s7wm" event={"ID":"eee7d57c-578f-4a71-9396-997f51897678","Type":"ContainerStarted","Data":"d0ea625e350d3505d0fbfdc86f8476a6e6d61557d8c2a8f68c8c6c0a3489a48a"}
Jul 24 18:41:17.839004 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.838616    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5884c859b7-9s7wm" event={"ID":"eee7d57c-578f-4a71-9396-997f51897678","Type":"ContainerStarted","Data":"4f3225518cc1ff7932b2a8738a4463eedeeee3ce16a60498ec25a4439e70213a"}
Jul 24 18:41:17.840323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.840297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l" event={"ID":"a6fa0350-9e9b-4361-8c55-05c8f9a5a564","Type":"ContainerStarted","Data":"05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594"}
Jul 24 18:41:17.840448 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.840333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l" event={"ID":"a6fa0350-9e9b-4361-8c55-05c8f9a5a564","Type":"ContainerStarted","Data":"e9bf2e213a2e63c057b9794b708244c0ee0ee6f5e57ba10d918da8d7e81f5ce3"}
Jul 24 18:41:17.840448 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.840434    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:17.859993 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.859944    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5884c859b7-9s7wm" podStartSLOduration=17.85992775 podStartE2EDuration="17.85992775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:17.859280249 +0000 UTC m=+69.777131810" watchObservedRunningTime="2026-07-24 18:41:17.85992775 +0000 UTC m=+69.777779276"
Jul 24 18:41:17.878010 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:17.877969    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l" podStartSLOduration=17.877952385 podStartE2EDuration="17.877952385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:17.877488002 +0000 UTC m=+69.795339522" watchObservedRunningTime="2026-07-24 18:41:17.877952385 +0000 UTC m=+69.795803912"
Jul 24 18:41:18.730491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:18.730456    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:18.733570 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:18.733541    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:18.843441 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:18.843406    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:18.844883 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:18.844860    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5884c859b7-9s7wm"
Jul 24 18:41:20.850209 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.850181    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r66w7" event={"ID":"3aff4f2d-b7e2-4a25-8e97-498643f0f3f7","Type":"ContainerStarted","Data":"e7507aeb76e278266efd6569e9a7693372fb7ca5164410c694c54c2f70d76481"}
Jul 24 18:41:20.850589 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.850283    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:41:20.851978 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.851954    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq7d8" event={"ID":"672be5d8-e78c-48f2-8b1d-076fa1a61c2b","Type":"ContainerStarted","Data":"831e741fabfdfc71b89179285d181f7ceff23bdbf7cc04010b728b8c04407e9f"}
Jul 24 18:41:20.852117 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.851994    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hq7d8" event={"ID":"672be5d8-e78c-48f2-8b1d-076fa1a61c2b","Type":"ContainerStarted","Data":"ffd03ea4ebab6b2bc6fa21cc3118697f95cadde0f06e3222657f93d834eedb08"}
Jul 24 18:41:20.852117 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.852075    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:41:20.853379 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.853357    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p2g2" event={"ID":"99185c08-404e-46af-9db0-6cf2685a34af","Type":"ContainerStarted","Data":"7004307a52ea9eeb6d61f3f2f16810c25be2d907222654ab4bb9bf043bb5fb08"}
Jul 24 18:41:20.868916 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.866433    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r66w7" podStartSLOduration=67.678321859 podStartE2EDuration="1m12.866417824s" totalImagesPullingTime="5.188095965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:20.865907518 +0000 UTC m=+72.783759044" watchObservedRunningTime="2026-07-24 18:41:20.866417824 +0000 UTC m=+72.784269350"
Jul 24 18:41:20.881818 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.881783    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8p2g2" podStartSLOduration=67.36953908 podStartE2EDuration="1m12.881771873s" totalImagesPullingTime="5.512232793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:20.881270443 +0000 UTC m=+72.799121968" watchObservedRunningTime="2026-07-24 18:41:20.881771873 +0000 UTC m=+72.799623397"
Jul 24 18:41:20.899353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:20.899320    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hq7d8" podStartSLOduration=34.071078052 podStartE2EDuration="37.899308787s" totalImagesPullingTime="3.828230735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:20.898419776 +0000 UTC m=+72.816271302" watchObservedRunningTime="2026-07-24 18:41:20.899308787 +0000 UTC m=+72.817160312"
Jul 24 18:41:21.603133 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.603092    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:21.603133 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.603136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:21.603711 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.603689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93c975f2-1b02-464d-9c3c-6fd0afb03efa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:21.605288 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.605267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93c975f2-1b02-464d-9c3c-6fd0afb03efa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpcm9\" (UID: \"93c975f2-1b02-464d-9c3c-6fd0afb03efa\") " pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:21.723733 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.723709    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bkk8\""
Jul 24 18:41:21.731850 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.731832    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpcm9"
Jul 24 18:41:21.854449 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:21.854329    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpcm9"]
Jul 24 18:41:21.858170 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:21.858123    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c975f2_1b02_464d_9c3c_6fd0afb03efa.slice/crio-6e54561fb2ce709ecd9fc04b081021cb455e864b48c84c366073a2519ae02019 WatchSource:0}: Error finding container 6e54561fb2ce709ecd9fc04b081021cb455e864b48c84c366073a2519ae02019: Status 404 returned error can't find the container with id 6e54561fb2ce709ecd9fc04b081021cb455e864b48c84c366073a2519ae02019
Jul 24 18:41:22.862967 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:22.862932    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpcm9" event={"ID":"93c975f2-1b02-464d-9c3c-6fd0afb03efa","Type":"ContainerStarted","Data":"6e54561fb2ce709ecd9fc04b081021cb455e864b48c84c366073a2519ae02019"}
Jul 24 18:41:26.878188 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:26.878154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpcm9" event={"ID":"93c975f2-1b02-464d-9c3c-6fd0afb03efa","Type":"ContainerStarted","Data":"59bcc1e619fa4ba31468a54c8429ea18a5498d4acaa5026cb5f7bfda4a46fcc6"}
Jul 24 18:41:29.137315 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.137286    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5454ffdbc4-7846l"]
Jul 24 18:41:29.162417 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.162393    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"]
Jul 24 18:41:29.180588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.180563    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.184050 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.184030    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 18:41:29.185602 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.185576    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 18:41:29.185827 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.185807    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 18:41:29.185930 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.185810    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 18:41:29.186190 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.186174    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 18:41:29.186190 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.186183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 18:41:29.193153 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.193131    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"]
Jul 24 18:41:29.199978 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.199956    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 18:41:29.268368 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.268337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-hub\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.268368 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.268371    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.268569 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.268413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-ca\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.268569 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.268450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.268569 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.268510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.268709 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.268581    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q29t\" (UniqueName: \"kubernetes.io/projected/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-kube-api-access-2q29t\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.369426 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.369398    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.369601 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.369448    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q29t\" (UniqueName: \"kubernetes.io/projected/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-kube-api-access-2q29t\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.369601 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.369563    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-hub\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.369716 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.369616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.369716 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.369667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-ca\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.369716 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.369700    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.370514 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.370488    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.372418 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.372393    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-ca\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.372515 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.372415    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-hub\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.372588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.372567    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.372739 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.372713    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.383497 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.383453    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q29t\" (UniqueName: \"kubernetes.io/projected/efa5a3f9-9b80-4335-bd26-0b89f8e1e61e-kube-api-access-2q29t\") pod \"cluster-proxy-proxy-agent-7d66db65dd-ttwhl\" (UID: \"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:29.500544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:29.500474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"
Jul 24 18:41:30.298453 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:30.298428    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl"]
Jul 24 18:41:30.301674 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:30.301652    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefa5a3f9_9b80_4335_bd26_0b89f8e1e61e.slice/crio-7bda8333c8d1b63467a5098219677bdf9419d3640372915b87f09f4e6a1dfaeb WatchSource:0}: Error finding container 7bda8333c8d1b63467a5098219677bdf9419d3640372915b87f09f4e6a1dfaeb: Status 404 returned error can't find the container with id 7bda8333c8d1b63467a5098219677bdf9419d3640372915b87f09f4e6a1dfaeb
Jul 24 18:41:30.860500 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:30.860472    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hq7d8"
Jul 24 18:41:30.893433 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:30.892987    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpcm9" event={"ID":"93c975f2-1b02-464d-9c3c-6fd0afb03efa","Type":"ContainerStarted","Data":"214345caff3e185957e0db9640762b7d35a8e58a6615fb9801a4ead5e1ed2b3f"}
Jul 24 18:41:30.894871 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:30.894812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl" event={"ID":"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e","Type":"ContainerStarted","Data":"7bda8333c8d1b63467a5098219677bdf9419d3640372915b87f09f4e6a1dfaeb"}
Jul 24 18:41:35.915171 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:35.915136    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpcm9" event={"ID":"93c975f2-1b02-464d-9c3c-6fd0afb03efa","Type":"ContainerStarted","Data":"d1636bb445fab574f22befd7207f2c1117d2d420632e148f558a6ebb7107bc53"}
Jul 24 18:41:35.917138 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:35.917114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl" event={"ID":"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e","Type":"ContainerStarted","Data":"cda8454659f0d98a4f1126c56d855674890c0f5aa702ee49858ab8da4abf5f37"}
Jul 24 18:41:35.917235 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:35.917156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl" event={"ID":"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e","Type":"ContainerStarted","Data":"afe6eb838da9f6c613fedd4b099d5153b4d2965371e8654e0803edcc60716851"}
Jul 24 18:41:35.917235 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:35.917171    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl" event={"ID":"efa5a3f9-9b80-4335-bd26-0b89f8e1e61e","Type":"ContainerStarted","Data":"da695b2a40eddb4705ce50d02932a75edcda667afc4c4b0d53c7e9773f1b528f"}
Jul 24 18:41:35.936871 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:35.936832    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kpcm9" podStartSLOduration=17.221363983 podStartE2EDuration="30.936820055s" totalImagesPullingTime="13.715456072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:41:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:35.93565751 +0000 UTC m=+87.853509034" watchObservedRunningTime="2026-07-24 18:41:35.936820055 +0000 UTC m=+87.854671580"
Jul 24 18:41:35.953147 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:35.953011    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d66db65dd-ttwhl" podStartSLOduration=1.5446739489999999 podStartE2EDuration="6.952994023s" totalImagesPullingTime="5.408320074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:35.952834335 +0000 UTC m=+87.870685861" watchObservedRunningTime="2026-07-24 18:41:35.952994023 +0000 UTC m=+87.870845545"
Jul 24 18:41:39.142723 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:39.142698    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:51.861012 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:51.860983    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r66w7"
Jul 24 18:41:53.410458 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.410423    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"]
Jul 24 18:41:53.413288 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.413272    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.416066 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.416027    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 18:41:53.416185 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.416035    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 18:41:53.416471 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.416455    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 18:41:53.416523 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.416467    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9k9f2\""
Jul 24 18:41:53.417451 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.417432    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 18:41:53.417551 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.417468    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 18:41:53.424493 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.424473    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"]
Jul 24 18:41:53.441789 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.441769    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rxl78"]
Jul 24 18:41:53.443664 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.443650    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.446530 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.446513    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2wdjq\""
Jul 24 18:41:53.446619 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.446590    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 18:41:53.447895 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.447875    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 18:41:53.447980 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.447893    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 18:41:53.541336 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541314    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c89ec0b-98ec-44ee-acde-3e955fce0769-metrics-client-ca\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541429 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.541429 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc6bx\" (UniqueName: \"kubernetes.io/projected/9c89ec0b-98ec-44ee-acde-3e955fce0769-kube-api-access-kc6bx\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541429 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541408    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-textfile\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541429 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541425    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-accelerators-collector-config\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541574 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.541574 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-wtmp\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541574 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541504    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.541574 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-tls\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541706 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541706 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541606    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-root\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.541706 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541621    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jszgj\" (UniqueName: \"kubernetes.io/projected/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-kube-api-access-jszgj\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.541706 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.541636    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-sys\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.641946 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.641921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-root\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642075 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.641959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jszgj\" (UniqueName: \"kubernetes.io/projected/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-kube-api-access-jszgj\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.642075 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.641987    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-sys\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642193 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-root\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642193 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-sys\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642193 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c89ec0b-98ec-44ee-acde-3e955fce0769-metrics-client-ca\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.642339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642219    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc6bx\" (UniqueName: \"kubernetes.io/projected/9c89ec0b-98ec-44ee-acde-3e955fce0769-kube-api-access-kc6bx\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-textfile\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-accelerators-collector-config\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.642587 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-wtmp\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642587 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.642587 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-tls\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642587 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.642936 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:53.642915    2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 24 18:41:53.643572 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.643112    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-wtmp\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.643572 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:53.643121    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-tls podName:8c7696ea-c2cb-4f41-bf56-d3934e29d59a nodeName:}" failed. No retries permitted until 2026-07-24 18:41:54.143099819 +0000 UTC m=+106.060951328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-xbscq" (UID: "8c7696ea-c2cb-4f41-bf56-d3934e29d59a") : secret "openshift-state-metrics-tls" not found
Jul 24 18:41:53.643572 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:53.643213    2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 18:41:53.643572 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:53.643256    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-tls podName:9c89ec0b-98ec-44ee-acde-3e955fce0769 nodeName:}" failed. No retries permitted until 2026-07-24 18:41:54.143241582 +0000 UTC m=+106.061093092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-tls") pod "node-exporter-rxl78" (UID: "9c89ec0b-98ec-44ee-acde-3e955fce0769") : secret "node-exporter-tls" not found
Jul 24 18:41:53.643572 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.642969    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.643572 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.643459    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c89ec0b-98ec-44ee-acde-3e955fce0769-metrics-client-ca\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.643878 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.643742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-accelerators-collector-config\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.643878 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.643791    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-textfile\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.645230 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.645182    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.645737 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.645715    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:53.650827 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.650807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc6bx\" (UniqueName: \"kubernetes.io/projected/9c89ec0b-98ec-44ee-acde-3e955fce0769-kube-api-access-kc6bx\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:53.651405 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:53.651382    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jszgj\" (UniqueName: \"kubernetes.io/projected/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-kube-api-access-jszgj\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:54.146663 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.146630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:54.146848 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.146672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-tls\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:54.148964 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.148943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c89ec0b-98ec-44ee-acde-3e955fce0769-node-exporter-tls\") pod \"node-exporter-rxl78\" (UID: \"9c89ec0b-98ec-44ee-acde-3e955fce0769\") " pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:54.149204 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.149184    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c7696ea-c2cb-4f41-bf56-d3934e29d59a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xbscq\" (UID: \"8c7696ea-c2cb-4f41-bf56-d3934e29d59a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:54.157876 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.157850    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l" podUID="a6fa0350-9e9b-4361-8c55-05c8f9a5a564" containerName="registry" containerID="cri-o://05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594" gracePeriod=30
Jul 24 18:41:54.322412 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.322384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"
Jul 24 18:41:54.352204 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.352178    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rxl78"
Jul 24 18:41:54.361136 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:54.361105    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c89ec0b_98ec_44ee_acde_3e955fce0769.slice/crio-16fa6cc7636f632aa549fb02a48c95ec5e5c2c198b1f8e73fe8f1187bca2357b WatchSource:0}: Error finding container 16fa6cc7636f632aa549fb02a48c95ec5e5c2c198b1f8e73fe8f1187bca2357b: Status 404 returned error can't find the container with id 16fa6cc7636f632aa549fb02a48c95ec5e5c2c198b1f8e73fe8f1187bca2357b
Jul 24 18:41:54.381770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.381746    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:54.463998 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.463967    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq"]
Jul 24 18:41:54.466885 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:54.466860    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7696ea_c2cb_4f41_bf56_d3934e29d59a.slice/crio-efeb55ce04ae1f89cd6314d384cd9e794f850b8e651908ab9724b3f1e84538c3 WatchSource:0}: Error finding container efeb55ce04ae1f89cd6314d384cd9e794f850b8e651908ab9724b3f1e84538c3: Status 404 returned error can't find the container with id efeb55ce04ae1f89cd6314d384cd9e794f850b8e651908ab9724b3f1e84538c3
Jul 24 18:41:54.543470 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.543445    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:41:54.543786 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.543769    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6fa0350-9e9b-4361-8c55-05c8f9a5a564" containerName="registry"
Jul 24 18:41:54.543828 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.543792    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6fa0350-9e9b-4361-8c55-05c8f9a5a564" containerName="registry"
Jul 24 18:41:54.543870 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.543860    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6fa0350-9e9b-4361-8c55-05c8f9a5a564" containerName="registry"
Jul 24 18:41:54.547114 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.547095    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.549619 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.549598    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9tfw\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-kube-api-access-p9tfw\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.549717 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.549640    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.549717 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.549671    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-bound-sa-token\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.549824 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.549786    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 18:41:54.549873 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.549791    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-certificates\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.550217 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.549894    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-ca-trust-extracted\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.550363 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.550177    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:41:54.550363 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.550267    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-image-registry-private-configuration\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.550477 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.550376    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-installation-pull-secrets\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.550477 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.550407    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-trusted-ca\") pod \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\" (UID: \"a6fa0350-9e9b-4361-8c55-05c8f9a5a564\") "
Jul 24 18:41:54.550890 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.550870    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-certificates\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.551416 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.551392    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:41:54.551779 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.551582    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 18:41:54.551779 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.551741    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 18:41:54.551929 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.551822    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 18:41:54.552032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.551981    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 18:41:54.552206 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.552187    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 18:41:54.552274 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.552207    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 18:41:54.552659 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.552546    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fk2wq\""
Jul 24 18:41:54.552659 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.552570    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 18:41:54.553435 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.553308    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:41:54.553965 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.553592    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:41:54.553965 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.553775    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 18:41:54.556678 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.555270    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:41:54.556678 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.555304    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-kube-api-access-p9tfw" (OuterVolumeSpecName: "kube-api-access-p9tfw") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "kube-api-access-p9tfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:41:54.558481 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.558445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:41:54.564148 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.564117    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:41:54.566487 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.566458    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a6fa0350-9e9b-4361-8c55-05c8f9a5a564" (UID: "a6fa0350-9e9b-4361-8c55-05c8f9a5a564"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:41:54.652127 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652236 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652146    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff640631-4910-40dc-ab09-5793da4e3c4e-config-out\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652236 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff640631-4910-40dc-ab09-5793da4e3c4e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652286    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff640631-4910-40dc-ab09-5793da4e3c4e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652302    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-web-config\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652317    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652469 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652469 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652410    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff640631-4910-40dc-ab09-5793da4e3c4e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652469 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brjh\" (UniqueName: \"kubernetes.io/projected/ff640631-4910-40dc-ab09-5793da4e3c4e-kube-api-access-6brjh\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652575 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-config-volume\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652575 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652638 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ff640631-4910-40dc-ab09-5793da4e3c4e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.652678 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652662    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-registry-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.652711 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652685    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-bound-sa-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.652711 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652701    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-ca-trust-extracted\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.652774 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652720    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-image-registry-private-configuration\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.652774 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652735    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-installation-pull-secrets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.652774 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652752    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-trusted-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.652774 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.652768    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9tfw\" (UniqueName: \"kubernetes.io/projected/a6fa0350-9e9b-4361-8c55-05c8f9a5a564-kube-api-access-p9tfw\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:41:54.753524 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff640631-4910-40dc-ab09-5793da4e3c4e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753524 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brjh\" (UniqueName: \"kubernetes.io/projected/ff640631-4910-40dc-ab09-5793da4e3c4e-kube-api-access-6brjh\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753683 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-config-volume\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753683 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753796 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ff640631-4910-40dc-ab09-5793da4e3c4e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753796 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753911 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff640631-4910-40dc-ab09-5793da4e3c4e-config-out\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753971 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753911    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff640631-4910-40dc-ab09-5793da4e3c4e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.753971 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.754097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.753999    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff640631-4910-40dc-ab09-5793da4e3c4e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.754097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.754025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-web-config\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.754097 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.754046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.754266 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.754106    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.754266 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.754131    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ff640631-4910-40dc-ab09-5793da4e3c4e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.754363 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.754279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff640631-4910-40dc-ab09-5793da4e3c4e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.756443 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.756419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-config-volume\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.756645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.756870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.756982    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.757011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757325 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.757102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff640631-4910-40dc-ab09-5793da4e3c4e-config-out\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757456 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.757434    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.757519 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.757472    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff640631-4910-40dc-ab09-5793da4e3c4e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.758216 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.758196    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff640631-4910-40dc-ab09-5793da4e3c4e-web-config\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.758510 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.758496    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff640631-4910-40dc-ab09-5793da4e3c4e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.761576 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.761550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brjh\" (UniqueName: \"kubernetes.io/projected/ff640631-4910-40dc-ab09-5793da4e3c4e-kube-api-access-6brjh\") pod \"alertmanager-main-0\" (UID: \"ff640631-4910-40dc-ab09-5793da4e3c4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.880595 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.880563    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:41:54.971889 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.971860    2584 generic.go:356] "Generic (PLEG): container finished" podID="a6fa0350-9e9b-4361-8c55-05c8f9a5a564" containerID="05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594" exitCode=0
Jul 24 18:41:54.972017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.971933    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l"
Jul 24 18:41:54.972017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.971935    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l" event={"ID":"a6fa0350-9e9b-4361-8c55-05c8f9a5a564","Type":"ContainerDied","Data":"05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594"}
Jul 24 18:41:54.972017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.971995    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5454ffdbc4-7846l" event={"ID":"a6fa0350-9e9b-4361-8c55-05c8f9a5a564","Type":"ContainerDied","Data":"e9bf2e213a2e63c057b9794b708244c0ee0ee6f5e57ba10d918da8d7e81f5ce3"}
Jul 24 18:41:54.972233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.972022    2584 scope.go:117] "RemoveContainer" containerID="05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594"
Jul 24 18:41:54.975481 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.975451    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq" event={"ID":"8c7696ea-c2cb-4f41-bf56-d3934e29d59a","Type":"ContainerStarted","Data":"00063a17b90ac987f9d3b8a291fc332d04f0fce0b468e8e2e9891f706e50e7f7"}
Jul 24 18:41:54.975572 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.975515    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq" event={"ID":"8c7696ea-c2cb-4f41-bf56-d3934e29d59a","Type":"ContainerStarted","Data":"4982abf717887a49fd8092ceba24a0d0ff1a3df94e02ee30a2a4ef309883b3fb"}
Jul 24 18:41:54.975572 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.975545    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq" event={"ID":"8c7696ea-c2cb-4f41-bf56-d3934e29d59a","Type":"ContainerStarted","Data":"efeb55ce04ae1f89cd6314d384cd9e794f850b8e651908ab9724b3f1e84538c3"}
Jul 24 18:41:54.980614 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.980581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxl78" event={"ID":"9c89ec0b-98ec-44ee-acde-3e955fce0769","Type":"ContainerStarted","Data":"16fa6cc7636f632aa549fb02a48c95ec5e5c2c198b1f8e73fe8f1187bca2357b"}
Jul 24 18:41:54.992889 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.992866    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5454ffdbc4-7846l"]
Jul 24 18:41:54.999553 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:54.999531    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5454ffdbc4-7846l"]
Jul 24 18:41:55.024539 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.024481    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:41:55.172669 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.172537    2584 scope.go:117] "RemoveContainer" containerID="05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594"
Jul 24 18:41:55.172871 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:41:55.172849    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594\": container with ID starting with 05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594 not found: ID does not exist" containerID="05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594"
Jul 24 18:41:55.172933 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.172882    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594"} err="failed to get container status \"05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594\": rpc error: code = NotFound desc = could not find container \"05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594\": container with ID starting with 05025d172a414ca66816ca42d1117cb27473cc9425929a5faa0fa3d462e31594 not found: ID does not exist"
Jul 24 18:41:55.173384 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:55.173363    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff640631_4910_40dc_ab09_5793da4e3c4e.slice/crio-2e200c1b469dea4df572053a147e3760eee0390d52674e48886951f9fa142138 WatchSource:0}: Error finding container 2e200c1b469dea4df572053a147e3760eee0390d52674e48886951f9fa142138: Status 404 returned error can't find the container with id 2e200c1b469dea4df572053a147e3760eee0390d52674e48886951f9fa142138
Jul 24 18:41:55.400776 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.400741    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b8449f878-9nq85"]
Jul 24 18:41:55.403240 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.403220    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.406352 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406333    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 18:41:55.406478 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406383    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 18:41:55.406478 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406406    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d2rgqeqi7gchs\""
Jul 24 18:41:55.406478 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406383    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 18:41:55.406804 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406773    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 18:41:55.406914 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406893    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 18:41:55.406976 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.406932    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nmtlx\""
Jul 24 18:41:55.418245 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.418196    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b8449f878-9nq85"]
Jul 24 18:41:55.559991 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.559959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.559991 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.559993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwhmk\" (UniqueName: \"kubernetes.io/projected/f6e1ddb0-027b-4665-a186-bb416c47c8b6-kube-api-access-pwhmk\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.560437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.560014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.560437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.560045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6e1ddb0-027b-4665-a186-bb416c47c8b6-metrics-client-ca\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.560437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.560121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-grpc-tls\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.560437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.560189    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.560437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.560230    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-tls\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.560437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.560257    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.660724 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.660859 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwhmk\" (UniqueName: \"kubernetes.io/projected/f6e1ddb0-027b-4665-a186-bb416c47c8b6-kube-api-access-pwhmk\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.660859 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.660859 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6e1ddb0-027b-4665-a186-bb416c47c8b6-metrics-client-ca\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.660859 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-grpc-tls\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.661050 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.661050 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-tls\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.661050 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.660943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.661682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.661648    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6e1ddb0-027b-4665-a186-bb416c47c8b6-metrics-client-ca\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.663822 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.663777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.664187 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.664009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.664187 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.664124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.664187 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.664167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.664433 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.664409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-grpc-tls\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.664592 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.664563    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6e1ddb0-027b-4665-a186-bb416c47c8b6-secret-thanos-querier-tls\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.669117 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.669100    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwhmk\" (UniqueName: \"kubernetes.io/projected/f6e1ddb0-027b-4665-a186-bb416c47c8b6-kube-api-access-pwhmk\") pod \"thanos-querier-7b8449f878-9nq85\" (UID: \"f6e1ddb0-027b-4665-a186-bb416c47c8b6\") " pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.714144 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.714120    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:41:55.917103 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.917080    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b8449f878-9nq85"]
Jul 24 18:41:55.917951 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:55.917927    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e1ddb0_027b_4665_a186_bb416c47c8b6.slice/crio-9127c829edd7fcd0f0029d765d29d52f169e4b039605bc0ce336f01be763e193 WatchSource:0}: Error finding container 9127c829edd7fcd0f0029d765d29d52f169e4b039605bc0ce336f01be763e193: Status 404 returned error can't find the container with id 9127c829edd7fcd0f0029d765d29d52f169e4b039605bc0ce336f01be763e193
Jul 24 18:41:55.985288 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.985258    2584 generic.go:356] "Generic (PLEG): container finished" podID="9c89ec0b-98ec-44ee-acde-3e955fce0769" containerID="d9d98bd6b9352df1f342d19cae0a6f03f9413dcb3ae6e2a07e6b48ad6b4f2bf2" exitCode=0
Jul 24 18:41:55.985396 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.985333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxl78" event={"ID":"9c89ec0b-98ec-44ee-acde-3e955fce0769","Type":"ContainerDied","Data":"d9d98bd6b9352df1f342d19cae0a6f03f9413dcb3ae6e2a07e6b48ad6b4f2bf2"}
Jul 24 18:41:55.986485 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.986454    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"9127c829edd7fcd0f0029d765d29d52f169e4b039605bc0ce336f01be763e193"}
Jul 24 18:41:55.994239 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.994214    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq" event={"ID":"8c7696ea-c2cb-4f41-bf56-d3934e29d59a","Type":"ContainerStarted","Data":"d38035061e68791599305a1545f661cc7b05fc71cba8a57991690033bd74dca1"}
Jul 24 18:41:55.995291 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:55.995267    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"2e200c1b469dea4df572053a147e3760eee0390d52674e48886951f9fa142138"}
Jul 24 18:41:56.023277 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:56.023228    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xbscq" podStartSLOduration=1.812133404 podStartE2EDuration="3.023216056s" totalImagesPullingTime="1.211082652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:56.022308376 +0000 UTC m=+107.940159902" watchObservedRunningTime="2026-07-24 18:41:56.023216056 +0000 UTC m=+107.941067581"
Jul 24 18:41:56.572945 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:56.572922    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6fa0350-9e9b-4361-8c55-05c8f9a5a564" path="/var/lib/kubelet/pods/a6fa0350-9e9b-4361-8c55-05c8f9a5a564/volumes"
Jul 24 18:41:57.001483 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.001437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxl78" event={"ID":"9c89ec0b-98ec-44ee-acde-3e955fce0769","Type":"ContainerStarted","Data":"9a7cbe32036d7e87029000c84ef879eb50f6cc0c4d14c9e167f7a97577cf30f6"}
Jul 24 18:41:57.001651 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.001512    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rxl78" event={"ID":"9c89ec0b-98ec-44ee-acde-3e955fce0769","Type":"ContainerStarted","Data":"738f6ba876f5f457a60e0573eb89c3944547479c42e2a951d2cfef7c523db1d7"}
Jul 24 18:41:57.003214 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.003083    2584 generic.go:356] "Generic (PLEG): container finished" podID="ff640631-4910-40dc-ab09-5793da4e3c4e" containerID="fae813500f214e36a629826b3b4eaf6a75b7fb00de0b71ea28973cf75ccee98c" exitCode=0
Jul 24 18:41:57.003214 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.003151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerDied","Data":"fae813500f214e36a629826b3b4eaf6a75b7fb00de0b71ea28973cf75ccee98c"}
Jul 24 18:41:57.023341 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.023304    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rxl78" podStartSLOduration=3.128431097 podStartE2EDuration="4.023289929s" totalImagesPullingTime="831.436232ms" totalInitContainerRuntime="63.4226ms" isStatefulPod=true podCreationTimestamp="2026-07-24 18:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:41:57.021943158 +0000 UTC m=+108.939794707" watchObservedRunningTime="2026-07-24 18:41:57.023289929 +0000 UTC m=+108.941141603"
Jul 24 18:41:57.745488 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.745453    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7485849964-r7dzb"]
Jul 24 18:41:57.753164 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.753140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.757588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.757557    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 18:41:57.757588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.757575    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 18:41:57.757813 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.757627    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 18:41:57.757813 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.757637    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wwv4b\""
Jul 24 18:41:57.757813 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.757768    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 18:41:57.758891 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.757817    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-iq3fh3cbanfq\""
Jul 24 18:41:57.759977 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.759952    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7485849964-r7dzb"]
Jul 24 18:41:57.880460 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880411    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmcx\" (UniqueName: \"kubernetes.io/projected/02132501-3263-47d4-9275-7099e266c54b-kube-api-access-jrmcx\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.880460 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880439    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-secret-metrics-server-tls\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.880564 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880480    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02132501-3263-47d4-9275-7099e266c54b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.880564 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02132501-3263-47d4-9275-7099e266c54b-audit-log\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.880564 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880543    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-client-ca-bundle\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.880671 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-secret-metrics-server-client-certs\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.880671 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.880613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02132501-3263-47d4-9275-7099e266c54b-metrics-server-audit-profiles\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.981915 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.981892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02132501-3263-47d4-9275-7099e266c54b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982011 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.981927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02132501-3263-47d4-9275-7099e266c54b-audit-log\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982011 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.981950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-client-ca-bundle\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982011 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.981974    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-secret-metrics-server-client-certs\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982011 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.982009    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02132501-3263-47d4-9275-7099e266c54b-metrics-server-audit-profiles\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982205 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.982041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmcx\" (UniqueName: \"kubernetes.io/projected/02132501-3263-47d4-9275-7099e266c54b-kube-api-access-jrmcx\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982205 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.982089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-secret-metrics-server-tls\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982349 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.982325    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02132501-3263-47d4-9275-7099e266c54b-audit-log\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982888 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.982861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02132501-3263-47d4-9275-7099e266c54b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.982988 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.982955    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02132501-3263-47d4-9275-7099e266c54b-metrics-server-audit-profiles\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.984344 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.984317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-secret-metrics-server-tls\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.984443 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.984394    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-client-ca-bundle\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.984443 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.984403    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02132501-3263-47d4-9275-7099e266c54b-secret-metrics-server-client-certs\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:57.990538 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:57.990476    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmcx\" (UniqueName: \"kubernetes.io/projected/02132501-3263-47d4-9275-7099e266c54b-kube-api-access-jrmcx\") pod \"metrics-server-7485849964-r7dzb\" (UID: \"02132501-3263-47d4-9275-7099e266c54b\") " pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:58.011083 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:58.011044    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"8134765ebe9918682ac70e0422b549edefeb9e593c865140ad743b22871df80f"}
Jul 24 18:41:58.011277 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:58.011132    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"1c2eafc1b1096f7d62fbf3555ba94660e13726b49a152656e16967bdfd4b9ab7"}
Jul 24 18:41:58.064751 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:58.064715    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:41:58.238781 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:58.238745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7485849964-r7dzb"]
Jul 24 18:41:58.240917 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:41:58.240895    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02132501_3263_47d4_9275_7099e266c54b.slice/crio-cd735968493d4f3d46d36238b8110478a11b3b6420ed37ed69186cdfe5492c3d WatchSource:0}: Error finding container cd735968493d4f3d46d36238b8110478a11b3b6420ed37ed69186cdfe5492c3d: Status 404 returned error can't find the container with id cd735968493d4f3d46d36238b8110478a11b3b6420ed37ed69186cdfe5492c3d
Jul 24 18:41:59.017133 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:59.017092    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7485849964-r7dzb" event={"ID":"02132501-3263-47d4-9275-7099e266c54b","Type":"ContainerStarted","Data":"cd735968493d4f3d46d36238b8110478a11b3b6420ed37ed69186cdfe5492c3d"}
Jul 24 18:41:59.018984 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:41:59.018959    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"d271be00770fe89c86cf20d9b7812cda9e5ff81df8e19a8835bdb7148fdb645f"}
Jul 24 18:42:00.025463 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.025427    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"99c7e8f5980c38797cf4505bdadf5a2c11406eac9b978477b5ef38cd15b215ef"}
Jul 24 18:42:00.025751 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.025517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"6cd513a9a652ecc67a100fc5360cd17b57ab3f1ee03fe58223467c71941e9384"}
Jul 24 18:42:00.025751 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.025561    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" event={"ID":"f6e1ddb0-027b-4665-a186-bb416c47c8b6","Type":"ContainerStarted","Data":"54b9041fe8901d36f0416edb399c1944da5d00e52cadb7274cc81591c2dc6963"}
Jul 24 18:42:00.025970 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.025849    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:42:00.029366 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.029338    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"58f151a71f649d7353798bb52318b08209563c846040825cc46887e0b30991a9"}
Jul 24 18:42:00.029467 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.029401    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"1e1914359cd68618a0bc8262302580db8f82304b88c8f4421366cf6fd7d8d6bd"}
Jul 24 18:42:00.029467 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.029433    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"865169b910a8651be62d485a7bd2e7876b30439d7d7826299b9254c01e2560ee"}
Jul 24 18:42:00.050894 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:00.050777    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85" podStartSLOduration=1.58126854 podStartE2EDuration="5.050750769s" totalImagesPullingTime="3.469482229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:00.048584583 +0000 UTC m=+111.966436108" watchObservedRunningTime="2026-07-24 18:42:00.050750769 +0000 UTC m=+111.968602294"
Jul 24 18:42:01.036814 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:01.036734    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"c4179e2454353fa8c1fc6636e4a037d5e0a9501426cbf5f366cf7264e3a178ea"}
Jul 24 18:42:01.037264 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:01.036818    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"e48f29390963074dc24c57188f452b6f093c4b54ff56b37134cf3b8af728a12c"}
Jul 24 18:42:01.037264 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:01.036860    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff640631-4910-40dc-ab09-5793da4e3c4e","Type":"ContainerStarted","Data":"7aa97332dbe0202b2480b37e38e50a689addfc4d1054693a3d9792854a7f1363"}
Jul 24 18:42:01.038388 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:01.038316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7485849964-r7dzb" event={"ID":"02132501-3263-47d4-9275-7099e266c54b","Type":"ContainerStarted","Data":"5d6b011d6e9285382d285bdf901687e9385dad4308247474f4139a4c03ea24ec"}
Jul 24 18:42:01.064779 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:01.064687    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.12181421 podStartE2EDuration="7.06466861s" totalImagesPullingTime="3.927170413s" totalInitContainerRuntime="15.683987ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:01.062507895 +0000 UTC m=+112.980359422" watchObservedRunningTime="2026-07-24 18:42:01.06466861 +0000 UTC m=+112.982520135"
Jul 24 18:42:01.081258 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:01.081211    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7485849964-r7dzb" podStartSLOduration=1.54061012 podStartE2EDuration="4.081193108s" totalImagesPullingTime="2.540582988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:01.079488442 +0000 UTC m=+112.997339966" watchObservedRunningTime="2026-07-24 18:42:01.081193108 +0000 UTC m=+112.999044637"
Jul 24 18:42:06.043742 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:06.043716    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b8449f878-9nq85"
Jul 24 18:42:18.065293 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.065258    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:42:18.065654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.065336    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:42:18.331332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.331243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:42:18.333373 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.333355    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e88c7e1b-b36d-4832-b697-5fc853aeac4e-metrics-certs\") pod \"network-metrics-daemon-z85kl\" (UID: \"e88c7e1b-b36d-4832-b697-5fc853aeac4e\") " pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:42:18.589561 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.589541    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8czh\""
Jul 24 18:42:18.597001 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.596983    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z85kl"
Jul 24 18:42:18.737637 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:18.737503    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z85kl"]
Jul 24 18:42:18.739998 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:42:18.739965    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88c7e1b_b36d_4832_b697_5fc853aeac4e.slice/crio-a98cafaa46cddcdde978bcec63edb616dc6bd3fcb6e66acaf1329517c20a1777 WatchSource:0}: Error finding container a98cafaa46cddcdde978bcec63edb616dc6bd3fcb6e66acaf1329517c20a1777: Status 404 returned error can't find the container with id a98cafaa46cddcdde978bcec63edb616dc6bd3fcb6e66acaf1329517c20a1777
Jul 24 18:42:19.101540 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:19.101506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z85kl" event={"ID":"e88c7e1b-b36d-4832-b697-5fc853aeac4e","Type":"ContainerStarted","Data":"a98cafaa46cddcdde978bcec63edb616dc6bd3fcb6e66acaf1329517c20a1777"}
Jul 24 18:42:20.106432 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:20.106399    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z85kl" event={"ID":"e88c7e1b-b36d-4832-b697-5fc853aeac4e","Type":"ContainerStarted","Data":"976ffc46d50bbdf2dbf0600740f3f424cf6c968875c2bfca09ff5382a86bf40b"}
Jul 24 18:42:20.106786 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:20.106450    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z85kl" event={"ID":"e88c7e1b-b36d-4832-b697-5fc853aeac4e","Type":"ContainerStarted","Data":"767a2e23f4a34d0c20c7f50580a2ea1dca5e648b11d296423efa06b46af20d14"}
Jul 24 18:42:20.124484 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:20.124437    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z85kl" podStartSLOduration=131.35202503 podStartE2EDuration="2m12.124423167s" totalImagesPullingTime="772.398137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:42:20.12226037 +0000 UTC m=+132.040111894" watchObservedRunningTime="2026-07-24 18:42:20.124423167 +0000 UTC m=+132.042274691"
Jul 24 18:42:38.071613 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:38.071583    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:42:38.075288 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:42:38.075263    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7485849964-r7dzb"
Jul 24 18:44:02.667712 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.667679    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"]
Jul 24 18:44:02.670898 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.670880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.673608 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.673585    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 18:44:02.674888 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.674868    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz9n7\""
Jul 24 18:44:02.674981 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.674896    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 18:44:02.680804 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.680779    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"]
Jul 24 18:44:02.752043 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.752017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxjrw\" (UniqueName: \"kubernetes.io/projected/d87489a7-f781-4a4c-bd28-851b306543b8-kube-api-access-mxjrw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.752159 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.752049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.752159 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.752092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.853279 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.853256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxjrw\" (UniqueName: \"kubernetes.io/projected/d87489a7-f781-4a4c-bd28-851b306543b8-kube-api-access-mxjrw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.853348 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.853289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.853348 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.853308    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.853679 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.853661    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.853718 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.853682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.861272 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.861252    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxjrw\" (UniqueName: \"kubernetes.io/projected/d87489a7-f781-4a4c-bd28-851b306543b8-kube-api-access-mxjrw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:02.980618 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:02.980565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:03.103422 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:03.103391    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"]
Jul 24 18:44:03.105924 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:44:03.105897    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87489a7_f781_4a4c_bd28_851b306543b8.slice/crio-6da210c0d0bd15c73b5aa5628cb09c4ef579d020de6640032dcbe627d18e79a7 WatchSource:0}: Error finding container 6da210c0d0bd15c73b5aa5628cb09c4ef579d020de6640032dcbe627d18e79a7: Status 404 returned error can't find the container with id 6da210c0d0bd15c73b5aa5628cb09c4ef579d020de6640032dcbe627d18e79a7
Jul 24 18:44:03.476026 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:03.475992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" event={"ID":"d87489a7-f781-4a4c-bd28-851b306543b8","Type":"ContainerStarted","Data":"6da210c0d0bd15c73b5aa5628cb09c4ef579d020de6640032dcbe627d18e79a7"}
Jul 24 18:44:09.500447 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:09.500378    2584 generic.go:356] "Generic (PLEG): container finished" podID="d87489a7-f781-4a4c-bd28-851b306543b8" containerID="348900a2f1a2ce9a24d8f0acd094f22163bd1f0484ae390dfb513f6b52b77df4" exitCode=0
Jul 24 18:44:09.500745 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:09.500442    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" event={"ID":"d87489a7-f781-4a4c-bd28-851b306543b8","Type":"ContainerDied","Data":"348900a2f1a2ce9a24d8f0acd094f22163bd1f0484ae390dfb513f6b52b77df4"}
Jul 24 18:44:11.509198 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:11.509170    2584 generic.go:356] "Generic (PLEG): container finished" podID="d87489a7-f781-4a4c-bd28-851b306543b8" containerID="80b35a0fdfea030291c7fe26b17fb6ba3aa875b9952e038b49fdf3440609d598" exitCode=0
Jul 24 18:44:11.509495 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:11.509238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" event={"ID":"d87489a7-f781-4a4c-bd28-851b306543b8","Type":"ContainerDied","Data":"80b35a0fdfea030291c7fe26b17fb6ba3aa875b9952e038b49fdf3440609d598"}
Jul 24 18:44:18.539656 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:18.539620    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" event={"ID":"d87489a7-f781-4a4c-bd28-851b306543b8","Type":"ContainerStarted","Data":"750a2119426fa305bb2c3a134e9c03ffa5d638ceb29ac9490a075aa5372e4854"}
Jul 24 18:44:18.560269 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:18.560194    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" podStartSLOduration=1.831730743 podStartE2EDuration="16.560176655s" totalImagesPullingTime="14.728445912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:18.559285582 +0000 UTC m=+250.477137107" watchObservedRunningTime="2026-07-24 18:44:18.560176655 +0000 UTC m=+250.478028181"
Jul 24 18:44:19.544543 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:19.544509    2584 generic.go:356] "Generic (PLEG): container finished" podID="d87489a7-f781-4a4c-bd28-851b306543b8" containerID="750a2119426fa305bb2c3a134e9c03ffa5d638ceb29ac9490a075aa5372e4854" exitCode=0
Jul 24 18:44:19.544889 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:19.544573    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" event={"ID":"d87489a7-f781-4a4c-bd28-851b306543b8","Type":"ContainerDied","Data":"750a2119426fa305bb2c3a134e9c03ffa5d638ceb29ac9490a075aa5372e4854"}
Jul 24 18:44:20.664620 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.664599    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:20.793497 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.793472    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-bundle\") pod \"d87489a7-f781-4a4c-bd28-851b306543b8\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") "
Jul 24 18:44:20.793602 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.793526    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-util\") pod \"d87489a7-f781-4a4c-bd28-851b306543b8\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") "
Jul 24 18:44:20.793602 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.793565    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxjrw\" (UniqueName: \"kubernetes.io/projected/d87489a7-f781-4a4c-bd28-851b306543b8-kube-api-access-mxjrw\") pod \"d87489a7-f781-4a4c-bd28-851b306543b8\" (UID: \"d87489a7-f781-4a4c-bd28-851b306543b8\") "
Jul 24 18:44:20.794071 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.794027    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-bundle" (OuterVolumeSpecName: "bundle") pod "d87489a7-f781-4a4c-bd28-851b306543b8" (UID: "d87489a7-f781-4a4c-bd28-851b306543b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:44:20.795616 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.795584    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87489a7-f781-4a4c-bd28-851b306543b8-kube-api-access-mxjrw" (OuterVolumeSpecName: "kube-api-access-mxjrw") pod "d87489a7-f781-4a4c-bd28-851b306543b8" (UID: "d87489a7-f781-4a4c-bd28-851b306543b8"). InnerVolumeSpecName "kube-api-access-mxjrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:44:20.797410 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.797386    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-util" (OuterVolumeSpecName: "util") pod "d87489a7-f781-4a4c-bd28-851b306543b8" (UID: "d87489a7-f781-4a4c-bd28-851b306543b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:44:20.894323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.894303    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-util\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:44:20.894323 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.894323    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxjrw\" (UniqueName: \"kubernetes.io/projected/d87489a7-f781-4a4c-bd28-851b306543b8-kube-api-access-mxjrw\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:44:20.894437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:20.894333    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87489a7-f781-4a4c-bd28-851b306543b8-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:44:21.553045 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:21.553021    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d"
Jul 24 18:44:21.553246 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:21.553017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v455d" event={"ID":"d87489a7-f781-4a4c-bd28-851b306543b8","Type":"ContainerDied","Data":"6da210c0d0bd15c73b5aa5628cb09c4ef579d020de6640032dcbe627d18e79a7"}
Jul 24 18:44:21.553246 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:21.553141    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6da210c0d0bd15c73b5aa5628cb09c4ef579d020de6640032dcbe627d18e79a7"
Jul 24 18:44:36.714140 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714073    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"]
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714369    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="pull"
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714382    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="pull"
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714397    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="extract"
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714402    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="extract"
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714410    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="util"
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714416    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="util"
Jul 24 18:44:36.714544 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.714459    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87489a7-f781-4a4c-bd28-851b306543b8" containerName="extract"
Jul 24 18:44:36.716190 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.716176    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:36.718860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.718841    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 18:44:36.719083 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.719053    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hfhvc\""
Jul 24 18:44:36.720276 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.720261    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 18:44:36.725516 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.725496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"]
Jul 24 18:44:36.804273 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.804248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqlbw\" (UniqueName: \"kubernetes.io/projected/4f23f53e-8a00-4507-9a53-3038664b4d9a-kube-api-access-hqlbw\") pod \"cert-manager-cainjector-559cdd8c87-lgjp9\" (UID: \"4f23f53e-8a00-4507-9a53-3038664b4d9a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:36.804389 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.804283    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f23f53e-8a00-4507-9a53-3038664b4d9a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lgjp9\" (UID: \"4f23f53e-8a00-4507-9a53-3038664b4d9a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:36.905396 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.905374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqlbw\" (UniqueName: \"kubernetes.io/projected/4f23f53e-8a00-4507-9a53-3038664b4d9a-kube-api-access-hqlbw\") pod \"cert-manager-cainjector-559cdd8c87-lgjp9\" (UID: \"4f23f53e-8a00-4507-9a53-3038664b4d9a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:36.905505 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.905409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f23f53e-8a00-4507-9a53-3038664b4d9a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lgjp9\" (UID: \"4f23f53e-8a00-4507-9a53-3038664b4d9a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:36.915172 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.915151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f23f53e-8a00-4507-9a53-3038664b4d9a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lgjp9\" (UID: \"4f23f53e-8a00-4507-9a53-3038664b4d9a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:36.915271 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:36.915251    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqlbw\" (UniqueName: \"kubernetes.io/projected/4f23f53e-8a00-4507-9a53-3038664b4d9a-kube-api-access-hqlbw\") pod \"cert-manager-cainjector-559cdd8c87-lgjp9\" (UID: \"4f23f53e-8a00-4507-9a53-3038664b4d9a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:37.025370 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:37.025311    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"
Jul 24 18:44:37.144615 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:37.144595    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9"]
Jul 24 18:44:37.146815 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:44:37.146791    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f23f53e_8a00_4507_9a53_3038664b4d9a.slice/crio-89d257f571f1c236908bd1c5a12373e9399aadca95942b93db540dd7425c8be3 WatchSource:0}: Error finding container 89d257f571f1c236908bd1c5a12373e9399aadca95942b93db540dd7425c8be3: Status 404 returned error can't find the container with id 89d257f571f1c236908bd1c5a12373e9399aadca95942b93db540dd7425c8be3
Jul 24 18:44:37.606274 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:37.606247    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9" event={"ID":"4f23f53e-8a00-4507-9a53-3038664b4d9a","Type":"ContainerStarted","Data":"89d257f571f1c236908bd1c5a12373e9399aadca95942b93db540dd7425c8be3"}
Jul 24 18:44:40.622477 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:40.622439    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9" event={"ID":"4f23f53e-8a00-4507-9a53-3038664b4d9a","Type":"ContainerStarted","Data":"4bc31d208f29c602f1b7588eb2effe6a7ec0c4fa19f0ef68a2b4831328dc819d"}
Jul 24 18:44:40.638669 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:40.638612    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lgjp9" podStartSLOduration=1.99430599 podStartE2EDuration="4.638598919s" totalImagesPullingTime="2.644292929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:40.637581138 +0000 UTC m=+272.555432664" watchObservedRunningTime="2026-07-24 18:44:40.638598919 +0000 UTC m=+272.556450446"
Jul 24 18:44:59.900149 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.900118    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"]
Jul 24 18:44:59.902426 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.902407    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:44:59.905336 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.905317    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 24 18:44:59.906588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.906567    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz9n7\""
Jul 24 18:44:59.906703 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.906555    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 24 18:44:59.912529 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.912511    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"]
Jul 24 18:44:59.963643 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.963616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv7hp\" (UniqueName: \"kubernetes.io/projected/7da17377-6b30-4f17-8904-e6f2c5ce5e61-kube-api-access-kv7hp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:44:59.963734 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.963646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:44:59.963734 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:44:59.963667    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.064295 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.064255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv7hp\" (UniqueName: \"kubernetes.io/projected/7da17377-6b30-4f17-8904-e6f2c5ce5e61-kube-api-access-kv7hp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.064295 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.064298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.064502 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.064319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.064670 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.064653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.064712 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.064682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.072427 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.072402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv7hp\" (UniqueName: \"kubernetes.io/projected/7da17377-6b30-4f17-8904-e6f2c5ce5e61-kube-api-access-kv7hp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.211707 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.211639    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:00.335552 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.335520    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"]
Jul 24 18:45:00.337767 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:45:00.337729    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da17377_6b30_4f17_8904_e6f2c5ce5e61.slice/crio-52db7215ecb0a55eeae6478cc29d78885aee3d6084cb2d56305a7afadf47b531 WatchSource:0}: Error finding container 52db7215ecb0a55eeae6478cc29d78885aee3d6084cb2d56305a7afadf47b531: Status 404 returned error can't find the container with id 52db7215ecb0a55eeae6478cc29d78885aee3d6084cb2d56305a7afadf47b531
Jul 24 18:45:00.690723 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.690682    2584 generic.go:356] "Generic (PLEG): container finished" podID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerID="05f984f855e2a117d91ac6d545ac061fb1674bf6e2a16dac3e35ca708d8ac2d1" exitCode=0
Jul 24 18:45:00.690865 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.690760    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8" event={"ID":"7da17377-6b30-4f17-8904-e6f2c5ce5e61","Type":"ContainerDied","Data":"05f984f855e2a117d91ac6d545ac061fb1674bf6e2a16dac3e35ca708d8ac2d1"}
Jul 24 18:45:00.690865 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:00.690807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8" event={"ID":"7da17377-6b30-4f17-8904-e6f2c5ce5e61","Type":"ContainerStarted","Data":"52db7215ecb0a55eeae6478cc29d78885aee3d6084cb2d56305a7afadf47b531"}
Jul 24 18:45:01.696315 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:01.696250    2584 generic.go:356] "Generic (PLEG): container finished" podID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerID="2f780606ce48d6948b64709a4aaaa77d35099c620737cdc7bc11176ba92cc997" exitCode=0
Jul 24 18:45:01.696602 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:01.696312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8" event={"ID":"7da17377-6b30-4f17-8904-e6f2c5ce5e61","Type":"ContainerDied","Data":"2f780606ce48d6948b64709a4aaaa77d35099c620737cdc7bc11176ba92cc997"}
Jul 24 18:45:02.701161 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:02.701127    2584 generic.go:356] "Generic (PLEG): container finished" podID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerID="c298be4b089d9a893d78eceda46981c8d343384dd68231169c8dd5fb8cb42c7e" exitCode=0
Jul 24 18:45:02.701506 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:02.701166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8" event={"ID":"7da17377-6b30-4f17-8904-e6f2c5ce5e61","Type":"ContainerDied","Data":"c298be4b089d9a893d78eceda46981c8d343384dd68231169c8dd5fb8cb42c7e"}
Jul 24 18:45:03.821825 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.821800    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:03.891731 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.891706    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-bundle\") pod \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") "
Jul 24 18:45:03.891856 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.891759    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv7hp\" (UniqueName: \"kubernetes.io/projected/7da17377-6b30-4f17-8904-e6f2c5ce5e61-kube-api-access-kv7hp\") pod \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") "
Jul 24 18:45:03.891856 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.891793    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-util\") pod \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\" (UID: \"7da17377-6b30-4f17-8904-e6f2c5ce5e61\") "
Jul 24 18:45:03.892579 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.892555    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-bundle" (OuterVolumeSpecName: "bundle") pod "7da17377-6b30-4f17-8904-e6f2c5ce5e61" (UID: "7da17377-6b30-4f17-8904-e6f2c5ce5e61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:45:03.893645 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.893619    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da17377-6b30-4f17-8904-e6f2c5ce5e61-kube-api-access-kv7hp" (OuterVolumeSpecName: "kube-api-access-kv7hp") pod "7da17377-6b30-4f17-8904-e6f2c5ce5e61" (UID: "7da17377-6b30-4f17-8904-e6f2c5ce5e61"). InnerVolumeSpecName "kube-api-access-kv7hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:45:03.897961 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.897942    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-util" (OuterVolumeSpecName: "util") pod "7da17377-6b30-4f17-8904-e6f2c5ce5e61" (UID: "7da17377-6b30-4f17-8904-e6f2c5ce5e61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:45:03.992807 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.992757    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:45:03.992807 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.992776    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv7hp\" (UniqueName: \"kubernetes.io/projected/7da17377-6b30-4f17-8904-e6f2c5ce5e61-kube-api-access-kv7hp\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:45:03.992807 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:03.992787    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7da17377-6b30-4f17-8904-e6f2c5ce5e61-util\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:45:04.710485 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:04.710461    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8"
Jul 24 18:45:04.710627 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:04.710501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk88n8" event={"ID":"7da17377-6b30-4f17-8904-e6f2c5ce5e61","Type":"ContainerDied","Data":"52db7215ecb0a55eeae6478cc29d78885aee3d6084cb2d56305a7afadf47b531"}
Jul 24 18:45:04.710627 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:04.710546    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52db7215ecb0a55eeae6478cc29d78885aee3d6084cb2d56305a7afadf47b531"
Jul 24 18:45:08.460504 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:08.460477    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 18:45:14.763185 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763153    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"]
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763408    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="pull"
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763417    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="pull"
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763428    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="util"
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763434    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="util"
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763448    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="extract"
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763453    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="extract"
Jul 24 18:45:14.764491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.763502    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da17377-6b30-4f17-8904-e6f2c5ce5e61" containerName="extract"
Jul 24 18:45:14.765190 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.765174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.769467 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.769448    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 18:45:14.769569 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.769470    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 18:45:14.769726 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.769712    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb8gh\""
Jul 24 18:45:14.769912 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.769900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 18:45:14.770003 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.769983    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 18:45:14.784148 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.784123    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"]
Jul 24 18:45:14.870489 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.870466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg92f\" (UniqueName: \"kubernetes.io/projected/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-kube-api-access-rg92f\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.870580 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.870495    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.870580 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.870513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-tmp\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.870580 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.870529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.870682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.870598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-manifests\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.971142 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.971112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg92f\" (UniqueName: \"kubernetes.io/projected/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-kube-api-access-rg92f\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.971142 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.971143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.971295 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.971162    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-tmp\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.971383 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.971359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.971532 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.971512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-manifests\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.971857 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.971837    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-manifests\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.973385 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.973361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-tmp\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.973594 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.973572    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.973670 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.973653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:14.986934 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:14.986913    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg92f\" (UniqueName: \"kubernetes.io/projected/1e27bb05-f9da-4dd6-b875-b8c6034ad4ec-kube-api-access-rg92f\") pod \"opendatahub-operator-controller-manager-859dddff6f-gx4zz\" (UID: \"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec\") " pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:15.074529 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:15.074470    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:15.201952 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:15.201922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"]
Jul 24 18:45:15.206025 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:45:15.206000    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e27bb05_f9da_4dd6_b875_b8c6034ad4ec.slice/crio-ed701109e105757aff25247711590d69956bcf480b2996b75f8fb641375882fd WatchSource:0}: Error finding container ed701109e105757aff25247711590d69956bcf480b2996b75f8fb641375882fd: Status 404 returned error can't find the container with id ed701109e105757aff25247711590d69956bcf480b2996b75f8fb641375882fd
Jul 24 18:45:15.207796 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:15.207778    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:45:15.751788 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:15.751757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz" event={"ID":"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec","Type":"ContainerStarted","Data":"ed701109e105757aff25247711590d69956bcf480b2996b75f8fb641375882fd"}
Jul 24 18:45:18.766698 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:18.766621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz" event={"ID":"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec","Type":"ContainerStarted","Data":"38e4822a435c2470cf0298b97434b055a6c0b482cf7ef33920aba9197667090a"}
Jul 24 18:45:19.771825 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:19.771793    2584 generic.go:356] "Generic (PLEG): container finished" podID="1e27bb05-f9da-4dd6-b875-b8c6034ad4ec" containerID="38e4822a435c2470cf0298b97434b055a6c0b482cf7ef33920aba9197667090a" exitCode=0
Jul 24 18:45:19.772153 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:19.771885    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz" event={"ID":"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec","Type":"ContainerDied","Data":"38e4822a435c2470cf0298b97434b055a6c0b482cf7ef33920aba9197667090a"}
Jul 24 18:45:20.777588 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:20.777551    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz" event={"ID":"1e27bb05-f9da-4dd6-b875-b8c6034ad4ec","Type":"ContainerStarted","Data":"e7ecae31d0cb4e36e01ccd8a14627c84912335908cd02b4aa5f4c72c6174c92d"}
Jul 24 18:45:20.777937 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:20.777684    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:20.804264 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:20.804046    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz" podStartSLOduration=2.183441193 podStartE2EDuration="6.804031144s" totalImagesPullingTime="3.590625044s" totalInitContainerRuntime="1.029964907s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:20.802224004 +0000 UTC m=+312.720075530" watchObservedRunningTime="2026-07-24 18:45:20.804031144 +0000 UTC m=+312.721882669"
Jul 24 18:45:31.783661 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:31.783630    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-859dddff6f-gx4zz"
Jul 24 18:45:32.983392 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.983362    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"]
Jul 24 18:45:32.986452 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.986433    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:32.989326 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.989306    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 18:45:32.989425 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.989331    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 18:45:32.990440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.990424    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 18:45:32.990529 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.990456    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:45:32.990529 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.990468    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zs4t2\""
Jul 24 18:45:32.990637 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.990549    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 18:45:32.996162 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:32.996141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"]
Jul 24 18:45:33.106510 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.106489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9eda87f9-bd62-4195-98a2-80fb4191b82a-manager-config\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.106624 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.106519    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpp2n\" (UniqueName: \"kubernetes.io/projected/9eda87f9-bd62-4195-98a2-80fb4191b82a-kube-api-access-tpp2n\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.106624 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.106552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eda87f9-bd62-4195-98a2-80fb4191b82a-metrics-cert\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.106697 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.106635    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eda87f9-bd62-4195-98a2-80fb4191b82a-cert\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.207768 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.207742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpp2n\" (UniqueName: \"kubernetes.io/projected/9eda87f9-bd62-4195-98a2-80fb4191b82a-kube-api-access-tpp2n\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.207864 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.207791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eda87f9-bd62-4195-98a2-80fb4191b82a-metrics-cert\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.207864 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.207816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eda87f9-bd62-4195-98a2-80fb4191b82a-cert\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.207864 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.207857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9eda87f9-bd62-4195-98a2-80fb4191b82a-manager-config\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.208484 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.208462    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9eda87f9-bd62-4195-98a2-80fb4191b82a-manager-config\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.210277 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.210254    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9eda87f9-bd62-4195-98a2-80fb4191b82a-metrics-cert\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.210277 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.210274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eda87f9-bd62-4195-98a2-80fb4191b82a-cert\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.216243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.216218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpp2n\" (UniqueName: \"kubernetes.io/projected/9eda87f9-bd62-4195-98a2-80fb4191b82a-kube-api-access-tpp2n\") pod \"lws-controller-manager-8456f466bb-rqxgh\" (UID: \"9eda87f9-bd62-4195-98a2-80fb4191b82a\") " pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.295216 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.295167    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:33.415948 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.415922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"]
Jul 24 18:45:33.417914 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:45:33.417886    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eda87f9_bd62_4195_98a2_80fb4191b82a.slice/crio-c1b3166cce90877ddeaeabbe8a1c233cfa953987afa1986635224b04d37a643d WatchSource:0}: Error finding container c1b3166cce90877ddeaeabbe8a1c233cfa953987afa1986635224b04d37a643d: Status 404 returned error can't find the container with id c1b3166cce90877ddeaeabbe8a1c233cfa953987afa1986635224b04d37a643d
Jul 24 18:45:33.829699 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:33.829676    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh" event={"ID":"9eda87f9-bd62-4195-98a2-80fb4191b82a","Type":"ContainerStarted","Data":"c1b3166cce90877ddeaeabbe8a1c233cfa953987afa1986635224b04d37a643d"}
Jul 24 18:45:36.845826 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:36.845793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh" event={"ID":"9eda87f9-bd62-4195-98a2-80fb4191b82a","Type":"ContainerStarted","Data":"aed4c331d280afc7a651c4deec69a67b11e8ac437210452a9bb8c3ba33372f70"}
Jul 24 18:45:36.846235 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:36.845909    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:36.865997 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:36.865955    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh" podStartSLOduration=2.368141797 podStartE2EDuration="4.865937874s" totalImagesPullingTime="2.497796077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:36.865114476 +0000 UTC m=+328.782966003" watchObservedRunningTime="2026-07-24 18:45:36.865937874 +0000 UTC m=+328.783789400"
Jul 24 18:45:47.852001 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:47.851971    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8456f466bb-rqxgh"
Jul 24 18:45:54.782566 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.782525    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"]
Jul 24 18:45:54.789382 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.789360    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.792138 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.792113    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cl46b\""
Jul 24 18:45:54.792252 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.792136    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 18:45:54.796200 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.796179    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"]
Jul 24 18:45:54.884850 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.884816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.884991 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.884857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.884991 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.884918    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.884991 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.884982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.885132 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.885003    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.885132 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.885100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.885205 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.885131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snpnx\" (UniqueName: \"kubernetes.io/projected/a61208a4-06ac-4e82-ae1d-989a200ae196-kube-api-access-snpnx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.885205 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.885179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.885205 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.885199    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61208a4-06ac-4e82-ae1d-989a200ae196-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986030 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snpnx\" (UniqueName: \"kubernetes.io/projected/a61208a4-06ac-4e82-ae1d-989a200ae196-kube-api-access-snpnx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986115    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61208a4-06ac-4e82-ae1d-989a200ae196-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986207 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986188    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986507 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986507 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986420    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986507 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986458    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986644 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986644 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986795 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986769    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.986973 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.986953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a61208a4-06ac-4e82-ae1d-989a200ae196-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.988480 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.988460    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.988573 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.988518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.995348 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.995328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a61208a4-06ac-4e82-ae1d-989a200ae196-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:54.995457 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:54.995436    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snpnx\" (UniqueName: \"kubernetes.io/projected/a61208a4-06ac-4e82-ae1d-989a200ae196-kube-api-access-snpnx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p\" (UID: \"a61208a4-06ac-4e82-ae1d-989a200ae196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:55.101324 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:55.101294    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:55.225597 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:55.225565    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"]
Jul 24 18:45:55.228363 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:45:55.228335    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61208a4_06ac_4e82_ae1d_989a200ae196.slice/crio-27b4d7fe682bc704c8096467644b0ecdd15e2f2ca5b5dfd96d2ee87ddce72468 WatchSource:0}: Error finding container 27b4d7fe682bc704c8096467644b0ecdd15e2f2ca5b5dfd96d2ee87ddce72468: Status 404 returned error can't find the container with id 27b4d7fe682bc704c8096467644b0ecdd15e2f2ca5b5dfd96d2ee87ddce72468
Jul 24 18:45:55.935024 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:55.934985    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p" event={"ID":"a61208a4-06ac-4e82-ae1d-989a200ae196","Type":"ContainerStarted","Data":"27b4d7fe682bc704c8096467644b0ecdd15e2f2ca5b5dfd96d2ee87ddce72468"}
Jul 24 18:45:58.094531 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:58.094497    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:45:58.094788 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:58.094568    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:45:58.094788 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:58.094599    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:45:58.950933 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:58.950901    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p" event={"ID":"a61208a4-06ac-4e82-ae1d-989a200ae196","Type":"ContainerStarted","Data":"ddfc60095d9b1e9645fda6bfb18ab1a01fa58a27f7575365b28c10a7b2ebda01"}
Jul 24 18:45:58.976113 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:58.976050    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p" podStartSLOduration=2.1121996259999998 podStartE2EDuration="4.976033072s" totalImagesPullingTime="2.863833446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:58.974894393 +0000 UTC m=+350.892745929" watchObservedRunningTime="2026-07-24 18:45:58.976033072 +0000 UTC m=+350.893884600"
Jul 24 18:45:59.102215 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:59.102184    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:59.106353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:59.106331    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:59.958077 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:59.957877    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:45:59.960201 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:45:59.960175    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p"
Jul 24 18:46:36.281376 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.281341    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hrrzd"]
Jul 24 18:46:36.289230 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.289203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:36.292159 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.292133    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 18:46:36.292298 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.292202    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r29l4\""
Jul 24 18:46:36.293417 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.293394    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 18:46:36.295681 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.295658    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hrrzd"]
Jul 24 18:46:36.385175 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.385148    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjsbg\" (UniqueName: \"kubernetes.io/projected/6b72a654-627b-467f-9728-ad88da08e0a2-kube-api-access-jjsbg\") pod \"kuadrant-operator-catalog-hrrzd\" (UID: \"6b72a654-627b-467f-9728-ad88da08e0a2\") " pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:36.485534 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.485501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjsbg\" (UniqueName: \"kubernetes.io/projected/6b72a654-627b-467f-9728-ad88da08e0a2-kube-api-access-jjsbg\") pod \"kuadrant-operator-catalog-hrrzd\" (UID: \"6b72a654-627b-467f-9728-ad88da08e0a2\") " pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:36.493873 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.493843    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjsbg\" (UniqueName: \"kubernetes.io/projected/6b72a654-627b-467f-9728-ad88da08e0a2-kube-api-access-jjsbg\") pod \"kuadrant-operator-catalog-hrrzd\" (UID: \"6b72a654-627b-467f-9728-ad88da08e0a2\") " pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:36.599908 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.599882    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:36.645116 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.645090    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hrrzd"]
Jul 24 18:46:36.729139 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.729079    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hrrzd"]
Jul 24 18:46:36.731828 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:46:36.731786    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b72a654_627b_467f_9728_ad88da08e0a2.slice/crio-aad8d8841a759304e0a9d217f4ba52ce5d50dfa525e2d3b937ac5aac2c0fe397 WatchSource:0}: Error finding container aad8d8841a759304e0a9d217f4ba52ce5d50dfa525e2d3b937ac5aac2c0fe397: Status 404 returned error can't find the container with id aad8d8841a759304e0a9d217f4ba52ce5d50dfa525e2d3b937ac5aac2c0fe397
Jul 24 18:46:36.855261 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.855201    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5dqxf"]
Jul 24 18:46:36.859966 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.859947    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:36.865976 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.865952    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5dqxf"]
Jul 24 18:46:36.988292 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:36.988264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmn4j\" (UniqueName: \"kubernetes.io/projected/a2d68396-b85c-4e25-aab5-a840bb9de325-kube-api-access-lmn4j\") pod \"kuadrant-operator-catalog-5dqxf\" (UID: \"a2d68396-b85c-4e25-aab5-a840bb9de325\") " pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:37.089322 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:37.089293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmn4j\" (UniqueName: \"kubernetes.io/projected/a2d68396-b85c-4e25-aab5-a840bb9de325-kube-api-access-lmn4j\") pod \"kuadrant-operator-catalog-5dqxf\" (UID: \"a2d68396-b85c-4e25-aab5-a840bb9de325\") " pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:37.097280 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:37.097258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmn4j\" (UniqueName: \"kubernetes.io/projected/a2d68396-b85c-4e25-aab5-a840bb9de325-kube-api-access-lmn4j\") pod \"kuadrant-operator-catalog-5dqxf\" (UID: \"a2d68396-b85c-4e25-aab5-a840bb9de325\") " pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:37.105431 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:37.105368    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd" event={"ID":"6b72a654-627b-467f-9728-ad88da08e0a2","Type":"ContainerStarted","Data":"aad8d8841a759304e0a9d217f4ba52ce5d50dfa525e2d3b937ac5aac2c0fe397"}
Jul 24 18:46:37.169451 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:37.169431    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:37.299810 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:37.299751    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5dqxf"]
Jul 24 18:46:37.324400 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:46:37.324358    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d68396_b85c_4e25_aab5_a840bb9de325.slice/crio-7c582b46fd57d6b936559ab1010cd637462d9e333c554e13e4d274afbaaa439c WatchSource:0}: Error finding container 7c582b46fd57d6b936559ab1010cd637462d9e333c554e13e4d274afbaaa439c: Status 404 returned error can't find the container with id 7c582b46fd57d6b936559ab1010cd637462d9e333c554e13e4d274afbaaa439c
Jul 24 18:46:38.111420 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:38.111382    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf" event={"ID":"a2d68396-b85c-4e25-aab5-a840bb9de325","Type":"ContainerStarted","Data":"7c582b46fd57d6b936559ab1010cd637462d9e333c554e13e4d274afbaaa439c"}
Jul 24 18:46:39.116902 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.116863    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd" event={"ID":"6b72a654-627b-467f-9728-ad88da08e0a2","Type":"ContainerStarted","Data":"d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6"}
Jul 24 18:46:39.117350 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.116912    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd" podUID="6b72a654-627b-467f-9728-ad88da08e0a2" containerName="registry-server" containerID="cri-o://d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6" gracePeriod=2
Jul 24 18:46:39.118611 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.118589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf" event={"ID":"a2d68396-b85c-4e25-aab5-a840bb9de325","Type":"ContainerStarted","Data":"7c5c16d3f259be485555e09b65b9a0e4a1ce1b1d51681b23692b83ace0c86ce4"}
Jul 24 18:46:39.134736 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.134681    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd" podStartSLOduration=0.94914052 podStartE2EDuration="3.134663755s" totalImagesPullingTime="2.185523235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:46:39.133734272 +0000 UTC m=+391.051585807" watchObservedRunningTime="2026-07-24 18:46:39.134663755 +0000 UTC m=+391.052515280"
Jul 24 18:46:39.150446 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.150408    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf" podStartSLOduration=1.5543808700000001 podStartE2EDuration="3.150396732s" totalImagesPullingTime="1.596015862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:46:39.149735985 +0000 UTC m=+391.067587512" watchObservedRunningTime="2026-07-24 18:46:39.150396732 +0000 UTC m=+391.068248257"
Jul 24 18:46:39.353438 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.353413    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:39.408682 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.408658    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjsbg\" (UniqueName: \"kubernetes.io/projected/6b72a654-627b-467f-9728-ad88da08e0a2-kube-api-access-jjsbg\") pod \"6b72a654-627b-467f-9728-ad88da08e0a2\" (UID: \"6b72a654-627b-467f-9728-ad88da08e0a2\") "
Jul 24 18:46:39.410615 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.410587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b72a654-627b-467f-9728-ad88da08e0a2-kube-api-access-jjsbg" (OuterVolumeSpecName: "kube-api-access-jjsbg") pod "6b72a654-627b-467f-9728-ad88da08e0a2" (UID: "6b72a654-627b-467f-9728-ad88da08e0a2"). InnerVolumeSpecName "kube-api-access-jjsbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:39.509585 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:39.509525    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjsbg\" (UniqueName: \"kubernetes.io/projected/6b72a654-627b-467f-9728-ad88da08e0a2-kube-api-access-jjsbg\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:40.124242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.124204    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b72a654-627b-467f-9728-ad88da08e0a2" containerID="d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6" exitCode=0
Jul 24 18:46:40.124242 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.124246    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd"
Jul 24 18:46:40.124664 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.124284    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd" event={"ID":"6b72a654-627b-467f-9728-ad88da08e0a2","Type":"ContainerDied","Data":"d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6"}
Jul 24 18:46:40.124664 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.124334    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hrrzd" event={"ID":"6b72a654-627b-467f-9728-ad88da08e0a2","Type":"ContainerDied","Data":"aad8d8841a759304e0a9d217f4ba52ce5d50dfa525e2d3b937ac5aac2c0fe397"}
Jul 24 18:46:40.124664 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.124356    2584 scope.go:117] "RemoveContainer" containerID="d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6"
Jul 24 18:46:40.133297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.133280    2584 scope.go:117] "RemoveContainer" containerID="d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6"
Jul 24 18:46:40.133524 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:46:40.133506    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6\": container with ID starting with d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6 not found: ID does not exist" containerID="d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6"
Jul 24 18:46:40.133589 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.133539    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6"} err="failed to get container status \"d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6\": rpc error: code = NotFound desc = could not find container \"d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6\": container with ID starting with d4b0c3fc1d661879309fa34fa8adc7b00eea978d6fb9f702f9df607fc12f45f6 not found: ID does not exist"
Jul 24 18:46:40.144652 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.144629    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hrrzd"]
Jul 24 18:46:40.148825 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.148806    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hrrzd"]
Jul 24 18:46:40.573007 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:40.572976    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b72a654-627b-467f-9728-ad88da08e0a2" path="/var/lib/kubelet/pods/6b72a654-627b-467f-9728-ad88da08e0a2/volumes"
Jul 24 18:46:47.170118 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:47.170086    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:47.170501 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:47.170132    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:47.190901 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:47.190877    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:48.186670 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:48.186645    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5dqxf"
Jul 24 18:46:51.689729 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.689691    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"]
Jul 24 18:46:51.690104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.689967    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b72a654-627b-467f-9728-ad88da08e0a2" containerName="registry-server"
Jul 24 18:46:51.690104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.689978    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b72a654-627b-467f-9728-ad88da08e0a2" containerName="registry-server"
Jul 24 18:46:51.690104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.690044    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b72a654-627b-467f-9728-ad88da08e0a2" containerName="registry-server"
Jul 24 18:46:51.694444 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.694424    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.697155 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.697126    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-49g7j\""
Jul 24 18:46:51.701844 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.701822    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"]
Jul 24 18:46:51.795526 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.795500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.795655 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.795558    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.795655 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.795576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhxf\" (UniqueName: \"kubernetes.io/projected/26ade546-7cb7-4224-bd70-80e3707585ba-kube-api-access-hjhxf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.896114 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.896093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.896215 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.896145    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.896215 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.896165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhxf\" (UniqueName: \"kubernetes.io/projected/26ade546-7cb7-4224-bd70-80e3707585ba-kube-api-access-hjhxf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.896437 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.896421    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.896476 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.896450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:51.904562 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:51.904534    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhxf\" (UniqueName: \"kubernetes.io/projected/26ade546-7cb7-4224-bd70-80e3707585ba-kube-api-access-hjhxf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:52.003748 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.003700    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:52.127847 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.127823    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"]
Jul 24 18:46:52.130454 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:46:52.130429    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ade546_7cb7_4224_bd70_80e3707585ba.slice/crio-e3d651ed8f23831fd7844884a826fe8025da02d262d0910e070670aac35c1e39 WatchSource:0}: Error finding container e3d651ed8f23831fd7844884a826fe8025da02d262d0910e070670aac35c1e39: Status 404 returned error can't find the container with id e3d651ed8f23831fd7844884a826fe8025da02d262d0910e070670aac35c1e39
Jul 24 18:46:52.183887 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.183860    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq" event={"ID":"26ade546-7cb7-4224-bd70-80e3707585ba","Type":"ContainerStarted","Data":"e3d651ed8f23831fd7844884a826fe8025da02d262d0910e070670aac35c1e39"}
Jul 24 18:46:52.289881 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.289830    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"]
Jul 24 18:46:52.292961 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.292945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.301736 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.301717    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"]
Jul 24 18:46:52.399357 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.399338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.399469 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.399366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfpg\" (UniqueName: \"kubernetes.io/projected/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-kube-api-access-wcfpg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.399469 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.399442    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.500243 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.500218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.500333 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.500264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.500333 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.500287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfpg\" (UniqueName: \"kubernetes.io/projected/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-kube-api-access-wcfpg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.500617 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.500596    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.500681 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.500634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.508253 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.508236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfpg\" (UniqueName: \"kubernetes.io/projected/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-kube-api-access-wcfpg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.602083 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.602050    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:52.696143 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.696104    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"]
Jul 24 18:46:52.701234 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.701215    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.709041 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.709012    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"]
Jul 24 18:46:52.727670 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.727650    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"]
Jul 24 18:46:52.729919 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:46:52.729900    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998c35c6_fe56_4a5e_8374_4ee798fbe4ad.slice/crio-5d6893bed88e89d714c38dfae3fc4177af2aab236dc4b40b1471f68da5d6773c WatchSource:0}: Error finding container 5d6893bed88e89d714c38dfae3fc4177af2aab236dc4b40b1471f68da5d6773c: Status 404 returned error can't find the container with id 5d6893bed88e89d714c38dfae3fc4177af2aab236dc4b40b1471f68da5d6773c
Jul 24 18:46:52.802546 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.802521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.802634 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.802552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwjft\" (UniqueName: \"kubernetes.io/projected/b807edd2-dc63-4b76-aa7d-606fd30a9d22-kube-api-access-kwjft\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.802678 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.802644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.903133 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.903076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.903230 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.903148    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.903230 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.903176    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwjft\" (UniqueName: \"kubernetes.io/projected/b807edd2-dc63-4b76-aa7d-606fd30a9d22-kube-api-access-kwjft\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.903461 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.903436    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.903505 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.903442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:52.911280 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:52.911261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwjft\" (UniqueName: \"kubernetes.io/projected/b807edd2-dc63-4b76-aa7d-606fd30a9d22-kube-api-access-kwjft\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:53.017569 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.017550    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:53.092219 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.092185    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"]
Jul 24 18:46:53.097532 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.097508    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.106374 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.106347    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"]
Jul 24 18:46:53.141433 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.141412    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"]
Jul 24 18:46:53.142968 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:46:53.142939    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb807edd2_dc63_4b76_aa7d_606fd30a9d22.slice/crio-63343012f3533ec621dcb418a5fca407f0f7681ae3ef5e7f69e053323f5353fc WatchSource:0}: Error finding container 63343012f3533ec621dcb418a5fca407f0f7681ae3ef5e7f69e053323f5353fc: Status 404 returned error can't find the container with id 63343012f3533ec621dcb418a5fca407f0f7681ae3ef5e7f69e053323f5353fc
Jul 24 18:46:53.190172 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.190143    2584 generic.go:356] "Generic (PLEG): container finished" podID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerID="bc94be8748cd31f27b989805c04115c20db9abcc8284b9dd718bc5a18a1e5067" exitCode=0
Jul 24 18:46:53.190284 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.190210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs" event={"ID":"998c35c6-fe56-4a5e-8374-4ee798fbe4ad","Type":"ContainerDied","Data":"bc94be8748cd31f27b989805c04115c20db9abcc8284b9dd718bc5a18a1e5067"}
Jul 24 18:46:53.190284 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.190263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs" event={"ID":"998c35c6-fe56-4a5e-8374-4ee798fbe4ad","Type":"ContainerStarted","Data":"5d6893bed88e89d714c38dfae3fc4177af2aab236dc4b40b1471f68da5d6773c"}
Jul 24 18:46:53.191561 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.191536    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp" event={"ID":"b807edd2-dc63-4b76-aa7d-606fd30a9d22","Type":"ContainerStarted","Data":"63343012f3533ec621dcb418a5fca407f0f7681ae3ef5e7f69e053323f5353fc"}
Jul 24 18:46:53.193072 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.193036    2584 generic.go:356] "Generic (PLEG): container finished" podID="26ade546-7cb7-4224-bd70-80e3707585ba" containerID="be7d518ba268ae701a5f11c1e887ea509888204db98e4109e6201ee7d8b1fb31" exitCode=0
Jul 24 18:46:53.193168 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.193098    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq" event={"ID":"26ade546-7cb7-4224-bd70-80e3707585ba","Type":"ContainerDied","Data":"be7d518ba268ae701a5f11c1e887ea509888204db98e4109e6201ee7d8b1fb31"}
Jul 24 18:46:53.204844 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.204823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.204927 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.204866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8ll\" (UniqueName: \"kubernetes.io/projected/af50f11a-3c06-4502-8ced-00fc32fdee23-kube-api-access-fr8ll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.204927 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.204887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.305513 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.305486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.305626 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.305533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8ll\" (UniqueName: \"kubernetes.io/projected/af50f11a-3c06-4502-8ced-00fc32fdee23-kube-api-access-fr8ll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.305626 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.305556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.305869 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.305848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.305930 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.305908    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.314737 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.314706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8ll\" (UniqueName: \"kubernetes.io/projected/af50f11a-3c06-4502-8ced-00fc32fdee23-kube-api-access-fr8ll\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.408109 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.408038    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:53.541575 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:53.541549    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"]
Jul 24 18:46:53.544749 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:46:53.544716    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf50f11a_3c06_4502_8ced_00fc32fdee23.slice/crio-19bd90b1aff1f1ec6ff0fbb1a60af4eef3135ca0d87c2377c1254c8cc5733fa1 WatchSource:0}: Error finding container 19bd90b1aff1f1ec6ff0fbb1a60af4eef3135ca0d87c2377c1254c8cc5733fa1: Status 404 returned error can't find the container with id 19bd90b1aff1f1ec6ff0fbb1a60af4eef3135ca0d87c2377c1254c8cc5733fa1
Jul 24 18:46:54.198462 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.198436    2584 generic.go:356] "Generic (PLEG): container finished" podID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerID="9caeeb1438a877f7a3ba4711dd314d325c21b8591c8a33e7f256952f31067e81" exitCode=0
Jul 24 18:46:54.198791 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.198518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd" event={"ID":"af50f11a-3c06-4502-8ced-00fc32fdee23","Type":"ContainerDied","Data":"9caeeb1438a877f7a3ba4711dd314d325c21b8591c8a33e7f256952f31067e81"}
Jul 24 18:46:54.198791 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.198579    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd" event={"ID":"af50f11a-3c06-4502-8ced-00fc32fdee23","Type":"ContainerStarted","Data":"19bd90b1aff1f1ec6ff0fbb1a60af4eef3135ca0d87c2377c1254c8cc5733fa1"}
Jul 24 18:46:54.200681 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.200659    2584 generic.go:356] "Generic (PLEG): container finished" podID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerID="67056ec91eb5270202b238addd5dd834e5b4a8e416d93829d388cf9a66ca8061" exitCode=0
Jul 24 18:46:54.200785 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.200727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs" event={"ID":"998c35c6-fe56-4a5e-8374-4ee798fbe4ad","Type":"ContainerDied","Data":"67056ec91eb5270202b238addd5dd834e5b4a8e416d93829d388cf9a66ca8061"}
Jul 24 18:46:54.202353 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.202327    2584 generic.go:356] "Generic (PLEG): container finished" podID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerID="ed44924e9994c3cd476aeab0d8bc44df57cadbe4311d646729950a7d7959ec27" exitCode=0
Jul 24 18:46:54.202461 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:54.202362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp" event={"ID":"b807edd2-dc63-4b76-aa7d-606fd30a9d22","Type":"ContainerDied","Data":"ed44924e9994c3cd476aeab0d8bc44df57cadbe4311d646729950a7d7959ec27"}
Jul 24 18:46:55.210258 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:55.210236    2584 generic.go:356] "Generic (PLEG): container finished" podID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerID="319b9067158e6a7cc3df5ae3e6338b622a848c0615a256d88760106172202ed8" exitCode=0
Jul 24 18:46:55.210523 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:55.210317    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs" event={"ID":"998c35c6-fe56-4a5e-8374-4ee798fbe4ad","Type":"ContainerDied","Data":"319b9067158e6a7cc3df5ae3e6338b622a848c0615a256d88760106172202ed8"}
Jul 24 18:46:55.212001 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:55.211982    2584 generic.go:356] "Generic (PLEG): container finished" podID="26ade546-7cb7-4224-bd70-80e3707585ba" containerID="d88d18c5fbe8509117158ed7cd49791e85bda97b830180111fafe82ad9dc5ea2" exitCode=0
Jul 24 18:46:55.212132 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:55.212108    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq" event={"ID":"26ade546-7cb7-4224-bd70-80e3707585ba","Type":"ContainerDied","Data":"d88d18c5fbe8509117158ed7cd49791e85bda97b830180111fafe82ad9dc5ea2"}
Jul 24 18:46:55.216960 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:55.216934    2584 generic.go:356] "Generic (PLEG): container finished" podID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerID="4dd07840b5ba0c1f0f4b03887f7360524ad0da11384e6c55589a527623a99568" exitCode=0
Jul 24 18:46:55.217053 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:55.217000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd" event={"ID":"af50f11a-3c06-4502-8ced-00fc32fdee23","Type":"ContainerDied","Data":"4dd07840b5ba0c1f0f4b03887f7360524ad0da11384e6c55589a527623a99568"}
Jul 24 18:46:56.223643 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.223569    2584 generic.go:356] "Generic (PLEG): container finished" podID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerID="430ad32b6537914b76ddaeadb3e04e8522dddce7215ae2c15256c89227da4559" exitCode=0
Jul 24 18:46:56.224011 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.223658    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp" event={"ID":"b807edd2-dc63-4b76-aa7d-606fd30a9d22","Type":"ContainerDied","Data":"430ad32b6537914b76ddaeadb3e04e8522dddce7215ae2c15256c89227da4559"}
Jul 24 18:46:56.225843 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.225824    2584 generic.go:356] "Generic (PLEG): container finished" podID="26ade546-7cb7-4224-bd70-80e3707585ba" containerID="1cacedf216af2dd6c0aa5d97bf3548983026acb20593b11cbcadbb07a0ccd760" exitCode=0
Jul 24 18:46:56.225952 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.225893    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq" event={"ID":"26ade546-7cb7-4224-bd70-80e3707585ba","Type":"ContainerDied","Data":"1cacedf216af2dd6c0aa5d97bf3548983026acb20593b11cbcadbb07a0ccd760"}
Jul 24 18:46:56.228032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.228014    2584 generic.go:356] "Generic (PLEG): container finished" podID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerID="54602b9922369626ecdf4c710ad946486078a75bf8ab73c11a43ae1cc8d2aa15" exitCode=0
Jul 24 18:46:56.228141 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.228090    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd" event={"ID":"af50f11a-3c06-4502-8ced-00fc32fdee23","Type":"ContainerDied","Data":"54602b9922369626ecdf4c710ad946486078a75bf8ab73c11a43ae1cc8d2aa15"}
Jul 24 18:46:56.411102 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.411082    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:56.533297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.533241    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcfpg\" (UniqueName: \"kubernetes.io/projected/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-kube-api-access-wcfpg\") pod \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") "
Jul 24 18:46:56.533297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.533275    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-bundle\") pod \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") "
Jul 24 18:46:56.533297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.533293    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-util\") pod \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\" (UID: \"998c35c6-fe56-4a5e-8374-4ee798fbe4ad\") "
Jul 24 18:46:56.533730 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.533710    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-bundle" (OuterVolumeSpecName: "bundle") pod "998c35c6-fe56-4a5e-8374-4ee798fbe4ad" (UID: "998c35c6-fe56-4a5e-8374-4ee798fbe4ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:56.535206 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.535182    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-kube-api-access-wcfpg" (OuterVolumeSpecName: "kube-api-access-wcfpg") pod "998c35c6-fe56-4a5e-8374-4ee798fbe4ad" (UID: "998c35c6-fe56-4a5e-8374-4ee798fbe4ad"). InnerVolumeSpecName "kube-api-access-wcfpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:56.538349 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.538327    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-util" (OuterVolumeSpecName: "util") pod "998c35c6-fe56-4a5e-8374-4ee798fbe4ad" (UID: "998c35c6-fe56-4a5e-8374-4ee798fbe4ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:56.634306 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.634282    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcfpg\" (UniqueName: \"kubernetes.io/projected/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-kube-api-access-wcfpg\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:56.634376 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.634309    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:56.634376 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:56.634325    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/998c35c6-fe56-4a5e-8374-4ee798fbe4ad-util\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:57.234795 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.234725    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs" event={"ID":"998c35c6-fe56-4a5e-8374-4ee798fbe4ad","Type":"ContainerDied","Data":"5d6893bed88e89d714c38dfae3fc4177af2aab236dc4b40b1471f68da5d6773c"}
Jul 24 18:46:57.234795 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.234775    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d6893bed88e89d714c38dfae3fc4177af2aab236dc4b40b1471f68da5d6773c"
Jul 24 18:46:57.234795 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.234735    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs"
Jul 24 18:46:57.236827 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.236789    2584 generic.go:356] "Generic (PLEG): container finished" podID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerID="7c32b0864615a2fb7e6918fa966432ae0ec59a47492fced46d148254e18b4d71" exitCode=0
Jul 24 18:46:57.236942 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.236861    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp" event={"ID":"b807edd2-dc63-4b76-aa7d-606fd30a9d22","Type":"ContainerDied","Data":"7c32b0864615a2fb7e6918fa966432ae0ec59a47492fced46d148254e18b4d71"}
Jul 24 18:46:57.366182 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.366159    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:57.385150 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.385124    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:57.440677 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.440652    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-util\") pod \"26ade546-7cb7-4224-bd70-80e3707585ba\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") "
Jul 24 18:46:57.440800 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.440687    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhxf\" (UniqueName: \"kubernetes.io/projected/26ade546-7cb7-4224-bd70-80e3707585ba-kube-api-access-hjhxf\") pod \"26ade546-7cb7-4224-bd70-80e3707585ba\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") "
Jul 24 18:46:57.440800 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.440716    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-util\") pod \"af50f11a-3c06-4502-8ced-00fc32fdee23\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") "
Jul 24 18:46:57.440800 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.440732    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr8ll\" (UniqueName: \"kubernetes.io/projected/af50f11a-3c06-4502-8ced-00fc32fdee23-kube-api-access-fr8ll\") pod \"af50f11a-3c06-4502-8ced-00fc32fdee23\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") "
Jul 24 18:46:57.440800 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.440760    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-bundle\") pod \"af50f11a-3c06-4502-8ced-00fc32fdee23\" (UID: \"af50f11a-3c06-4502-8ced-00fc32fdee23\") "
Jul 24 18:46:57.440997 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.440800    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-bundle\") pod \"26ade546-7cb7-4224-bd70-80e3707585ba\" (UID: \"26ade546-7cb7-4224-bd70-80e3707585ba\") "
Jul 24 18:46:57.441530 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.441496    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-bundle" (OuterVolumeSpecName: "bundle") pod "af50f11a-3c06-4502-8ced-00fc32fdee23" (UID: "af50f11a-3c06-4502-8ced-00fc32fdee23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:57.441635 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.441535    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-bundle" (OuterVolumeSpecName: "bundle") pod "26ade546-7cb7-4224-bd70-80e3707585ba" (UID: "26ade546-7cb7-4224-bd70-80e3707585ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:57.442784 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.442760    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af50f11a-3c06-4502-8ced-00fc32fdee23-kube-api-access-fr8ll" (OuterVolumeSpecName: "kube-api-access-fr8ll") pod "af50f11a-3c06-4502-8ced-00fc32fdee23" (UID: "af50f11a-3c06-4502-8ced-00fc32fdee23"). InnerVolumeSpecName "kube-api-access-fr8ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:57.442863 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.442818    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ade546-7cb7-4224-bd70-80e3707585ba-kube-api-access-hjhxf" (OuterVolumeSpecName: "kube-api-access-hjhxf") pod "26ade546-7cb7-4224-bd70-80e3707585ba" (UID: "26ade546-7cb7-4224-bd70-80e3707585ba"). InnerVolumeSpecName "kube-api-access-hjhxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:57.449710 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.449686    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-util" (OuterVolumeSpecName: "util") pod "26ade546-7cb7-4224-bd70-80e3707585ba" (UID: "26ade546-7cb7-4224-bd70-80e3707585ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:57.449800 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.449686    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-util" (OuterVolumeSpecName: "util") pod "af50f11a-3c06-4502-8ced-00fc32fdee23" (UID: "af50f11a-3c06-4502-8ced-00fc32fdee23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:57.542354 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.542305    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:57.542354 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.542326    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:57.542354 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.542334    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26ade546-7cb7-4224-bd70-80e3707585ba-util\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:57.542354 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.542342    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhxf\" (UniqueName: \"kubernetes.io/projected/26ade546-7cb7-4224-bd70-80e3707585ba-kube-api-access-hjhxf\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:57.542354 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.542350    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af50f11a-3c06-4502-8ced-00fc32fdee23-util\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:57.542542 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:57.542358    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr8ll\" (UniqueName: \"kubernetes.io/projected/af50f11a-3c06-4502-8ced-00fc32fdee23-kube-api-access-fr8ll\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:58.242637 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.242565    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq"
Jul 24 18:46:58.243022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.242567    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq" event={"ID":"26ade546-7cb7-4224-bd70-80e3707585ba","Type":"ContainerDied","Data":"e3d651ed8f23831fd7844884a826fe8025da02d262d0910e070670aac35c1e39"}
Jul 24 18:46:58.243022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.242710    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3d651ed8f23831fd7844884a826fe8025da02d262d0910e070670aac35c1e39"
Jul 24 18:46:58.244389 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.244362    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd"
Jul 24 18:46:58.244486 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.244402    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd" event={"ID":"af50f11a-3c06-4502-8ced-00fc32fdee23","Type":"ContainerDied","Data":"19bd90b1aff1f1ec6ff0fbb1a60af4eef3135ca0d87c2377c1254c8cc5733fa1"}
Jul 24 18:46:58.244486 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.244439    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19bd90b1aff1f1ec6ff0fbb1a60af4eef3135ca0d87c2377c1254c8cc5733fa1"
Jul 24 18:46:58.372028 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.372005    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:58.450459 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.450430    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwjft\" (UniqueName: \"kubernetes.io/projected/b807edd2-dc63-4b76-aa7d-606fd30a9d22-kube-api-access-kwjft\") pod \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") "
Jul 24 18:46:58.450560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.450509    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-util\") pod \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") "
Jul 24 18:46:58.450560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.450544    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-bundle\") pod \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\" (UID: \"b807edd2-dc63-4b76-aa7d-606fd30a9d22\") "
Jul 24 18:46:58.450992 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.450966    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-bundle" (OuterVolumeSpecName: "bundle") pod "b807edd2-dc63-4b76-aa7d-606fd30a9d22" (UID: "b807edd2-dc63-4b76-aa7d-606fd30a9d22"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:58.452391 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.452369    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b807edd2-dc63-4b76-aa7d-606fd30a9d22-kube-api-access-kwjft" (OuterVolumeSpecName: "kube-api-access-kwjft") pod "b807edd2-dc63-4b76-aa7d-606fd30a9d22" (UID: "b807edd2-dc63-4b76-aa7d-606fd30a9d22"). InnerVolumeSpecName "kube-api-access-kwjft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:58.455676 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.455645    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-util" (OuterVolumeSpecName: "util") pod "b807edd2-dc63-4b76-aa7d-606fd30a9d22" (UID: "b807edd2-dc63-4b76-aa7d-606fd30a9d22"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:58.551860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.551810    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-util\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:58.551860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.551833    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b807edd2-dc63-4b76-aa7d-606fd30a9d22-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:58.551860 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:58.551843    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwjft\" (UniqueName: \"kubernetes.io/projected/b807edd2-dc63-4b76-aa7d-606fd30a9d22-kube-api-access-kwjft\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:46:59.250373 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:59.250333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp" event={"ID":"b807edd2-dc63-4b76-aa7d-606fd30a9d22","Type":"ContainerDied","Data":"63343012f3533ec621dcb418a5fca407f0f7681ae3ef5e7f69e053323f5353fc"}
Jul 24 18:46:59.250373 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:59.250373    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp"
Jul 24 18:46:59.250783 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:46:59.250391    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63343012f3533ec621dcb418a5fca407f0f7681ae3ef5e7f69e053323f5353fc"
Jul 24 18:47:07.666749 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.666702    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"]
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667179    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="extract"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667197    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="extract"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667222    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="extract"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667230    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="extract"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667241    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="pull"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667250    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="pull"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667264    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="util"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667273    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="util"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667283    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="pull"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667293    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="pull"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667304    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="util"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667313    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="util"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667325    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="util"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667333    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="util"
Jul 24 18:47:07.667347 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667349    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667358    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667367    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667375    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667389    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="util"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667397    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="util"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667410    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="pull"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667419    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="pull"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667427    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="pull"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667435    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="pull"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667509    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="998c35c6-fe56-4a5e-8374-4ee798fbe4ad" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667522    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ade546-7cb7-4224-bd70-80e3707585ba" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667535    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b807edd2-dc63-4b76-aa7d-606fd30a9d22" containerName="extract"
Jul 24 18:47:07.668047 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.667543    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="af50f11a-3c06-4502-8ced-00fc32fdee23" containerName="extract"
Jul 24 18:47:07.670543 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.670524    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:07.673409 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.673369    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 18:47:07.673537 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.673509    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xt725\""
Jul 24 18:47:07.687737 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.687714    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"]
Jul 24 18:47:07.816441 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.816404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb7dt\" (UniqueName: \"kubernetes.io/projected/a2ed359a-e962-40b5-8578-c030ed5bc0ee-kube-api-access-xb7dt\") pod \"dns-operator-controller-manager-864dd78c4c-mqhmn\" (UID: \"a2ed359a-e962-40b5-8578-c030ed5bc0ee\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:07.917649 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.917575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb7dt\" (UniqueName: \"kubernetes.io/projected/a2ed359a-e962-40b5-8578-c030ed5bc0ee-kube-api-access-xb7dt\") pod \"dns-operator-controller-manager-864dd78c4c-mqhmn\" (UID: \"a2ed359a-e962-40b5-8578-c030ed5bc0ee\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:07.927216 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.927186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb7dt\" (UniqueName: \"kubernetes.io/projected/a2ed359a-e962-40b5-8578-c030ed5bc0ee-kube-api-access-xb7dt\") pod \"dns-operator-controller-manager-864dd78c4c-mqhmn\" (UID: \"a2ed359a-e962-40b5-8578-c030ed5bc0ee\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:07.980222 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:07.980198    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:08.110068 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:08.110033    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"]
Jul 24 18:47:08.111684 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:47:08.111661    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ed359a_e962_40b5_8578_c030ed5bc0ee.slice/crio-436fa1b6bea4113dea1efcbd1aedc6b0eb18caac88da2ffd17e13d13823f86dd WatchSource:0}: Error finding container 436fa1b6bea4113dea1efcbd1aedc6b0eb18caac88da2ffd17e13d13823f86dd: Status 404 returned error can't find the container with id 436fa1b6bea4113dea1efcbd1aedc6b0eb18caac88da2ffd17e13d13823f86dd
Jul 24 18:47:08.288254 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:08.288198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn" event={"ID":"a2ed359a-e962-40b5-8578-c030ed5bc0ee","Type":"ContainerStarted","Data":"436fa1b6bea4113dea1efcbd1aedc6b0eb18caac88da2ffd17e13d13823f86dd"}
Jul 24 18:47:10.257487 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:10.257459    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 18:47:11.303327 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:11.303290    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn" event={"ID":"a2ed359a-e962-40b5-8578-c030ed5bc0ee","Type":"ContainerStarted","Data":"c0be519a38ed4a9e0502308a1e134db63f2a3ec4ddff1eaafeb0e9928259cf95"}
Jul 24 18:47:11.303687 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:11.303355    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:11.326318 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:11.326272    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn" podStartSLOduration=2.189404629 podStartE2EDuration="4.326258s" totalImagesPullingTime="2.136853371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:11.324750899 +0000 UTC m=+423.242602424" watchObservedRunningTime="2026-07-24 18:47:11.326258 +0000 UTC m=+423.244109525"
Jul 24 18:47:12.283176 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.283147    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"]
Jul 24 18:47:12.286360 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.286343    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:12.289328 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.289300    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lsb6z\""
Jul 24 18:47:12.297770 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.297746    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"]
Jul 24 18:47:12.457450 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.457410    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbrg\" (UniqueName: \"kubernetes.io/projected/c2a2d85e-8f43-4044-804a-9666dbcd7554-kube-api-access-gmbrg\") pod \"authorino-operator-75cc8d5cb7-44x6t\" (UID: \"c2a2d85e-8f43-4044-804a-9666dbcd7554\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:12.558092 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.558012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbrg\" (UniqueName: \"kubernetes.io/projected/c2a2d85e-8f43-4044-804a-9666dbcd7554-kube-api-access-gmbrg\") pod \"authorino-operator-75cc8d5cb7-44x6t\" (UID: \"c2a2d85e-8f43-4044-804a-9666dbcd7554\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:12.566436 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.566416    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbrg\" (UniqueName: \"kubernetes.io/projected/c2a2d85e-8f43-4044-804a-9666dbcd7554-kube-api-access-gmbrg\") pod \"authorino-operator-75cc8d5cb7-44x6t\" (UID: \"c2a2d85e-8f43-4044-804a-9666dbcd7554\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:12.595604 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.595582    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:12.724464 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:12.724420    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"]
Jul 24 18:47:12.726582 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:47:12.726559    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a2d85e_8f43_4044_804a_9666dbcd7554.slice/crio-8bf3c04d6a0dea30cdc37c8b387f36e3387329709b49262cc2cf30edb38d52f3 WatchSource:0}: Error finding container 8bf3c04d6a0dea30cdc37c8b387f36e3387329709b49262cc2cf30edb38d52f3: Status 404 returned error can't find the container with id 8bf3c04d6a0dea30cdc37c8b387f36e3387329709b49262cc2cf30edb38d52f3
Jul 24 18:47:13.319151 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:13.319045    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t" event={"ID":"c2a2d85e-8f43-4044-804a-9666dbcd7554","Type":"ContainerStarted","Data":"8bf3c04d6a0dea30cdc37c8b387f36e3387329709b49262cc2cf30edb38d52f3"}
Jul 24 18:47:15.330296 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:15.330217    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t" event={"ID":"c2a2d85e-8f43-4044-804a-9666dbcd7554","Type":"ContainerStarted","Data":"a33f4b09ee60acc6b9e58c6aa22112736c1c3cc69c92c0b7f9b1f5c17649b6d2"}
Jul 24 18:47:15.330756 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:15.330305    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:15.371160 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:15.371104    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t" podStartSLOduration=1.111944125 podStartE2EDuration="3.371044608s" totalImagesPullingTime="2.259100483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:15.370077806 +0000 UTC m=+427.287929323" watchObservedRunningTime="2026-07-24 18:47:15.371044608 +0000 UTC m=+427.288896133"
Jul 24 18:47:20.152601 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.152565    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"]
Jul 24 18:47:20.155964 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.155948    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.158817 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.158798    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wm5k8\""
Jul 24 18:47:20.169212 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.169192    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"]
Jul 24 18:47:20.319653 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.319630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmp7m\" (UniqueName: \"kubernetes.io/projected/0da4dac0-78a4-4b7f-b674-6396f1a68def-kube-api-access-fmp7m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.319777 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.319666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0da4dac0-78a4-4b7f-b674-6396f1a68def-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.420749 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.420685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmp7m\" (UniqueName: \"kubernetes.io/projected/0da4dac0-78a4-4b7f-b674-6396f1a68def-kube-api-access-fmp7m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.420749 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.420733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0da4dac0-78a4-4b7f-b674-6396f1a68def-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.421116 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.421098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0da4dac0-78a4-4b7f-b674-6396f1a68def-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.428843 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.428819    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmp7m\" (UniqueName: \"kubernetes.io/projected/0da4dac0-78a4-4b7f-b674-6396f1a68def-kube-api-access-fmp7m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.465794 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.465771    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:20.594260 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:20.594233    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"]
Jul 24 18:47:20.596516 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:47:20.596493    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da4dac0_78a4_4b7f_b674_6396f1a68def.slice/crio-c172920b215d4f6c201de9d305919784182e314c9fcb1923cccb7bbd6eb22909 WatchSource:0}: Error finding container c172920b215d4f6c201de9d305919784182e314c9fcb1923cccb7bbd6eb22909: Status 404 returned error can't find the container with id c172920b215d4f6c201de9d305919784182e314c9fcb1923cccb7bbd6eb22909
Jul 24 18:47:21.359952 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:21.359913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z" event={"ID":"0da4dac0-78a4-4b7f-b674-6396f1a68def","Type":"ContainerStarted","Data":"c172920b215d4f6c201de9d305919784182e314c9fcb1923cccb7bbd6eb22909"}
Jul 24 18:47:22.315973 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:22.315941    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mqhmn"
Jul 24 18:47:26.337534 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:26.337470    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-44x6t"
Jul 24 18:47:26.389374 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:26.389348    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z" event={"ID":"0da4dac0-78a4-4b7f-b674-6396f1a68def","Type":"ContainerStarted","Data":"9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10"}
Jul 24 18:47:26.389516 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:26.389501    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:26.410387 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:26.410332    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z" podStartSLOduration=0.687303026 podStartE2EDuration="6.410313498s" totalImagesPullingTime="5.723010472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:26.409388931 +0000 UTC m=+438.327240457" watchObservedRunningTime="2026-07-24 18:47:26.410313498 +0000 UTC m=+438.328165025"
Jul 24 18:47:37.396306 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:37.396230    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.090371 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.090337    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"]
Jul 24 18:47:39.090857 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.090517    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" containerName="manager" containerID="cri-o://9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10" gracePeriod=2
Jul 24 18:47:39.103123 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.103097    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"]
Jul 24 18:47:39.106453 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:39.106417    2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0da4dac0-78a4-4b7f-b674-6396f1a68def\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.121295 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.121274    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"]
Jul 24 18:47:39.121602 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.121590    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" containerName="manager"
Jul 24 18:47:39.121646 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.121604    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" containerName="manager"
Jul 24 18:47:39.121702 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.121692    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" containerName="manager"
Jul 24 18:47:39.124623 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.124607    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.127431 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:39.127401    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.136996 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.136974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"]
Jul 24 18:47:39.158029 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.158000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdf3b461-615c-450c-87ca-08ee4baf6999-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmpp6\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.158164 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.158147    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcbtd\" (UniqueName: \"kubernetes.io/projected/fdf3b461-615c-450c-87ca-08ee4baf6999-kube-api-access-xcbtd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmpp6\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.258698 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.258668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdf3b461-615c-450c-87ca-08ee4baf6999-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmpp6\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.258841 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.258775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcbtd\" (UniqueName: \"kubernetes.io/projected/fdf3b461-615c-450c-87ca-08ee4baf6999-kube-api-access-xcbtd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmpp6\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.259246 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.259115    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdf3b461-615c-450c-87ca-08ee4baf6999-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmpp6\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.268472 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.268448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcbtd\" (UniqueName: \"kubernetes.io/projected/fdf3b461-615c-450c-87ca-08ee4baf6999-kube-api-access-xcbtd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jmpp6\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.325460 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.325441    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.327927 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:39.327902    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.359945 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.359903    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmp7m\" (UniqueName: \"kubernetes.io/projected/0da4dac0-78a4-4b7f-b674-6396f1a68def-kube-api-access-fmp7m\") pod \"0da4dac0-78a4-4b7f-b674-6396f1a68def\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") "
Jul 24 18:47:39.359945 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.359938    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0da4dac0-78a4-4b7f-b674-6396f1a68def-extensions-socket-volume\") pod \"0da4dac0-78a4-4b7f-b674-6396f1a68def\" (UID: \"0da4dac0-78a4-4b7f-b674-6396f1a68def\") "
Jul 24 18:47:39.360420 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.360399    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da4dac0-78a4-4b7f-b674-6396f1a68def-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0da4dac0-78a4-4b7f-b674-6396f1a68def" (UID: "0da4dac0-78a4-4b7f-b674-6396f1a68def"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:47:39.361726 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.361700    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da4dac0-78a4-4b7f-b674-6396f1a68def-kube-api-access-fmp7m" (OuterVolumeSpecName: "kube-api-access-fmp7m") pod "0da4dac0-78a4-4b7f-b674-6396f1a68def" (UID: "0da4dac0-78a4-4b7f-b674-6396f1a68def"). InnerVolumeSpecName "kube-api-access-fmp7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:47:39.455166 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.455137    2584 generic.go:356] "Generic (PLEG): container finished" podID="0da4dac0-78a4-4b7f-b674-6396f1a68def" containerID="9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10" exitCode=0
Jul 24 18:47:39.455273 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.455182    2584 scope.go:117] "RemoveContainer" containerID="9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10"
Jul 24 18:47:39.455332 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.455187    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.457653 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:39.457632    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.461274 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.461250    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmp7m\" (UniqueName: \"kubernetes.io/projected/0da4dac0-78a4-4b7f-b674-6396f1a68def-kube-api-access-fmp7m\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:47:39.461274 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.461271    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0da4dac0-78a4-4b7f-b674-6396f1a68def-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:47:39.463691 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.463669    2584 scope.go:117] "RemoveContainer" containerID="9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10"
Jul 24 18:47:39.463948 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:39.463930    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10\": container with ID starting with 9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10 not found: ID does not exist" containerID="9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10"
Jul 24 18:47:39.464010 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.463955    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10"} err="failed to get container status \"9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10\": rpc error: code = NotFound desc = could not find container \"9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10\": container with ID starting with 9fdd61f4f2fa0a700c334d7f941144ecea3c035b623082bd2b8d0a1734e5ab10 not found: ID does not exist"
Jul 24 18:47:39.465457 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:39.465438    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:39.469607 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.469588    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:39.613774 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:39.613749    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"]
Jul 24 18:47:39.615960 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:47:39.615935    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf3b461_615c_450c_87ca_08ee4baf6999.slice/crio-0e6568500326bda31f69f0324155394718a905bbda790d3a826d0e6cb50d86d2 WatchSource:0}: Error finding container 0e6568500326bda31f69f0324155394718a905bbda790d3a826d0e6cb50d86d2: Status 404 returned error can't find the container with id 0e6568500326bda31f69f0324155394718a905bbda790d3a826d0e6cb50d86d2
Jul 24 18:47:40.462373 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:40.462340    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6" event={"ID":"fdf3b461-615c-450c-87ca-08ee4baf6999","Type":"ContainerStarted","Data":"a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28"}
Jul 24 18:47:40.462741 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:40.462389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6" event={"ID":"fdf3b461-615c-450c-87ca-08ee4baf6999","Type":"ContainerStarted","Data":"0e6568500326bda31f69f0324155394718a905bbda790d3a826d0e6cb50d86d2"}
Jul 24 18:47:40.462741 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:40.462449    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:47:40.464859 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:47:40.464830    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8jk4z\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8jk4z"
Jul 24 18:47:40.486897 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:40.486845    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6" podStartSLOduration=1.486829009 podStartE2EDuration="1.486829009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:47:40.486484743 +0000 UTC m=+452.404336267" watchObservedRunningTime="2026-07-24 18:47:40.486829009 +0000 UTC m=+452.404680535"
Jul 24 18:47:40.573100 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:40.573075    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0da4dac0-78a4-4b7f-b674-6396f1a68def" path="/var/lib/kubelet/pods/0da4dac0-78a4-4b7f-b674-6396f1a68def/volumes"
Jul 24 18:47:51.469762 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:47:51.469730    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:48:10.263322 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.263287    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"]
Jul 24 18:48:10.263870 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.263486    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6" podUID="fdf3b461-615c-450c-87ca-08ee4baf6999" containerName="manager" containerID="cri-o://a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28" gracePeriod=10
Jul 24 18:48:10.502909 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.502889    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:48:10.510445 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.510424    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"]
Jul 24 18:48:10.510736 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.510725    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf3b461-615c-450c-87ca-08ee4baf6999" containerName="manager"
Jul 24 18:48:10.510785 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.510738    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf3b461-615c-450c-87ca-08ee4baf6999" containerName="manager"
Jul 24 18:48:10.510817 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.510805    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf3b461-615c-450c-87ca-08ee4baf6999" containerName="manager"
Jul 24 18:48:10.513642 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.513608    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.534832 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.534812    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"]
Jul 24 18:48:10.577626 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.577606    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdf3b461-615c-450c-87ca-08ee4baf6999-extensions-socket-volume\") pod \"fdf3b461-615c-450c-87ca-08ee4baf6999\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") "
Jul 24 18:48:10.577722 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.577697    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcbtd\" (UniqueName: \"kubernetes.io/projected/fdf3b461-615c-450c-87ca-08ee4baf6999-kube-api-access-xcbtd\") pod \"fdf3b461-615c-450c-87ca-08ee4baf6999\" (UID: \"fdf3b461-615c-450c-87ca-08ee4baf6999\") "
Jul 24 18:48:10.577765 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.577756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mdzxs\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.577818 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.577803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxhr\" (UniqueName: \"kubernetes.io/projected/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-kube-api-access-8gxhr\") pod \"kuadrant-operator-controller-manager-86878c769f-mdzxs\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.577999 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.577974    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf3b461-615c-450c-87ca-08ee4baf6999-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fdf3b461-615c-450c-87ca-08ee4baf6999" (UID: "fdf3b461-615c-450c-87ca-08ee4baf6999"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:48:10.579548 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.579530    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf3b461-615c-450c-87ca-08ee4baf6999-kube-api-access-xcbtd" (OuterVolumeSpecName: "kube-api-access-xcbtd") pod "fdf3b461-615c-450c-87ca-08ee4baf6999" (UID: "fdf3b461-615c-450c-87ca-08ee4baf6999"). InnerVolumeSpecName "kube-api-access-xcbtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:48:10.610572 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.610551    2584 generic.go:356] "Generic (PLEG): container finished" podID="fdf3b461-615c-450c-87ca-08ee4baf6999" containerID="a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28" exitCode=0
Jul 24 18:48:10.610654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.610585    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"
Jul 24 18:48:10.610654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.610625    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6" event={"ID":"fdf3b461-615c-450c-87ca-08ee4baf6999","Type":"ContainerDied","Data":"a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28"}
Jul 24 18:48:10.610736 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.610672    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6" event={"ID":"fdf3b461-615c-450c-87ca-08ee4baf6999","Type":"ContainerDied","Data":"0e6568500326bda31f69f0324155394718a905bbda790d3a826d0e6cb50d86d2"}
Jul 24 18:48:10.610736 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.610700    2584 scope.go:117] "RemoveContainer" containerID="a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28"
Jul 24 18:48:10.622187 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.621986    2584 scope.go:117] "RemoveContainer" containerID="a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28"
Jul 24 18:48:10.622466 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:48:10.622445    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28\": container with ID starting with a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28 not found: ID does not exist" containerID="a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28"
Jul 24 18:48:10.622525 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.622475    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28"} err="failed to get container status \"a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28\": rpc error: code = NotFound desc = could not find container \"a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28\": container with ID starting with a2a713ca0a99af38b4a68fb65ee327beae13a5e2f8cf5a7f5661dc0d7a21ac28 not found: ID does not exist"
Jul 24 18:48:10.645143 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.645119    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"]
Jul 24 18:48:10.651640 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.651622    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jmpp6"]
Jul 24 18:48:10.678821 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.678796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mdzxs\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.678903 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.678862    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxhr\" (UniqueName: \"kubernetes.io/projected/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-kube-api-access-8gxhr\") pod \"kuadrant-operator-controller-manager-86878c769f-mdzxs\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.678903 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.678899    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcbtd\" (UniqueName: \"kubernetes.io/projected/fdf3b461-615c-450c-87ca-08ee4baf6999-kube-api-access-xcbtd\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:48:10.679028 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.678910    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdf3b461-615c-450c-87ca-08ee4baf6999-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:48:10.679214 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.679195    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mdzxs\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.687794 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.687775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxhr\" (UniqueName: \"kubernetes.io/projected/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-kube-api-access-8gxhr\") pod \"kuadrant-operator-controller-manager-86878c769f-mdzxs\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.822194 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.822146    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:10.948540 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:10.948515    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"]
Jul 24 18:48:10.949919 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:48:10.949887    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcd344c_fad3_43ba_84b8_7e4b5ba45dfc.slice/crio-0ed14d7bde6b56d0f62da9bfb4a1c16770f59a2d20ca1c20db8885fde400b7b8 WatchSource:0}: Error finding container 0ed14d7bde6b56d0f62da9bfb4a1c16770f59a2d20ca1c20db8885fde400b7b8: Status 404 returned error can't find the container with id 0ed14d7bde6b56d0f62da9bfb4a1c16770f59a2d20ca1c20db8885fde400b7b8
Jul 24 18:48:11.616743 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:11.616697    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs" event={"ID":"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc","Type":"ContainerStarted","Data":"ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7"}
Jul 24 18:48:11.617182 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:11.616834    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:11.617182 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:11.616868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs" event={"ID":"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc","Type":"ContainerStarted","Data":"0ed14d7bde6b56d0f62da9bfb4a1c16770f59a2d20ca1c20db8885fde400b7b8"}
Jul 24 18:48:11.658594 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:11.658550    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs" podStartSLOduration=1.658538911 podStartE2EDuration="1.658538911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:11.656527302 +0000 UTC m=+483.574378828" watchObservedRunningTime="2026-07-24 18:48:11.658538911 +0000 UTC m=+483.576390436"
Jul 24 18:48:12.574221 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:12.574190    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf3b461-615c-450c-87ca-08ee4baf6999" path="/var/lib/kubelet/pods/fdf3b461-615c-450c-87ca-08ee4baf6999/volumes"
Jul 24 18:48:22.624398 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:22.624364    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:48:26.711978 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.711941    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"]
Jul 24 18:48:26.715684 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.715667    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.729232 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.729211    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lxbqs\""
Jul 24 18:48:26.739571 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.739547    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"]
Jul 24 18:48:26.792030 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792003    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jl6f\" (UniqueName: \"kubernetes.io/projected/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-kube-api-access-9jl6f\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792165 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792046    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792165 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792256 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792256 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792256 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792371 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792371 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792281    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.792371 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.792315    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.892973 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.892947    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jl6f\" (UniqueName: \"kubernetes.io/projected/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-kube-api-access-9jl6f\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893113 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.892978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893113 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.892994    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893113 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893013    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893287 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893287 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893287 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893435 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893435 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893435 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893371    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893577 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893577 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893531    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.893577 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.893552    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.894106 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.894081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.895338 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.895315    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.895681 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.895664    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.902329 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.902296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jl6f\" (UniqueName: \"kubernetes.io/projected/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-kube-api-access-9jl6f\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:26.903035 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:26.903014    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fcmm9\" (UID: \"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:27.026304 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.026241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:27.163732 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.163705    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"]
Jul 24 18:48:27.166109 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:48:27.166081    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32fdf0f_6d4a_4b15_926d_15f3b5ec07a2.slice/crio-0dec6c6958b8d1a076853341bd88bfb3e1b794c4ffe7bf374342ca454ab8792a WatchSource:0}: Error finding container 0dec6c6958b8d1a076853341bd88bfb3e1b794c4ffe7bf374342ca454ab8792a: Status 404 returned error can't find the container with id 0dec6c6958b8d1a076853341bd88bfb3e1b794c4ffe7bf374342ca454ab8792a
Jul 24 18:48:27.168045 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.168012    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:48:27.168182 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.168112    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:48:27.168182 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.168162    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:48:27.694647 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.694608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" event={"ID":"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2","Type":"ContainerStarted","Data":"859724bf33a40da6f3e8d6f0713759ed080e43330d41ba83e9e4d687b0e9b149"}
Jul 24 18:48:27.694853 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.694667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" event={"ID":"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2","Type":"ContainerStarted","Data":"0dec6c6958b8d1a076853341bd88bfb3e1b794c4ffe7bf374342ca454ab8792a"}
Jul 24 18:48:27.729422 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:27.729376    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" podStartSLOduration=1.729359257 podStartE2EDuration="1.729359257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:27.728904791 +0000 UTC m=+499.646756315" watchObservedRunningTime="2026-07-24 18:48:27.729359257 +0000 UTC m=+499.647210783"
Jul 24 18:48:28.027297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:28.027220    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:28.031512 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:28.031489    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:28.699223 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:28.699194    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:28.700275 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:28.700252    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:48:29.874370 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:29.874337    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hvlkw"]
Jul 24 18:48:29.877902 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:29.877886    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:29.880879 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:29.880851    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-df8hd\""
Jul 24 18:48:29.896012 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:29.895990    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hvlkw"]
Jul 24 18:48:30.022007 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.021973    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85wg9\" (UniqueName: \"kubernetes.io/projected/c43e8f07-0be6-40f9-9525-e84081a054c5-kube-api-access-85wg9\") pod \"authorino-58cd955675-hvlkw\" (UID: \"c43e8f07-0be6-40f9-9525-e84081a054c5\") " pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:30.077720 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.077696    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fkxkr"]
Jul 24 18:48:30.080920 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.080905    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:48:30.089340 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.089313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fkxkr"]
Jul 24 18:48:30.123246 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.123219    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85wg9\" (UniqueName: \"kubernetes.io/projected/c43e8f07-0be6-40f9-9525-e84081a054c5-kube-api-access-85wg9\") pod \"authorino-58cd955675-hvlkw\" (UID: \"c43e8f07-0be6-40f9-9525-e84081a054c5\") " pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:30.132178 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.132121    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85wg9\" (UniqueName: \"kubernetes.io/projected/c43e8f07-0be6-40f9-9525-e84081a054c5-kube-api-access-85wg9\") pod \"authorino-58cd955675-hvlkw\" (UID: \"c43e8f07-0be6-40f9-9525-e84081a054c5\") " pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:30.187603 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.187580    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:30.224042 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.224013    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-948hb\" (UniqueName: \"kubernetes.io/projected/8e9717e5-c1e9-4210-9efb-09862c0611ab-kube-api-access-948hb\") pod \"authorino-75d556bd77-fkxkr\" (UID: \"8e9717e5-c1e9-4210-9efb-09862c0611ab\") " pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:48:30.317359 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.317334    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hvlkw"]
Jul 24 18:48:30.319878 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:48:30.319834    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc43e8f07_0be6_40f9_9525_e84081a054c5.slice/crio-25bc5eac0ab395f70e8e9d5ddf8b2db00db846d5f9b6d00af724b0a352c6af19 WatchSource:0}: Error finding container 25bc5eac0ab395f70e8e9d5ddf8b2db00db846d5f9b6d00af724b0a352c6af19: Status 404 returned error can't find the container with id 25bc5eac0ab395f70e8e9d5ddf8b2db00db846d5f9b6d00af724b0a352c6af19
Jul 24 18:48:30.324901 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.324875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-948hb\" (UniqueName: \"kubernetes.io/projected/8e9717e5-c1e9-4210-9efb-09862c0611ab-kube-api-access-948hb\") pod \"authorino-75d556bd77-fkxkr\" (UID: \"8e9717e5-c1e9-4210-9efb-09862c0611ab\") " pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:48:30.334549 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.334524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-948hb\" (UniqueName: \"kubernetes.io/projected/8e9717e5-c1e9-4210-9efb-09862c0611ab-kube-api-access-948hb\") pod \"authorino-75d556bd77-fkxkr\" (UID: \"8e9717e5-c1e9-4210-9efb-09862c0611ab\") " pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:48:30.390110 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.390030    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:48:30.512929 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.512903    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fkxkr"]
Jul 24 18:48:30.514978 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:48:30.514954    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e9717e5_c1e9_4210_9efb_09862c0611ab.slice/crio-94d8c15899ddc757927b66cdecae2d4030d0521f7a846ba258b59a3eec1b469c WatchSource:0}: Error finding container 94d8c15899ddc757927b66cdecae2d4030d0521f7a846ba258b59a3eec1b469c: Status 404 returned error can't find the container with id 94d8c15899ddc757927b66cdecae2d4030d0521f7a846ba258b59a3eec1b469c
Jul 24 18:48:30.708987 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.708915    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hvlkw" event={"ID":"c43e8f07-0be6-40f9-9525-e84081a054c5","Type":"ContainerStarted","Data":"25bc5eac0ab395f70e8e9d5ddf8b2db00db846d5f9b6d00af724b0a352c6af19"}
Jul 24 18:48:30.710049 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:30.710022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fkxkr" event={"ID":"8e9717e5-c1e9-4210-9efb-09862c0611ab","Type":"ContainerStarted","Data":"94d8c15899ddc757927b66cdecae2d4030d0521f7a846ba258b59a3eec1b469c"}
Jul 24 18:48:34.738023 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:34.737986    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hvlkw" event={"ID":"c43e8f07-0be6-40f9-9525-e84081a054c5","Type":"ContainerStarted","Data":"0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d"}
Jul 24 18:48:34.739470 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:34.739441    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fkxkr" event={"ID":"8e9717e5-c1e9-4210-9efb-09862c0611ab","Type":"ContainerStarted","Data":"75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6"}
Jul 24 18:48:34.755587 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:34.755545    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hvlkw" podStartSLOduration=2.239152128 podStartE2EDuration="5.755531863s" totalImagesPullingTime="3.516379735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:34.753739 +0000 UTC m=+506.671590525" watchObservedRunningTime="2026-07-24 18:48:34.755531863 +0000 UTC m=+506.673383754"
Jul 24 18:48:34.771973 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:34.771921    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fkxkr" podStartSLOduration=1.4381771429999999 podStartE2EDuration="4.771902487s" totalImagesPullingTime="3.333725344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:34.769007503 +0000 UTC m=+506.686859027" watchObservedRunningTime="2026-07-24 18:48:34.771902487 +0000 UTC m=+506.689754013"
Jul 24 18:48:34.809731 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:34.809701    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hvlkw"]
Jul 24 18:48:36.749383 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:36.749348    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hvlkw" podUID="c43e8f07-0be6-40f9-9525-e84081a054c5" containerName="authorino" containerID="cri-o://0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d" gracePeriod=30
Jul 24 18:48:36.987031 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:36.987010    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:37.089869 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.089847    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85wg9\" (UniqueName: \"kubernetes.io/projected/c43e8f07-0be6-40f9-9525-e84081a054c5-kube-api-access-85wg9\") pod \"c43e8f07-0be6-40f9-9525-e84081a054c5\" (UID: \"c43e8f07-0be6-40f9-9525-e84081a054c5\") "
Jul 24 18:48:37.091756 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.091729    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43e8f07-0be6-40f9-9525-e84081a054c5-kube-api-access-85wg9" (OuterVolumeSpecName: "kube-api-access-85wg9") pod "c43e8f07-0be6-40f9-9525-e84081a054c5" (UID: "c43e8f07-0be6-40f9-9525-e84081a054c5"). InnerVolumeSpecName "kube-api-access-85wg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:48:37.190398 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.190372    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85wg9\" (UniqueName: \"kubernetes.io/projected/c43e8f07-0be6-40f9-9525-e84081a054c5-kube-api-access-85wg9\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:48:37.755419 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.755380    2584 generic.go:356] "Generic (PLEG): container finished" podID="c43e8f07-0be6-40f9-9525-e84081a054c5" containerID="0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d" exitCode=0
Jul 24 18:48:37.755842 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.755423    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hvlkw"
Jul 24 18:48:37.755842 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.755440    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hvlkw" event={"ID":"c43e8f07-0be6-40f9-9525-e84081a054c5","Type":"ContainerDied","Data":"0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d"}
Jul 24 18:48:37.755842 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.755484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hvlkw" event={"ID":"c43e8f07-0be6-40f9-9525-e84081a054c5","Type":"ContainerDied","Data":"25bc5eac0ab395f70e8e9d5ddf8b2db00db846d5f9b6d00af724b0a352c6af19"}
Jul 24 18:48:37.755842 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.755502    2584 scope.go:117] "RemoveContainer" containerID="0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d"
Jul 24 18:48:37.763817 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.763803    2584 scope.go:117] "RemoveContainer" containerID="0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d"
Jul 24 18:48:37.764069 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:48:37.764037    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d\": container with ID starting with 0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d not found: ID does not exist" containerID="0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d"
Jul 24 18:48:37.764113 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.764083    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d"} err="failed to get container status \"0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d\": rpc error: code = NotFound desc = could not find container \"0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d\": container with ID starting with 0a67d9b789f773ae742addd93044eabd6189b6c291927ceb994ec9907c437a8d not found: ID does not exist"
Jul 24 18:48:37.777529 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.777510    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hvlkw"]
Jul 24 18:48:37.779521 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:37.779501    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hvlkw"]
Jul 24 18:48:38.573525 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:48:38.573494    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c43e8f07-0be6-40f9-9525-e84081a054c5" path="/var/lib/kubelet/pods/c43e8f07-0be6-40f9-9525-e84081a054c5/volumes"
Jul 24 18:49:06.069485 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.069412    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rk6zd"]
Jul 24 18:49:06.069899 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.069883    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c43e8f07-0be6-40f9-9525-e84081a054c5" containerName="authorino"
Jul 24 18:49:06.069941 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.069902    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c43e8f07-0be6-40f9-9525-e84081a054c5" containerName="authorino"
Jul 24 18:49:06.070023 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.070011    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c43e8f07-0be6-40f9-9525-e84081a054c5" containerName="authorino"
Jul 24 18:49:06.072858 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.072834    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:06.080463 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.080444    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rk6zd"]
Jul 24 18:49:06.194567 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.194540    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt67j\" (UniqueName: \"kubernetes.io/projected/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6-kube-api-access-rt67j\") pod \"authorino-5d4b67c446-rk6zd\" (UID: \"c76a12ee-eb37-496f-a0ef-0efa2ddac8a6\") " pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:06.246384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.246360    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rk6zd"]
Jul 24 18:49:06.246560 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:49:06.246543    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rt67j], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-rk6zd" podUID="c76a12ee-eb37-496f-a0ef-0efa2ddac8a6"
Jul 24 18:49:06.276912 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.276883    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-xsn2t"]
Jul 24 18:49:06.280071 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.280044    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.282810 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.282790    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 18:49:06.288974 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.288953    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-xsn2t"]
Jul 24 18:49:06.295508 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.295486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt67j\" (UniqueName: \"kubernetes.io/projected/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6-kube-api-access-rt67j\") pod \"authorino-5d4b67c446-rk6zd\" (UID: \"c76a12ee-eb37-496f-a0ef-0efa2ddac8a6\") " pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:06.304449 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.304429    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt67j\" (UniqueName: \"kubernetes.io/projected/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6-kube-api-access-rt67j\") pod \"authorino-5d4b67c446-rk6zd\" (UID: \"c76a12ee-eb37-496f-a0ef-0efa2ddac8a6\") " pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:06.321654 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.321603    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-xsn2t"]
Jul 24 18:49:06.321786 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:49:06.321768    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2nkf6 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-xsn2t" podUID="4a20f6ff-33d3-4e5e-92ac-03ab3903bba7"
Jul 24 18:49:06.349203 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.349182    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c497db56d-jjs6r"]
Jul 24 18:49:06.352440 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.352424    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.359856 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.359839    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c497db56d-jjs6r"]
Jul 24 18:49:06.396819 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.396795    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nkf6\" (UniqueName: \"kubernetes.io/projected/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-kube-api-access-2nkf6\") pod \"authorino-76877994-xsn2t\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") " pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.396903 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.396848    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-tls-cert\") pod \"authorino-76877994-xsn2t\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") " pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.498222 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.498199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nkf6\" (UniqueName: \"kubernetes.io/projected/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-kube-api-access-2nkf6\") pod \"authorino-76877994-xsn2t\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") " pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.498309 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.498231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4f99\" (UniqueName: \"kubernetes.io/projected/06c7f7ae-10c3-4b1e-acae-03ec00de097d-kube-api-access-s4f99\") pod \"authorino-5c497db56d-jjs6r\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") " pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.498309 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.498270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-tls-cert\") pod \"authorino-76877994-xsn2t\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") " pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.498396 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.498307    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06c7f7ae-10c3-4b1e-acae-03ec00de097d-tls-cert\") pod \"authorino-5c497db56d-jjs6r\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") " pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.500516 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.500500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-tls-cert\") pod \"authorino-76877994-xsn2t\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") " pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.506140 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.506123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nkf6\" (UniqueName: \"kubernetes.io/projected/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-kube-api-access-2nkf6\") pod \"authorino-76877994-xsn2t\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") " pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.598674 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.598649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06c7f7ae-10c3-4b1e-acae-03ec00de097d-tls-cert\") pod \"authorino-5c497db56d-jjs6r\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") " pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.598780 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.598727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4f99\" (UniqueName: \"kubernetes.io/projected/06c7f7ae-10c3-4b1e-acae-03ec00de097d-kube-api-access-s4f99\") pod \"authorino-5c497db56d-jjs6r\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") " pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.600730 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.600710    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06c7f7ae-10c3-4b1e-acae-03ec00de097d-tls-cert\") pod \"authorino-5c497db56d-jjs6r\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") " pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.607560 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.607542    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4f99\" (UniqueName: \"kubernetes.io/projected/06c7f7ae-10c3-4b1e-acae-03ec00de097d-kube-api-access-s4f99\") pod \"authorino-5c497db56d-jjs6r\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") " pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.662232 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.662210    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:49:06.787593 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.787568    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c497db56d-jjs6r"]
Jul 24 18:49:06.788868 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:49:06.788844    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06c7f7ae_10c3_4b1e_acae_03ec00de097d.slice/crio-fe5f3426275e917f548df9961b9b971c71a131dd7dc4ca1a23da00968eeb4198 WatchSource:0}: Error finding container fe5f3426275e917f548df9961b9b971c71a131dd7dc4ca1a23da00968eeb4198: Status 404 returned error can't find the container with id fe5f3426275e917f548df9961b9b971c71a131dd7dc4ca1a23da00968eeb4198
Jul 24 18:49:06.897077 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.897005    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c497db56d-jjs6r" event={"ID":"06c7f7ae-10c3-4b1e-acae-03ec00de097d","Type":"ContainerStarted","Data":"fe5f3426275e917f548df9961b9b971c71a131dd7dc4ca1a23da00968eeb4198"}
Jul 24 18:49:06.897077 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.897068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:06.897202 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.897067    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:06.905132 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.905114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:06.907091 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:06.907077    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:07.001679 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.001655    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nkf6\" (UniqueName: \"kubernetes.io/projected/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-kube-api-access-2nkf6\") pod \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") "
Jul 24 18:49:07.001785 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.001731    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt67j\" (UniqueName: \"kubernetes.io/projected/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6-kube-api-access-rt67j\") pod \"c76a12ee-eb37-496f-a0ef-0efa2ddac8a6\" (UID: \"c76a12ee-eb37-496f-a0ef-0efa2ddac8a6\") "
Jul 24 18:49:07.001785 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.001776    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-tls-cert\") pod \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\" (UID: \"4a20f6ff-33d3-4e5e-92ac-03ab3903bba7\") "
Jul 24 18:49:07.003716 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.003696    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4a20f6ff-33d3-4e5e-92ac-03ab3903bba7" (UID: "4a20f6ff-33d3-4e5e-92ac-03ab3903bba7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:49:07.003818 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.003798    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6-kube-api-access-rt67j" (OuterVolumeSpecName: "kube-api-access-rt67j") pod "c76a12ee-eb37-496f-a0ef-0efa2ddac8a6" (UID: "c76a12ee-eb37-496f-a0ef-0efa2ddac8a6"). InnerVolumeSpecName "kube-api-access-rt67j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:49:07.003818 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.003808    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-kube-api-access-2nkf6" (OuterVolumeSpecName: "kube-api-access-2nkf6") pod "4a20f6ff-33d3-4e5e-92ac-03ab3903bba7" (UID: "4a20f6ff-33d3-4e5e-92ac-03ab3903bba7"). InnerVolumeSpecName "kube-api-access-2nkf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:49:07.102996 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.102966    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt67j\" (UniqueName: \"kubernetes.io/projected/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6-kube-api-access-rt67j\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:49:07.102996 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.102993    2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-tls-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:49:07.103324 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.103006    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nkf6\" (UniqueName: \"kubernetes.io/projected/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7-kube-api-access-2nkf6\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:49:07.903474 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.903443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c497db56d-jjs6r" event={"ID":"06c7f7ae-10c3-4b1e-acae-03ec00de097d","Type":"ContainerStarted","Data":"e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7"}
Jul 24 18:49:07.903656 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.903474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-xsn2t"
Jul 24 18:49:07.903656 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.903644    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rk6zd"
Jul 24 18:49:07.922274 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.922230    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c497db56d-jjs6r" podStartSLOduration=1.535823607 podStartE2EDuration="1.922217607s" totalImagesPullingTime="386.394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:49:07.920740501 +0000 UTC m=+539.838592026" watchObservedRunningTime="2026-07-24 18:49:07.922217607 +0000 UTC m=+539.840069187"
Jul 24 18:49:07.955765 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.955733    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fkxkr"]
Jul 24 18:49:07.955973 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.955932    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fkxkr" podUID="8e9717e5-c1e9-4210-9efb-09862c0611ab" containerName="authorino" containerID="cri-o://75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6" gracePeriod=30
Jul 24 18:49:07.958052 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.958026    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rk6zd"]
Jul 24 18:49:07.961981 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.961931    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rk6zd"]
Jul 24 18:49:07.987509 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.987484    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-xsn2t"]
Jul 24 18:49:07.991690 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:07.991669    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-xsn2t"]
Jul 24 18:49:08.199552 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.199527    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:49:08.211615 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.211594    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-948hb\" (UniqueName: \"kubernetes.io/projected/8e9717e5-c1e9-4210-9efb-09862c0611ab-kube-api-access-948hb\") pod \"8e9717e5-c1e9-4210-9efb-09862c0611ab\" (UID: \"8e9717e5-c1e9-4210-9efb-09862c0611ab\") "
Jul 24 18:49:08.213460 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.213437    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9717e5-c1e9-4210-9efb-09862c0611ab-kube-api-access-948hb" (OuterVolumeSpecName: "kube-api-access-948hb") pod "8e9717e5-c1e9-4210-9efb-09862c0611ab" (UID: "8e9717e5-c1e9-4210-9efb-09862c0611ab"). InnerVolumeSpecName "kube-api-access-948hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:49:08.312502 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.312478    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-948hb\" (UniqueName: \"kubernetes.io/projected/8e9717e5-c1e9-4210-9efb-09862c0611ab-kube-api-access-948hb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:49:08.574803 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.574779    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a20f6ff-33d3-4e5e-92ac-03ab3903bba7" path="/var/lib/kubelet/pods/4a20f6ff-33d3-4e5e-92ac-03ab3903bba7/volumes"
Jul 24 18:49:08.575022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.575009    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76a12ee-eb37-496f-a0ef-0efa2ddac8a6" path="/var/lib/kubelet/pods/c76a12ee-eb37-496f-a0ef-0efa2ddac8a6/volumes"
Jul 24 18:49:08.909210 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.909185    2584 generic.go:356] "Generic (PLEG): container finished" podID="8e9717e5-c1e9-4210-9efb-09862c0611ab" containerID="75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6" exitCode=0
Jul 24 18:49:08.909384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.909230    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fkxkr"
Jul 24 18:49:08.909384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.909275    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fkxkr" event={"ID":"8e9717e5-c1e9-4210-9efb-09862c0611ab","Type":"ContainerDied","Data":"75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6"}
Jul 24 18:49:08.909384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.909321    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fkxkr" event={"ID":"8e9717e5-c1e9-4210-9efb-09862c0611ab","Type":"ContainerDied","Data":"94d8c15899ddc757927b66cdecae2d4030d0521f7a846ba258b59a3eec1b469c"}
Jul 24 18:49:08.909384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.909343    2584 scope.go:117] "RemoveContainer" containerID="75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6"
Jul 24 18:49:08.917022 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.917006    2584 scope.go:117] "RemoveContainer" containerID="75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6"
Jul 24 18:49:08.917286 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:49:08.917267    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6\": container with ID starting with 75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6 not found: ID does not exist" containerID="75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6"
Jul 24 18:49:08.917382 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.917291    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6"} err="failed to get container status \"75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6\": rpc error: code = NotFound desc = could not find container \"75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6\": container with ID starting with 75a7be47fec6c536fc9344301c1e43f484fb4e03847291e4f4dd1dcb23ef2ca6 not found: ID does not exist"
Jul 24 18:49:08.927391 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.927371    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fkxkr"]
Jul 24 18:49:08.932329 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:08.932310    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fkxkr"]
Jul 24 18:49:10.579969 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:10.579936    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e9717e5-c1e9-4210-9efb-09862c0611ab" path="/var/lib/kubelet/pods/8e9717e5-c1e9-4210-9efb-09862c0611ab/volumes"
Jul 24 18:49:55.133817 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:55.133788    2584 generic.go:356] "Generic (PLEG): container finished" podID="f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2" containerID="859724bf33a40da6f3e8d6f0713759ed080e43330d41ba83e9e4d687b0e9b149" exitCode=0
Jul 24 18:49:55.134186 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:55.133826    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" event={"ID":"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2","Type":"ContainerDied","Data":"859724bf33a40da6f3e8d6f0713759ed080e43330d41ba83e9e4d687b0e9b149"}
Jul 24 18:49:55.134186 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:55.134172    2584 scope.go:117] "RemoveContainer" containerID="859724bf33a40da6f3e8d6f0713759ed080e43330d41ba83e9e4d687b0e9b149"
Jul 24 18:49:55.135191 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:55.135157    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:49:55.135279 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:55.135228    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:49:55.135279 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:55.135262    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:49:56.140685 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:56.140653    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" event={"ID":"f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2","Type":"ContainerStarted","Data":"9eefd84f0e5211345ed78f331c9975b89559a1cae7c990f63bbcc51c24393ee0"}
Jul 24 18:49:57.026893 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:57.026855    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:49:57.027956 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:57.027932    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fcmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 24 18:49:57.028014 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:57.027981    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" podUID="f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 24 18:49:58.027374 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:58.027338    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fcmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 24 18:49:58.027803 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:58.027407    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" podUID="f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 24 18:49:58.699253 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:58.699216    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:49:59.027326 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:59.027242    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fcmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 24 18:49:59.027326 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:49:59.027296    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9" podUID="f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 24 18:50:00.030763 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:00.030726    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:50:00.031800 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:00.031776    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fcmm9"
Jul 24 18:50:50.581024 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.580994    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"]
Jul 24 18:50:50.581423 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.581301    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9717e5-c1e9-4210-9efb-09862c0611ab" containerName="authorino"
Jul 24 18:50:50.581423 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.581312    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9717e5-c1e9-4210-9efb-09862c0611ab" containerName="authorino"
Jul 24 18:50:50.581423 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.581381    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e9717e5-c1e9-4210-9efb-09862c0611ab" containerName="authorino"
Jul 24 18:50:50.583266 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.583250    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.586308 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.586282    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 18:50:50.586308 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.586302    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 18:50:50.587331 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.587316    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 18:50:50.587419 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.587401    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pq4pw\""
Jul 24 18:50:50.591935 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.591915    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"]
Jul 24 18:50:50.690217 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.690196    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.690329 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.690233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.690329 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.690259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.690417 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.690343    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.690417 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.690380    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj2m7\" (UniqueName: \"kubernetes.io/projected/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-kube-api-access-dj2m7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.690488 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.690466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791285 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791294    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj2m7\" (UniqueName: \"kubernetes.io/projected/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-kube-api-access-dj2m7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791380 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791367    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791395    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791491 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791773 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791845 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.791845 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.791789    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.793543 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.793519    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.793728 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.793714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.799719 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.799697    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj2m7\" (UniqueName: \"kubernetes.io/projected/28a5cbb8-1572-4cab-8bd0-f86df6e46b28-kube-api-access-dj2m7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dtn28\" (UID: \"28a5cbb8-1572-4cab-8bd0-f86df6e46b28\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:50.894069 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:50.894021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:50:51.027090 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:51.027050    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"]
Jul 24 18:50:51.029029 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:50:51.029000    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a5cbb8_1572_4cab_8bd0_f86df6e46b28.slice/crio-3d6a3dd2f3291244f1b8f167bb242f6d544f8c94d3613f4c591364f7d13b89a5 WatchSource:0}: Error finding container 3d6a3dd2f3291244f1b8f167bb242f6d544f8c94d3613f4c591364f7d13b89a5: Status 404 returned error can't find the container with id 3d6a3dd2f3291244f1b8f167bb242f6d544f8c94d3613f4c591364f7d13b89a5
Jul 24 18:50:51.030335 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:51.030316    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:50:51.412222 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:51.412182    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28" event={"ID":"28a5cbb8-1572-4cab-8bd0-f86df6e46b28","Type":"ContainerStarted","Data":"3d6a3dd2f3291244f1b8f167bb242f6d544f8c94d3613f4c591364f7d13b89a5"}
Jul 24 18:50:52.418574 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:52.418540    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28" event={"ID":"28a5cbb8-1572-4cab-8bd0-f86df6e46b28","Type":"ContainerStarted","Data":"ab295dc85767a43073db5210f42ab7b1f1bf0ca554d8aecccfb3be1871826424"}
Jul 24 18:50:52.442530 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:50:52.442484    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28" podStartSLOduration=1.267978046 podStartE2EDuration="2.442469343s" totalImagesPullingTime="1.174491297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:50:52.441589645 +0000 UTC m=+644.359441172" watchObservedRunningTime="2026-07-24 18:50:52.442469343 +0000 UTC m=+644.360320891"
Jul 24 18:51:00.895093 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:00.895040    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:51:00.895493 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:00.895131    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:51:00.907384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:00.907354    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:51:01.470334 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:01.470306    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dtn28"
Jul 24 18:51:18.557086 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.557036    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"]
Jul 24 18:51:18.560297 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.560278    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.563072 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.563040    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 18:51:18.573976 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.573951    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"]
Jul 24 18:51:18.711890 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.711855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.711890 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.711895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.712104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.711910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.712104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.711960    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.712104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.711996    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54c7f\" (UniqueName: \"kubernetes.io/projected/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-kube-api-access-54c7f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.712104 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.712027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.812956    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.812989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813005    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813258 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813258 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54c7f\" (UniqueName: \"kubernetes.io/projected/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-kube-api-access-54c7f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813258 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813418 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813371    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813418 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813392    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.813513 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.813439    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.815293 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.815275    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.815547 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.815531    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.821879 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.821859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54c7f\" (UniqueName: \"kubernetes.io/projected/cdf6bcde-44d8-4180-a113-88c8bcfda9c8-kube-api-access-54c7f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-24xs6\" (UID: \"cdf6bcde-44d8-4180-a113-88c8bcfda9c8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.870543 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.870525    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:18.998658 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:18.998634    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"]
Jul 24 18:51:19.000437 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:51:19.000405    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf6bcde_44d8_4180_a113_88c8bcfda9c8.slice/crio-f8bcc4700aebd83274198c97feed3b2250a347811a2dff39e04b2732a92f73b8 WatchSource:0}: Error finding container f8bcc4700aebd83274198c97feed3b2250a347811a2dff39e04b2732a92f73b8: Status 404 returned error can't find the container with id f8bcc4700aebd83274198c97feed3b2250a347811a2dff39e04b2732a92f73b8
Jul 24 18:51:19.546933 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:19.546843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6" event={"ID":"cdf6bcde-44d8-4180-a113-88c8bcfda9c8","Type":"ContainerStarted","Data":"afa213f282c252d4f6c57c3a39ac7ce0a2e738991917219ddb875c3863ef9f0b"}
Jul 24 18:51:19.546933 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:19.546894    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6" event={"ID":"cdf6bcde-44d8-4180-a113-88c8bcfda9c8","Type":"ContainerStarted","Data":"f8bcc4700aebd83274198c97feed3b2250a347811a2dff39e04b2732a92f73b8"}
Jul 24 18:51:19.565372 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:19.565328    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6" podStartSLOduration=1.298615734 podStartE2EDuration="1.565314022s" totalImagesPullingTime="266.698288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:19.564162871 +0000 UTC m=+671.482014399" watchObservedRunningTime="2026-07-24 18:51:19.565314022 +0000 UTC m=+671.483165547"
Jul 24 18:51:23.554339 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.554310    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"]
Jul 24 18:51:23.557850 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.557830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.560525 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.560505    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 18:51:23.567384 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.567361    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"]
Jul 24 18:51:23.656198 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.656177    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.656312 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.656210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.656312 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.656240    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.656312 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.656266    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzzx\" (UniqueName: \"kubernetes.io/projected/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-kube-api-access-8nzzx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.656312 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.656291    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.656444 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.656345    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757105 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757175    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzzx\" (UniqueName: \"kubernetes.io/projected/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-kube-api-access-8nzzx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757448 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757246    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757516 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757573 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757551    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.757616 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.757579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.759299 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.759272    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.759579 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.759560    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.778429 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.778398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzzx\" (UniqueName: \"kubernetes.io/projected/a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87-kube-api-access-8nzzx\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq\" (UID: \"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.868978 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.868950    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:23.995775 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:23.995752    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"]
Jul 24 18:51:23.997248 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:51:23.997210    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5c5a56b_f63e_42f0_8cc7_9e2cecdf9f87.slice/crio-288070a564a46b414638c2cfd6c232b79900cc255c295592ec129777424d9caf WatchSource:0}: Error finding container 288070a564a46b414638c2cfd6c232b79900cc255c295592ec129777424d9caf: Status 404 returned error can't find the container with id 288070a564a46b414638c2cfd6c232b79900cc255c295592ec129777424d9caf
Jul 24 18:51:24.575825 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:24.575732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq" event={"ID":"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87","Type":"ContainerStarted","Data":"5f9a327da14be34bf728a9e6665ceea9eaaafef397a7f8afb933014de06a63cf"}
Jul 24 18:51:24.575825 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:24.575786    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq" event={"ID":"a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87","Type":"ContainerStarted","Data":"288070a564a46b414638c2cfd6c232b79900cc255c295592ec129777424d9caf"}
Jul 24 18:51:24.593708 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:24.593663    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq" podStartSLOduration=1.399288866 podStartE2EDuration="1.593647903s" totalImagesPullingTime="194.359037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:24.592901735 +0000 UTC m=+676.510753262" watchObservedRunningTime="2026-07-24 18:51:24.593647903 +0000 UTC m=+676.511499428"
Jul 24 18:51:28.871574 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:28.871531    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:28.872017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:28.871599    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:28.885422 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:28.885398    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:29.613281 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:29.613254    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-24xs6"
Jul 24 18:51:33.869607 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:33.869576    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:33.869607 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:33.869616    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:33.882032 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:33.882008    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:51:34.635999 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:51:34.635967    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq"
Jul 24 18:52:41.883138 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:41.883106    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d6cb47465-gr8ql"]
Jul 24 18:52:41.886640 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:41.886624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:41.894110 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:41.894084    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6cb47465-gr8ql"]
Jul 24 18:52:41.965482 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:41.965455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c20fa890-7264-4d56-873f-cd30399c6441-tls-cert\") pod \"authorino-d6cb47465-gr8ql\" (UID: \"c20fa890-7264-4d56-873f-cd30399c6441\") " pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:41.965600 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:41.965492    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfprj\" (UniqueName: \"kubernetes.io/projected/c20fa890-7264-4d56-873f-cd30399c6441-kube-api-access-zfprj\") pod \"authorino-d6cb47465-gr8ql\" (UID: \"c20fa890-7264-4d56-873f-cd30399c6441\") " pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:42.066426 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.066383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c20fa890-7264-4d56-873f-cd30399c6441-tls-cert\") pod \"authorino-d6cb47465-gr8ql\" (UID: \"c20fa890-7264-4d56-873f-cd30399c6441\") " pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:42.066426 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.066425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfprj\" (UniqueName: \"kubernetes.io/projected/c20fa890-7264-4d56-873f-cd30399c6441-kube-api-access-zfprj\") pod \"authorino-d6cb47465-gr8ql\" (UID: \"c20fa890-7264-4d56-873f-cd30399c6441\") " pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:42.068797 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.068775    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c20fa890-7264-4d56-873f-cd30399c6441-tls-cert\") pod \"authorino-d6cb47465-gr8ql\" (UID: \"c20fa890-7264-4d56-873f-cd30399c6441\") " pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:42.074346 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.074326    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfprj\" (UniqueName: \"kubernetes.io/projected/c20fa890-7264-4d56-873f-cd30399c6441-kube-api-access-zfprj\") pod \"authorino-d6cb47465-gr8ql\" (UID: \"c20fa890-7264-4d56-873f-cd30399c6441\") " pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:42.196775 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.196719    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cb47465-gr8ql"
Jul 24 18:52:42.329777 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.329752    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6cb47465-gr8ql"]
Jul 24 18:52:42.331527 ip-10-0-128-234 kubenswrapper[2584]: W0724 18:52:42.331496    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc20fa890_7264_4d56_873f_cd30399c6441.slice/crio-8a11b09ba0b9191facf26f49c119294d8aac38813480ab776599f16679694552 WatchSource:0}: Error finding container 8a11b09ba0b9191facf26f49c119294d8aac38813480ab776599f16679694552: Status 404 returned error can't find the container with id 8a11b09ba0b9191facf26f49c119294d8aac38813480ab776599f16679694552
Jul 24 18:52:42.971220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.971131    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cb47465-gr8ql" event={"ID":"c20fa890-7264-4d56-873f-cd30399c6441","Type":"ContainerStarted","Data":"69796cb6bf1afa9833345a8cd082b1f5344c460369f1467296aa47644fc86a66"}
Jul 24 18:52:42.971220 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:42.971181    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cb47465-gr8ql" event={"ID":"c20fa890-7264-4d56-873f-cd30399c6441","Type":"ContainerStarted","Data":"8a11b09ba0b9191facf26f49c119294d8aac38813480ab776599f16679694552"}
Jul 24 18:52:43.071569 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.071503    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d6cb47465-gr8ql" podStartSLOduration=1.725631353 podStartE2EDuration="2.071479391s" totalImagesPullingTime="345.848038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:52:43.016228689 +0000 UTC m=+754.934080216" watchObservedRunningTime="2026-07-24 18:52:43.071479391 +0000 UTC m=+754.989330917"
Jul 24 18:52:43.076114 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.076090    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c497db56d-jjs6r"]
Jul 24 18:52:43.076463 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.076437    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5c497db56d-jjs6r" podUID="06c7f7ae-10c3-4b1e-acae-03ec00de097d" containerName="authorino" containerID="cri-o://e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7" gracePeriod=30
Jul 24 18:52:43.331100 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.331038    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:52:43.378316 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.378282    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4f99\" (UniqueName: \"kubernetes.io/projected/06c7f7ae-10c3-4b1e-acae-03ec00de097d-kube-api-access-s4f99\") pod \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") "
Jul 24 18:52:43.378473 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.378353    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06c7f7ae-10c3-4b1e-acae-03ec00de097d-tls-cert\") pod \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\" (UID: \"06c7f7ae-10c3-4b1e-acae-03ec00de097d\") "
Jul 24 18:52:43.380552 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.380516    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c7f7ae-10c3-4b1e-acae-03ec00de097d-kube-api-access-s4f99" (OuterVolumeSpecName: "kube-api-access-s4f99") pod "06c7f7ae-10c3-4b1e-acae-03ec00de097d" (UID: "06c7f7ae-10c3-4b1e-acae-03ec00de097d"). InnerVolumeSpecName "kube-api-access-s4f99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:52:43.389379 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.389337    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06c7f7ae-10c3-4b1e-acae-03ec00de097d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "06c7f7ae-10c3-4b1e-acae-03ec00de097d" (UID: "06c7f7ae-10c3-4b1e-acae-03ec00de097d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:52:43.479630 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.479587    2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06c7f7ae-10c3-4b1e-acae-03ec00de097d-tls-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:52:43.479630 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.479630    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4f99\" (UniqueName: \"kubernetes.io/projected/06c7f7ae-10c3-4b1e-acae-03ec00de097d-kube-api-access-s4f99\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:52:43.977919 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.977880    2584 generic.go:356] "Generic (PLEG): container finished" podID="06c7f7ae-10c3-4b1e-acae-03ec00de097d" containerID="e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7" exitCode=0
Jul 24 18:52:43.978393 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.977922    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c497db56d-jjs6r"
Jul 24 18:52:43.978393 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.977959    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c497db56d-jjs6r" event={"ID":"06c7f7ae-10c3-4b1e-acae-03ec00de097d","Type":"ContainerDied","Data":"e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7"}
Jul 24 18:52:43.978393 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.978001    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c497db56d-jjs6r" event={"ID":"06c7f7ae-10c3-4b1e-acae-03ec00de097d","Type":"ContainerDied","Data":"fe5f3426275e917f548df9961b9b971c71a131dd7dc4ca1a23da00968eeb4198"}
Jul 24 18:52:43.978393 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.978022    2584 scope.go:117] "RemoveContainer" containerID="e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7"
Jul 24 18:52:43.987474 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.987457    2584 scope.go:117] "RemoveContainer" containerID="e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7"
Jul 24 18:52:43.987749 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:52:43.987733    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7\": container with ID starting with e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7 not found: ID does not exist" containerID="e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7"
Jul 24 18:52:43.987797 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:43.987756    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7"} err="failed to get container status \"e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7\": rpc error: code = NotFound desc = could not find container \"e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7\": container with ID starting with e62b882a24df6e35feae759203caffc54cd25024dd38b9267181e89375ccc0c7 not found: ID does not exist"
Jul 24 18:52:44.003736 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:44.003715    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c497db56d-jjs6r"]
Jul 24 18:52:44.005797 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:44.005774    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c497db56d-jjs6r"]
Jul 24 18:52:44.573908 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:52:44.573878    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c7f7ae-10c3-4b1e-acae-03ec00de097d" path="/var/lib/kubelet/pods/06c7f7ae-10c3-4b1e-acae-03ec00de097d/volumes"
Jul 24 18:59:29.069580 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:29.069548    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"]
Jul 24 18:59:29.070189 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:29.069838    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs" podUID="0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" containerName="manager" containerID="cri-o://ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7" gracePeriod=10
Jul 24 18:59:30.818673 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:30.818646    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:59:30.941004 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:30.940907    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-extensions-socket-volume\") pod \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") "
Jul 24 18:59:30.941004 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:30.940988    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gxhr\" (UniqueName: \"kubernetes.io/projected/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-kube-api-access-8gxhr\") pod \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\" (UID: \"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc\") "
Jul 24 18:59:30.941312 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:30.941291    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" (UID: "0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:59:30.943017 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:30.942990    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-kube-api-access-8gxhr" (OuterVolumeSpecName: "kube-api-access-8gxhr") pod "0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" (UID: "0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc"). InnerVolumeSpecName "kube-api-access-8gxhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:59:31.030233 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.030205    2584 generic.go:356] "Generic (PLEG): container finished" podID="0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" containerID="ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7" exitCode=0
Jul 24 18:59:31.030344 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.030251    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"
Jul 24 18:59:31.030344 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.030298    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs" event={"ID":"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc","Type":"ContainerDied","Data":"ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7"}
Jul 24 18:59:31.030415 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.030350    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs" event={"ID":"0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc","Type":"ContainerDied","Data":"0ed14d7bde6b56d0f62da9bfb4a1c16770f59a2d20ca1c20db8885fde400b7b8"}
Jul 24 18:59:31.030415 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.030372    2584 scope.go:117] "RemoveContainer" containerID="ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7"
Jul 24 18:59:31.039656 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.039640    2584 scope.go:117] "RemoveContainer" containerID="ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7"
Jul 24 18:59:31.039910 ip-10-0-128-234 kubenswrapper[2584]: E0724 18:59:31.039894    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7\": container with ID starting with ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7 not found: ID does not exist" containerID="ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7"
Jul 24 18:59:31.039961 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.039918    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7"} err="failed to get container status \"ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7\": rpc error: code = NotFound desc = could not find container \"ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7\": container with ID starting with ec7abcbaaf26e28bf30f6f712beb6cb3b86ccb1bee7b4305d8b7f46206730de7 not found: ID does not exist"
Jul 24 18:59:31.042371 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.042346    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gxhr\" (UniqueName: \"kubernetes.io/projected/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-kube-api-access-8gxhr\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:59:31.042462 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.042376    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 18:59:31.053850 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.053831    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"]
Jul 24 18:59:31.061694 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:31.060278    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mdzxs"]
Jul 24 18:59:32.573490 ip-10-0-128-234 kubenswrapper[2584]: I0724 18:59:32.573456    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" path="/var/lib/kubelet/pods/0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc/volumes"
Jul 24 19:00:00.145760 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.145723    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"]
Jul 24 19:00:00.146274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.146085    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" containerName="manager"
Jul 24 19:00:00.146274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.146097    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" containerName="manager"
Jul 24 19:00:00.146274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.146116    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c7f7ae-10c3-4b1e-acae-03ec00de097d" containerName="authorino"
Jul 24 19:00:00.146274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.146122    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c7f7ae-10c3-4b1e-acae-03ec00de097d" containerName="authorino"
Jul 24 19:00:00.146274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.146172    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c7f7ae-10c3-4b1e-acae-03ec00de097d" containerName="authorino"
Jul 24 19:00:00.146274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.146181    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcd344c-fad3-43ba-84b8-7e4b5ba45dfc" containerName="manager"
Jul 24 19:00:00.149090 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.149054    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"
Jul 24 19:00:00.152620 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.152604    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:00:00.157017 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.156991    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"]
Jul 24 19:00:00.160160 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.160141    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"
Jul 24 19:00:00.491458 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.491431    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"]
Jul 24 19:00:00.493474 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:00:00.493450    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb92b72_71f3_4116_99e2_a685dceafbd1.slice/crio-0226298ed46e7a82a1c59646d90baee88cd3de988c4578592f0f995cc151a9cb WatchSource:0}: Error finding container 0226298ed46e7a82a1c59646d90baee88cd3de988c4578592f0f995cc151a9cb: Status 404 returned error can't find the container with id 0226298ed46e7a82a1c59646d90baee88cd3de988c4578592f0f995cc151a9cb
Jul 24 19:00:00.495191 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:00.495176    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:00:01.184814 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:01.184777    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz" event={"ID":"6bb92b72-71f3-4116-99e2-a685dceafbd1","Type":"ContainerStarted","Data":"0226298ed46e7a82a1c59646d90baee88cd3de988c4578592f0f995cc151a9cb"}
Jul 24 19:00:04.203009 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:04.202977    2584 generic.go:356] "Generic (PLEG): container finished" podID="6bb92b72-71f3-4116-99e2-a685dceafbd1" containerID="fc6053bc7503e06faa1ae994342e6ad49a684bc0961b43f5b026ba8b52e40896" exitCode=0
Jul 24 19:00:04.203396 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:04.203088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz" event={"ID":"6bb92b72-71f3-4116-99e2-a685dceafbd1","Type":"ContainerDied","Data":"fc6053bc7503e06faa1ae994342e6ad49a684bc0961b43f5b026ba8b52e40896"}
Jul 24 19:00:05.333948 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:05.333925    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"
Jul 24 19:00:06.213919 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:06.213891    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz"
Jul 24 19:00:06.214235 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:06.213924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748660-trgbz" event={"ID":"6bb92b72-71f3-4116-99e2-a685dceafbd1","Type":"ContainerDied","Data":"0226298ed46e7a82a1c59646d90baee88cd3de988c4578592f0f995cc151a9cb"}
Jul 24 19:00:06.214235 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:06.213963    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0226298ed46e7a82a1c59646d90baee88cd3de988c4578592f0f995cc151a9cb"
Jul 24 19:00:30.189977 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.189943    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"]
Jul 24 19:00:30.190422 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.190305    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb92b72-71f3-4116-99e2-a685dceafbd1" containerName="cleanup"
Jul 24 19:00:30.190422 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.190317    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb92b72-71f3-4116-99e2-a685dceafbd1" containerName="cleanup"
Jul 24 19:00:30.190422 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.190373    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb92b72-71f3-4116-99e2-a685dceafbd1" containerName="cleanup"
Jul 24 19:00:30.194470 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.194447    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.198280 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.198257    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wm5k8\""
Jul 24 19:00:30.205785 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.205765    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"]
Jul 24 19:00:30.301882 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.301849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc1aa37-436e-4442-8e3b-f01424a6650d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7gck5\" (UID: \"3bc1aa37-436e-4442-8e3b-f01424a6650d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.302029 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.301963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2km\" (UniqueName: \"kubernetes.io/projected/3bc1aa37-436e-4442-8e3b-f01424a6650d-kube-api-access-2n2km\") pod \"kuadrant-operator-controller-manager-86878c769f-7gck5\" (UID: \"3bc1aa37-436e-4442-8e3b-f01424a6650d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.403200 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.403168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2km\" (UniqueName: \"kubernetes.io/projected/3bc1aa37-436e-4442-8e3b-f01424a6650d-kube-api-access-2n2km\") pod \"kuadrant-operator-controller-manager-86878c769f-7gck5\" (UID: \"3bc1aa37-436e-4442-8e3b-f01424a6650d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.403329 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.403241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc1aa37-436e-4442-8e3b-f01424a6650d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7gck5\" (UID: \"3bc1aa37-436e-4442-8e3b-f01424a6650d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.403594 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.403576    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc1aa37-436e-4442-8e3b-f01424a6650d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7gck5\" (UID: \"3bc1aa37-436e-4442-8e3b-f01424a6650d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.422521 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.422495    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2km\" (UniqueName: \"kubernetes.io/projected/3bc1aa37-436e-4442-8e3b-f01424a6650d-kube-api-access-2n2km\") pod \"kuadrant-operator-controller-manager-86878c769f-7gck5\" (UID: \"3bc1aa37-436e-4442-8e3b-f01424a6650d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.505333 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.505271    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:30.635153 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:30.635130    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"]
Jul 24 19:00:30.636960 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:00:30.636934    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc1aa37_436e_4442_8e3b_f01424a6650d.slice/crio-a2a4f3c84bd0a89652742ed647c3b13933d5d81a46ebade7d38febb38177ec31 WatchSource:0}: Error finding container a2a4f3c84bd0a89652742ed647c3b13933d5d81a46ebade7d38febb38177ec31: Status 404 returned error can't find the container with id a2a4f3c84bd0a89652742ed647c3b13933d5d81a46ebade7d38febb38177ec31
Jul 24 19:00:31.342719 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:31.342685    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5" event={"ID":"3bc1aa37-436e-4442-8e3b-f01424a6650d","Type":"ContainerStarted","Data":"23b9e6f5ccce39975545f5496a5bccb4eda6f928cb92177d468670fb98d09dab"}
Jul 24 19:00:31.343137 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:31.342742    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:00:31.343137 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:31.342765    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5" event={"ID":"3bc1aa37-436e-4442-8e3b-f01424a6650d","Type":"ContainerStarted","Data":"a2a4f3c84bd0a89652742ed647c3b13933d5d81a46ebade7d38febb38177ec31"}
Jul 24 19:00:31.365888 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:31.365835    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5" podStartSLOduration=1.365817595 podStartE2EDuration="1.365817595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:00:31.362601683 +0000 UTC m=+1223.280453199" watchObservedRunningTime="2026-07-24 19:00:31.365817595 +0000 UTC m=+1223.283669122"
Jul 24 19:00:42.349608 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:00:42.349579    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7gck5"
Jul 24 19:03:27.763482 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.763450    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"]
Jul 24 19:03:27.766006 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.765982    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.768651 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.768633    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-670f312d-kserve-self-signed-certs\""
Jul 24 19:03:27.780516 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.780498    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"]
Jul 24 19:03:27.855769 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.855744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvks6\" (UniqueName: \"kubernetes.io/projected/fff43d6f-69b1-42f8-9512-2d290d93801f-kube-api-access-gvks6\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.855881 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.855785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-tmp-dir\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.855881 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.855818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fff43d6f-69b1-42f8-9512-2d290d93801f-tls-certs\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.855881 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.855850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-home\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.855881 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.855870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-model-cache\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.856030 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.855901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-dshm\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957216 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-home\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957353 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957227    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-model-cache\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957353 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-dshm\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957353 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvks6\" (UniqueName: \"kubernetes.io/projected/fff43d6f-69b1-42f8-9512-2d290d93801f-kube-api-access-gvks6\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957353 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957323    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-tmp-dir\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957512 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fff43d6f-69b1-42f8-9512-2d290d93801f-tls-certs\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957688 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-home\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957753 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-model-cache\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.957791 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.957779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-tmp-dir\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.959514 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.959494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-dshm\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.959682 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.959666    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fff43d6f-69b1-42f8-9512-2d290d93801f-tls-certs\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:27.966797 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:27.966773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvks6\" (UniqueName: \"kubernetes.io/projected/fff43d6f-69b1-42f8-9512-2d290d93801f-kube-api-access-gvks6\") pod \"e2e-same-id-b-670f312d-kserve-5454848759-rxxtf\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") " pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:28.074321 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:28.074261    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:28.202778 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:28.202738    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"]
Jul 24 19:03:28.204032 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:03:28.204008    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfff43d6f_69b1_42f8_9512_2d290d93801f.slice/crio-a209690b5609be724c4f8a3f38cda8897472332ad1a5ab55965ff7deda1cbe21 WatchSource:0}: Error finding container a209690b5609be724c4f8a3f38cda8897472332ad1a5ab55965ff7deda1cbe21: Status 404 returned error can't find the container with id a209690b5609be724c4f8a3f38cda8897472332ad1a5ab55965ff7deda1cbe21
Jul 24 19:03:28.235906 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:28.235883    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf" event={"ID":"fff43d6f-69b1-42f8-9512-2d290d93801f","Type":"ContainerStarted","Data":"a209690b5609be724c4f8a3f38cda8897472332ad1a5ab55965ff7deda1cbe21"}
Jul 24 19:03:29.243125 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:29.243080    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf" event={"ID":"fff43d6f-69b1-42f8-9512-2d290d93801f","Type":"ContainerStarted","Data":"79c915badd78bc928dab25e40a8990c9d0e3b0786528e71ce6eefbf6473165c0"}
Jul 24 19:03:29.260408 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:29.260358    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf" podStartSLOduration=2.260343054 podStartE2EDuration="2.260343054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:03:29.258136875 +0000 UTC m=+1401.175988402" watchObservedRunningTime="2026-07-24 19:03:29.260343054 +0000 UTC m=+1401.178194578"
Jul 24 19:03:38.075009 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:38.074972    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:38.075479 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:38.075023    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:38.087550 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:38.087527    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:03:38.298994 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:03:38.298967    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:04:15.366192 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:15.366109    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"]
Jul 24 19:04:30.385047 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.384989    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf" podUID="fff43d6f-69b1-42f8-9512-2d290d93801f" containerName="main" containerID="cri-o://79c915badd78bc928dab25e40a8990c9d0e3b0786528e71ce6eefbf6473165c0" gracePeriod=45
Jul 24 19:04:30.554454 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.554424    2584 generic.go:356] "Generic (PLEG): container finished" podID="fff43d6f-69b1-42f8-9512-2d290d93801f" containerID="79c915badd78bc928dab25e40a8990c9d0e3b0786528e71ce6eefbf6473165c0" exitCode=0
Jul 24 19:04:30.554559 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.554494    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf" event={"ID":"fff43d6f-69b1-42f8-9512-2d290d93801f","Type":"ContainerDied","Data":"79c915badd78bc928dab25e40a8990c9d0e3b0786528e71ce6eefbf6473165c0"}
Jul 24 19:04:30.636472 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.636420    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:04:30.649892 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.649872    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fff43d6f-69b1-42f8-9512-2d290d93801f-tls-certs\") pod \"fff43d6f-69b1-42f8-9512-2d290d93801f\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") "
Jul 24 19:04:30.649986 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.649914    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-model-cache\") pod \"fff43d6f-69b1-42f8-9512-2d290d93801f\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") "
Jul 24 19:04:30.649986 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.649946    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-dshm\") pod \"fff43d6f-69b1-42f8-9512-2d290d93801f\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") "
Jul 24 19:04:30.649986 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.649986    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-home\") pod \"fff43d6f-69b1-42f8-9512-2d290d93801f\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") "
Jul 24 19:04:30.650171 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650014    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvks6\" (UniqueName: \"kubernetes.io/projected/fff43d6f-69b1-42f8-9512-2d290d93801f-kube-api-access-gvks6\") pod \"fff43d6f-69b1-42f8-9512-2d290d93801f\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") "
Jul 24 19:04:30.650171 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650037    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-tmp-dir\") pod \"fff43d6f-69b1-42f8-9512-2d290d93801f\" (UID: \"fff43d6f-69b1-42f8-9512-2d290d93801f\") "
Jul 24 19:04:30.650278 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650206    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-model-cache" (OuterVolumeSpecName: "model-cache") pod "fff43d6f-69b1-42f8-9512-2d290d93801f" (UID: "fff43d6f-69b1-42f8-9512-2d290d93801f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:30.650278 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650260    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-home" (OuterVolumeSpecName: "home") pod "fff43d6f-69b1-42f8-9512-2d290d93801f" (UID: "fff43d6f-69b1-42f8-9512-2d290d93801f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:30.650418 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650394    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:04:30.650418 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650405    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fff43d6f-69b1-42f8-9512-2d290d93801f" (UID: "fff43d6f-69b1-42f8-9512-2d290d93801f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:30.650530 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.650419    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:04:30.651977 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.651953    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff43d6f-69b1-42f8-9512-2d290d93801f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fff43d6f-69b1-42f8-9512-2d290d93801f" (UID: "fff43d6f-69b1-42f8-9512-2d290d93801f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:04:30.652408 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.652382    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff43d6f-69b1-42f8-9512-2d290d93801f-kube-api-access-gvks6" (OuterVolumeSpecName: "kube-api-access-gvks6") pod "fff43d6f-69b1-42f8-9512-2d290d93801f" (UID: "fff43d6f-69b1-42f8-9512-2d290d93801f"). InnerVolumeSpecName "kube-api-access-gvks6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:04:30.652479 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.652391    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-dshm" (OuterVolumeSpecName: "dshm") pod "fff43d6f-69b1-42f8-9512-2d290d93801f" (UID: "fff43d6f-69b1-42f8-9512-2d290d93801f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:04:30.750807 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.750786    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvks6\" (UniqueName: \"kubernetes.io/projected/fff43d6f-69b1-42f8-9512-2d290d93801f-kube-api-access-gvks6\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:04:30.750807 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.750805    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:04:30.750931 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.750815    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fff43d6f-69b1-42f8-9512-2d290d93801f-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:04:30.750931 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:30.750823    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fff43d6f-69b1-42f8-9512-2d290d93801f-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:04:31.561476 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:31.561445    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"
Jul 24 19:04:31.561851 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:31.561494    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf" event={"ID":"fff43d6f-69b1-42f8-9512-2d290d93801f","Type":"ContainerDied","Data":"a209690b5609be724c4f8a3f38cda8897472332ad1a5ab55965ff7deda1cbe21"}
Jul 24 19:04:31.561851 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:31.561543    2584 scope.go:117] "RemoveContainer" containerID="79c915badd78bc928dab25e40a8990c9d0e3b0786528e71ce6eefbf6473165c0"
Jul 24 19:04:31.584512 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:31.584488    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"]
Jul 24 19:04:31.587848 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:31.587828    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-670f312d-kserve-5454848759-rxxtf"]
Jul 24 19:04:32.574566 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:04:32.574536    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff43d6f-69b1-42f8-9512-2d290d93801f" path="/var/lib/kubelet/pods/fff43d6f-69b1-42f8-9512-2d290d93801f/volumes"
Jul 24 19:07:52.753383 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.753349    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"]
Jul 24 19:07:52.753943 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.753886    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff43d6f-69b1-42f8-9512-2d290d93801f" containerName="main"
Jul 24 19:07:52.753943 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.753905    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff43d6f-69b1-42f8-9512-2d290d93801f" containerName="main"
Jul 24 19:07:52.754086 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.753995    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff43d6f-69b1-42f8-9512-2d290d93801f" containerName="main"
Jul 24 19:07:52.756081 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.756037    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.758817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.758796    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1ed084fc-openshift-default-dockercfg-qt2cz\""
Jul 24 19:07:52.777190 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.777168    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"]
Jul 24 19:07:52.938926 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.938896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-certs\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939123 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.938958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-token\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939123 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939016    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istiod-ca-cert\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939123 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-credential-socket\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939123 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939111    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-data\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939296 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-podinfo\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939296 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939198    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-socket\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939296 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939230    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-envoy\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:52.939296 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:52.939251    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2n2t\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-kube-api-access-g2n2t\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040458 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-socket\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040458 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-envoy\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040458 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2n2t\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-kube-api-access-g2n2t\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-certs\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-token\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istiod-ca-cert\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-credential-socket\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-data\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040644    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-podinfo\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040981 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-socket\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.040981 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.040915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-certs\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.041204 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.041089    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-credential-socket\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.041204 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.041146    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-data\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.041316 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.041280    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istiod-ca-cert\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.043320 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.043289    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-envoy\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.043453 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.043435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-podinfo\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.052460 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.052441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-token\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.052759 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.052742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2n2t\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-kube-api-access-g2n2t\") pod \"e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") " pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.065800 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.065777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:53.199560 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.199514    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"]
Jul 24 19:07:53.201713 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:07:53.201683    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1624a02_567b_4b94_80d8_bfdcf4ccf78f.slice/crio-a32306433e7383d73671f4089de50ca52308282bc62e27f82f020fa46fdb6607 WatchSource:0}: Error finding container a32306433e7383d73671f4089de50ca52308282bc62e27f82f020fa46fdb6607: Status 404 returned error can't find the container with id a32306433e7383d73671f4089de50ca52308282bc62e27f82f020fa46fdb6607
Jul 24 19:07:53.203854 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.203820    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:07:53.203918 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.203882    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:07:53.203918 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.203911    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:07:53.590666 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.590627    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" event={"ID":"b1624a02-567b-4b94-80d8-bfdcf4ccf78f","Type":"ContainerStarted","Data":"c700453351344781b3fa164ea2aba3c2db8eba1768879a6f5e6247a7e0681992"}
Jul 24 19:07:53.590833 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.590690    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" event={"ID":"b1624a02-567b-4b94-80d8-bfdcf4ccf78f","Type":"ContainerStarted","Data":"a32306433e7383d73671f4089de50ca52308282bc62e27f82f020fa46fdb6607"}
Jul 24 19:07:53.611652 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:53.611594    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" podStartSLOduration=1.6115814739999998 podStartE2EDuration="1.611581474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:07:53.609191246 +0000 UTC m=+1665.527042772" watchObservedRunningTime="2026-07-24 19:07:53.611581474 +0000 UTC m=+1665.529432998"
Jul 24 19:07:54.066828 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:54.066730    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:54.071696 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:54.071675    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:54.595296 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:54.595260    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:07:54.596238 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:07:54.596216    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:06.656235 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:06.656204    2584 generic.go:356] "Generic (PLEG): container finished" podID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerID="c700453351344781b3fa164ea2aba3c2db8eba1768879a6f5e6247a7e0681992" exitCode=0
Jul 24 19:08:06.656614 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:06.656280    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" event={"ID":"b1624a02-567b-4b94-80d8-bfdcf4ccf78f","Type":"ContainerDied","Data":"c700453351344781b3fa164ea2aba3c2db8eba1768879a6f5e6247a7e0681992"}
Jul 24 19:08:06.656655 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:06.656646    2584 scope.go:117] "RemoveContainer" containerID="c700453351344781b3fa164ea2aba3c2db8eba1768879a6f5e6247a7e0681992"
Jul 24 19:08:06.657713 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:06.657686    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:06.657773 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:06.657757    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:06.657810 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:06.657792    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:08:07.663979 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:07.663944    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" event={"ID":"b1624a02-567b-4b94-80d8-bfdcf4ccf78f","Type":"ContainerStarted","Data":"5e8b5860183443258da996c0face130de08acfc80df725e596916d4fa523878c"}
Jul 24 19:08:08.066793 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:08.066687    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:08.067131 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:08.067092    2584 patch_prober.go:28] interesting pod/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:08:08.067260 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:08.067162    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:08:09.066719 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:09.066678    2584 patch_prober.go:28] interesting pod/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:08:09.067243 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:09.066740    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:08:09.595622 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:09.595588    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:10.066610 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:10.066513    2584 patch_prober.go:28] interesting pod/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:08:10.066610 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:10.066583    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:08:11.067071 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:11.067018    2584 patch_prober.go:28] interesting pod/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:08:11.067554 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:11.067115    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:08:12.070139 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:12.070107    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:12.071051 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:12.071030    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:35.666797 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:35.666707    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"]
Jul 24 19:08:35.667400 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:35.666977    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy" containerID="cri-o://5e8b5860183443258da996c0face130de08acfc80df725e596916d4fa523878c" gracePeriod=30
Jul 24 19:08:40.837381 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:40.837353    2584 generic.go:356] "Generic (PLEG): container finished" podID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerID="5e8b5860183443258da996c0face130de08acfc80df725e596916d4fa523878c" exitCode=0
Jul 24 19:08:40.837773 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:40.837424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" event={"ID":"b1624a02-567b-4b94-80d8-bfdcf4ccf78f","Type":"ContainerDied","Data":"5e8b5860183443258da996c0face130de08acfc80df725e596916d4fa523878c"}
Jul 24 19:08:40.837773 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:40.837486    2584 scope.go:117] "RemoveContainer" containerID="c700453351344781b3fa164ea2aba3c2db8eba1768879a6f5e6247a7e0681992"
Jul 24 19:08:40.916883 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:40.916858    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:41.048048 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.047977    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-certs\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048048 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048006    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istiod-ca-cert\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048048 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048029    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-credential-socket\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048278 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048162    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-data\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048278 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048185    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-envoy\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048278 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048207    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2n2t\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-kube-api-access-g2n2t\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048278 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048261    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-token\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048490 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:08:41.048490 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048306    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:08:41.048490 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048308    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-podinfo\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048490 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048405    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-socket\") pod \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\" (UID: \"b1624a02-567b-4b94-80d8-bfdcf4ccf78f\") "
Jul 24 19:08:41.048490 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048474    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:08:41.048761 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048689    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:08:41.048825 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048756    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.048825 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048774    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.048825 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.048783    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.049053 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.049023    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:08:41.050642 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.050606    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:08:41.050763 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.050671    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:08:41.050815 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.050798    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-kube-api-access-g2n2t" (OuterVolumeSpecName: "kube-api-access-g2n2t") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "kube-api-access-g2n2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:08:41.050860 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.050816    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1624a02-567b-4b94-80d8-bfdcf4ccf78f" (UID: "b1624a02-567b-4b94-80d8-bfdcf4ccf78f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:08:41.149396 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.149365    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.149396 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.149395    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.149396 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.149403    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2n2t\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-kube-api-access-g2n2t\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.149559 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.149412    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.149559 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.149420    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.149559 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.149427    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1624a02-567b-4b94-80d8-bfdcf4ccf78f-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:08:41.844165 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.844129    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b" event={"ID":"b1624a02-567b-4b94-80d8-bfdcf4ccf78f","Type":"ContainerDied","Data":"a32306433e7383d73671f4089de50ca52308282bc62e27f82f020fa46fdb6607"}
Jul 24 19:08:41.844588 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.844188    2584 scope.go:117] "RemoveContainer" containerID="5e8b5860183443258da996c0face130de08acfc80df725e596916d4fa523878c"
Jul 24 19:08:41.844588 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.844141    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"
Jul 24 19:08:41.865711 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.865685    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"]
Jul 24 19:08:41.871151 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:41.871130    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1ed084fc-openshift-default-7748d959c4-5gx4b"]
Jul 24 19:08:42.573782 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:08:42.573754    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" path="/var/lib/kubelet/pods/b1624a02-567b-4b94-80d8-bfdcf4ccf78f/volumes"
Jul 24 19:10:08.095199 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.095167    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"]
Jul 24 19:10:08.095621 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.095554    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy"
Jul 24 19:10:08.095621 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.095569    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy"
Jul 24 19:10:08.095701 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.095647    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy"
Jul 24 19:10:08.095701 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.095656    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy"
Jul 24 19:10:08.098727 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.098703    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.101649 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.101629    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a93f4b7c-openshift-default-dockercfg-k4lxk\""
Jul 24 19:10:08.113241 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.113218    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"]
Jul 24 19:10:08.148935 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.148910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm9zs\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-kube-api-access-bm9zs\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149027 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.148951    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db71737e-24b1-46c8-bd50-82d6c49a3004-istiod-ca-cert\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149027 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.148977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-podinfo\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149136 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.149045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-data\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149136 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.149123    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-credential-socket\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149216 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.149155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-socket\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149216 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.149195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-certs\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149288 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.149215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-envoy\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.149288 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.149243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-token\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.249783 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.249755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm9zs\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-kube-api-access-bm9zs\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.249947 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.249798    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db71737e-24b1-46c8-bd50-82d6c49a3004-istiod-ca-cert\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.249947 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.249925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-podinfo\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250109 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.249970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-data\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250109 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-credential-socket\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250109 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-socket\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-certs\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-envoy\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-token\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250539 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250512    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-credential-socket\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250648 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250577    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-socket\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250648 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250618    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-data\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250753 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db71737e-24b1-46c8-bd50-82d6c49a3004-istiod-ca-cert\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.250753 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.250677    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-certs\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.252261 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.252237    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-envoy\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.252435 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.252418    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-podinfo\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.258527 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.258505    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-token\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.258610 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.258594    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm9zs\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-kube-api-access-bm9zs\") pod \"e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") " pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.409112 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.409005    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:08.549380 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.549352    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"]
Jul 24 19:10:08.550846 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:10:08.550751    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb71737e_24b1_46c8_bd50_82d6c49a3004.slice/crio-6754b79fd51c5f5eb190f611830b417043faea91909c2835c8a660c1d552bcf9 WatchSource:0}: Error finding container 6754b79fd51c5f5eb190f611830b417043faea91909c2835c8a660c1d552bcf9: Status 404 returned error can't find the container with id 6754b79fd51c5f5eb190f611830b417043faea91909c2835c8a660c1d552bcf9
Jul 24 19:10:08.553292 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.553260    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:10:08.553388 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.553335    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:10:08.553388 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:08.553364    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:10:09.297355 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:09.297318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" event={"ID":"db71737e-24b1-46c8-bd50-82d6c49a3004","Type":"ContainerStarted","Data":"518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"}
Jul 24 19:10:09.297726 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:09.297376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" event={"ID":"db71737e-24b1-46c8-bd50-82d6c49a3004","Type":"ContainerStarted","Data":"6754b79fd51c5f5eb190f611830b417043faea91909c2835c8a660c1d552bcf9"}
Jul 24 19:10:09.319231 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:09.319185    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" podStartSLOduration=1.319168687 podStartE2EDuration="1.319168687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:10:09.317635803 +0000 UTC m=+1801.235487329" watchObservedRunningTime="2026-07-24 19:10:09.319168687 +0000 UTC m=+1801.237020211"
Jul 24 19:10:09.409268 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:09.409243    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:09.413881 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:09.413861    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:10.302659 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:10.302627    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:10.303665 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:10.303647    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:24.375877 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:24.375851    2584 generic.go:356] "Generic (PLEG): container finished" podID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerID="518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed" exitCode=0
Jul 24 19:10:24.376307 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:24.375934    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" event={"ID":"db71737e-24b1-46c8-bd50-82d6c49a3004","Type":"ContainerDied","Data":"518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"}
Jul 24 19:10:24.376457 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:24.376439    2584 scope.go:117] "RemoveContainer" containerID="518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"
Jul 24 19:10:24.377642 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:24.377606    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:10:24.377750 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:24.377674    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:10:24.377750 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:24.377714    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:10:25.302816 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:25.302761    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:25.388257 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:25.388207    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" event={"ID":"db71737e-24b1-46c8-bd50-82d6c49a3004","Type":"ContainerStarted","Data":"9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8"}
Jul 24 19:10:25.410015 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:25.409987    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:25.411145 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:25.411121    2584 patch_prober.go:28] interesting pod/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:10:25.411247 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:25.411169    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:10:26.410408 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:26.410375    2584 patch_prober.go:28] interesting pod/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:10:26.410812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:26.410441    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:10:27.409687 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:27.409653    2584 patch_prober.go:28] interesting pod/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:10:27.409859 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:27.409704    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:10:28.410436 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:28.410405    2584 patch_prober.go:28] interesting pod/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:10:28.410848 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:28.410456    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:10:29.413784 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:29.413756    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:29.414213 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:29.414163    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:29.414882 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:29.414865    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:35.379725 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:35.379692    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"]
Jul 24 19:10:35.380304 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:35.379879    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy" containerID="cri-o://9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8" gracePeriod=30
Jul 24 19:10:40.651188 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.651116    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:40.745078 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745014    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-credential-socket\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745078 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745073    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-certs\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745342 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745105    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm9zs\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-kube-api-access-bm9zs\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745342 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745142    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-socket\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745342 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745173    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-podinfo\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745342 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745199    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-data\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745342 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745230    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db71737e-24b1-46c8-bd50-82d6c49a3004-istiod-ca-cert\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745342 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745307    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-envoy\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745709 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745360    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-token\") pod \"db71737e-24b1-46c8-bd50-82d6c49a3004\" (UID: \"db71737e-24b1-46c8-bd50-82d6c49a3004\") "
Jul 24 19:10:40.745709 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745356    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:40.745709 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745374    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:40.745709 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745462    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:40.745709 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745696    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.745974 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745715    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.745974 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745729    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.745974 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.745906    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db71737e-24b1-46c8-bd50-82d6c49a3004-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:10:40.746280 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.746256    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-data" (OuterVolumeSpecName: "istio-data") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:40.747860 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.747829    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-token" (OuterVolumeSpecName: "istio-token") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:10:40.747860 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.747829    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-kube-api-access-bm9zs" (OuterVolumeSpecName: "kube-api-access-bm9zs") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "kube-api-access-bm9zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:10:40.748006 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.747872    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:10:40.748006 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.747891    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db71737e-24b1-46c8-bd50-82d6c49a3004" (UID: "db71737e-24b1-46c8-bd50-82d6c49a3004"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:40.847042 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.847009    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.847042 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.847036    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.847042 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.847046    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm9zs\" (UniqueName: \"kubernetes.io/projected/db71737e-24b1-46c8-bd50-82d6c49a3004-kube-api-access-bm9zs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.847272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.847077    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.847272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.847088    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db71737e-24b1-46c8-bd50-82d6c49a3004-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:40.847272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:40.847097    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db71737e-24b1-46c8-bd50-82d6c49a3004-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:10:41.482275 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.482221    2584 generic.go:356] "Generic (PLEG): container finished" podID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerID="9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8" exitCode=0
Jul 24 19:10:41.482533 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.482513    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" event={"ID":"db71737e-24b1-46c8-bd50-82d6c49a3004","Type":"ContainerDied","Data":"9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8"}
Jul 24 19:10:41.482723 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.482710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp" event={"ID":"db71737e-24b1-46c8-bd50-82d6c49a3004","Type":"ContainerDied","Data":"6754b79fd51c5f5eb190f611830b417043faea91909c2835c8a660c1d552bcf9"}
Jul 24 19:10:41.482859 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.482848    2584 scope.go:117] "RemoveContainer" containerID="9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8"
Jul 24 19:10:41.483076 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.483050    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"
Jul 24 19:10:41.497027 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.496869    2584 scope.go:117] "RemoveContainer" containerID="518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"
Jul 24 19:10:41.504541 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.504520    2584 scope.go:117] "RemoveContainer" containerID="9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8"
Jul 24 19:10:41.504772 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:10:41.504753    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8\": container with ID starting with 9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8 not found: ID does not exist" containerID="9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8"
Jul 24 19:10:41.504823 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.504779    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8"} err="failed to get container status \"9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8\": rpc error: code = NotFound desc = could not find container \"9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8\": container with ID starting with 9b51da90d2f6a29f29a5f4425eeb029f4e3a73e87943b07f52bdc0ea5f83fee8 not found: ID does not exist"
Jul 24 19:10:41.504823 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.504803    2584 scope.go:117] "RemoveContainer" containerID="518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"
Jul 24 19:10:41.505044 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:10:41.505028    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed\": container with ID starting with 518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed not found: ID does not exist" containerID="518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"
Jul 24 19:10:41.505116 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.505046    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed"} err="failed to get container status \"518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed\": rpc error: code = NotFound desc = could not find container \"518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed\": container with ID starting with 518eb8458179cc6fda22b24f122df06a0a8982bac9d2f7ca11c7cca285e70bed not found: ID does not exist"
Jul 24 19:10:41.508419 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.508398    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"]
Jul 24 19:10:41.512782 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:41.512760    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a93f4b7c-openshift-default-75c6c658bd-r9kdp"]
Jul 24 19:10:42.573416 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:10:42.573381    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" path="/var/lib/kubelet/pods/db71737e-24b1-46c8-bd50-82d6c49a3004/volumes"
Jul 24 19:13:21.846206 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846172    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"]
Jul 24 19:13:21.846746 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846714    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy"
Jul 24 19:13:21.846833 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846749    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy"
Jul 24 19:13:21.846833 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846764    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy"
Jul 24 19:13:21.846833 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846773    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1624a02-567b-4b94-80d8-bfdcf4ccf78f" containerName="istio-proxy"
Jul 24 19:13:21.846978 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846898    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy"
Jul 24 19:13:21.846978 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.846911    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy"
Jul 24 19:13:21.856970 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.856941    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:21.860331 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.860290    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-780ac09a\"/\"kube-root-ca.crt\""
Jul 24 19:13:21.860331 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.860322    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-780ac09a\"/\"default-dockercfg-zhcg4\""
Jul 24 19:13:21.861173 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.861151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"]
Jul 24 19:13:21.861818 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.861552    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-780ac09a\"/\"openshift-service-ca.crt\""
Jul 24 19:13:21.861818 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.861810    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-780ac09a\"/\"e2e-lifecycle-model-780ac09a-kserve-self-signed-certs\""
Jul 24 19:13:21.957610 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.957583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aedf958-113c-4424-a628-86abd8685de2-tls-certs\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:21.957726 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.957622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lh69\" (UniqueName: \"kubernetes.io/projected/4aedf958-113c-4424-a628-86abd8685de2-kube-api-access-7lh69\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:21.957726 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.957672    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-home\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:21.957726 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.957717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-dshm\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:21.957849 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.957742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-tmp-dir\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:21.957849 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:21.957809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-model-cache\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.058813 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.058780    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-home\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.058813 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.058814    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-dshm\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059024 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.058835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-tmp-dir\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059024 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.058887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-model-cache\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059024 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.058912    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aedf958-113c-4424-a628-86abd8685de2-tls-certs\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059024 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.058954    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lh69\" (UniqueName: \"kubernetes.io/projected/4aedf958-113c-4424-a628-86abd8685de2-kube-api-access-7lh69\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059257 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.059179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-home\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059328 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.059308    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-tmp-dir\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.059389 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.059369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-model-cache\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.061097 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.061081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-dshm\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.061374 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.061356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aedf958-113c-4424-a628-86abd8685de2-tls-certs\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.068111 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.068085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lh69\" (UniqueName: \"kubernetes.io/projected/4aedf958-113c-4424-a628-86abd8685de2-kube-api-access-7lh69\") pod \"e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") " pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.170848 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.170780    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:22.301868 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:22.301845    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"]
Jul 24 19:13:22.303780 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:13:22.303752    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aedf958_113c_4424_a628_86abd8685de2.slice/crio-b03d73a74fa47135a8bdf943af09c7d64f9153b8ee91795dc62a115fbd6140d6 WatchSource:0}: Error finding container b03d73a74fa47135a8bdf943af09c7d64f9153b8ee91795dc62a115fbd6140d6: Status 404 returned error can't find the container with id b03d73a74fa47135a8bdf943af09c7d64f9153b8ee91795dc62a115fbd6140d6
Jul 24 19:13:23.297759 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:23.297726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px" event={"ID":"4aedf958-113c-4424-a628-86abd8685de2","Type":"ContainerStarted","Data":"3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0"}
Jul 24 19:13:23.298141 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:23.297766    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px" event={"ID":"4aedf958-113c-4424-a628-86abd8685de2","Type":"ContainerStarted","Data":"b03d73a74fa47135a8bdf943af09c7d64f9153b8ee91795dc62a115fbd6140d6"}
Jul 24 19:13:23.316134 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:23.316085    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px" podStartSLOduration=2.316046673 podStartE2EDuration="2.316046673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:13:23.31477522 +0000 UTC m=+1995.232626747" watchObservedRunningTime="2026-07-24 19:13:23.316046673 +0000 UTC m=+1995.233898198"
Jul 24 19:13:32.171437 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:32.171398    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:32.171437 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:32.171447    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:32.184400 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:32.184376    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:13:32.353953 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:13:32.353925    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:14:28.268853 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:28.268822    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"]
Jul 24 19:14:43.287207 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.287127    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px" podUID="4aedf958-113c-4424-a628-86abd8685de2" containerName="main" containerID="cri-o://3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0" gracePeriod=45
Jul 24 19:14:43.530609 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.530585    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:14:43.595135 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595115    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aedf958-113c-4424-a628-86abd8685de2-tls-certs\") pod \"4aedf958-113c-4424-a628-86abd8685de2\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") "
Jul 24 19:14:43.595268 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595194    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-model-cache\") pod \"4aedf958-113c-4424-a628-86abd8685de2\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") "
Jul 24 19:14:43.595268 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595221    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-dshm\") pod \"4aedf958-113c-4424-a628-86abd8685de2\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") "
Jul 24 19:14:43.595364 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595278    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-tmp-dir\") pod \"4aedf958-113c-4424-a628-86abd8685de2\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") "
Jul 24 19:14:43.595364 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595323    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lh69\" (UniqueName: \"kubernetes.io/projected/4aedf958-113c-4424-a628-86abd8685de2-kube-api-access-7lh69\") pod \"4aedf958-113c-4424-a628-86abd8685de2\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") "
Jul 24 19:14:43.595364 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595350    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-home\") pod \"4aedf958-113c-4424-a628-86abd8685de2\" (UID: \"4aedf958-113c-4424-a628-86abd8685de2\") "
Jul 24 19:14:43.595526 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595485    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-model-cache" (OuterVolumeSpecName: "model-cache") pod "4aedf958-113c-4424-a628-86abd8685de2" (UID: "4aedf958-113c-4424-a628-86abd8685de2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:14:43.595526 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595502    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4aedf958-113c-4424-a628-86abd8685de2" (UID: "4aedf958-113c-4424-a628-86abd8685de2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:14:43.595715 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595692    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:14:43.595820 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595718    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:14:43.595820 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.595717    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-home" (OuterVolumeSpecName: "home") pod "4aedf958-113c-4424-a628-86abd8685de2" (UID: "4aedf958-113c-4424-a628-86abd8685de2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:14:43.597256 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.597231    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aedf958-113c-4424-a628-86abd8685de2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4aedf958-113c-4424-a628-86abd8685de2" (UID: "4aedf958-113c-4424-a628-86abd8685de2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:14:43.597740 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.597717    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-dshm" (OuterVolumeSpecName: "dshm") pod "4aedf958-113c-4424-a628-86abd8685de2" (UID: "4aedf958-113c-4424-a628-86abd8685de2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:14:43.597740 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.597725    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aedf958-113c-4424-a628-86abd8685de2-kube-api-access-7lh69" (OuterVolumeSpecName: "kube-api-access-7lh69") pod "4aedf958-113c-4424-a628-86abd8685de2" (UID: "4aedf958-113c-4424-a628-86abd8685de2"). InnerVolumeSpecName "kube-api-access-7lh69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:14:43.696285 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.696258    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lh69\" (UniqueName: \"kubernetes.io/projected/4aedf958-113c-4424-a628-86abd8685de2-kube-api-access-7lh69\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:14:43.696441 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.696286    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:14:43.696441 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.696303    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4aedf958-113c-4424-a628-86abd8685de2-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:14:43.696441 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.696317    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4aedf958-113c-4424-a628-86abd8685de2-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:14:43.700697 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.700675    2584 generic.go:356] "Generic (PLEG): container finished" podID="4aedf958-113c-4424-a628-86abd8685de2" containerID="3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0" exitCode=0
Jul 24 19:14:43.700780 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.700711    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"
Jul 24 19:14:43.700780 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.700755    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px" event={"ID":"4aedf958-113c-4424-a628-86abd8685de2","Type":"ContainerDied","Data":"3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0"}
Jul 24 19:14:43.700853 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.700797    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px" event={"ID":"4aedf958-113c-4424-a628-86abd8685de2","Type":"ContainerDied","Data":"b03d73a74fa47135a8bdf943af09c7d64f9153b8ee91795dc62a115fbd6140d6"}
Jul 24 19:14:43.700853 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.700818    2584 scope.go:117] "RemoveContainer" containerID="3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0"
Jul 24 19:14:43.709965 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.709948    2584 scope.go:117] "RemoveContainer" containerID="3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0"
Jul 24 19:14:43.710213 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:14:43.710197    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0\": container with ID starting with 3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0 not found: ID does not exist" containerID="3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0"
Jul 24 19:14:43.710270 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.710221    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0"} err="failed to get container status \"3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0\": rpc error: code = NotFound desc = could not find container \"3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0\": container with ID starting with 3495ee74020ca74de445b2844cfba5bc5acf7c82724351793029167a11536eb0 not found: ID does not exist"
Jul 24 19:14:43.722363 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.722344    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"]
Jul 24 19:14:43.726262 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:43.726245    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-780ac09a/e2e-lifecycle-model-780ac09a-kserve-89d4bd6c-xb6px"]
Jul 24 19:14:44.573564 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:14:44.573530    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aedf958-113c-4424-a628-86abd8685de2" path="/var/lib/kubelet/pods/4aedf958-113c-4424-a628-86abd8685de2/volumes"
Jul 24 19:16:30.646739 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.646705    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"]
Jul 24 19:16:30.647325 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.647191    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aedf958-113c-4424-a628-86abd8685de2" containerName="main"
Jul 24 19:16:30.647325 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.647212    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aedf958-113c-4424-a628-86abd8685de2" containerName="main"
Jul 24 19:16:30.647325 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.647226    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy"
Jul 24 19:16:30.647325 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.647231    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="db71737e-24b1-46c8-bd50-82d6c49a3004" containerName="istio-proxy"
Jul 24 19:16:30.647553 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.647331    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aedf958-113c-4424-a628-86abd8685de2" containerName="main"
Jul 24 19:16:30.650407 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.650388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.653491 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.653468    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ee838\"/\"kube-root-ca.crt\""
Jul 24 19:16:30.654786 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.654758    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ee838\"/\"default-dockercfg-2pghs\""
Jul 24 19:16:30.654953 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.654930    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ee838\"/\"openshift-service-ca.crt\""
Jul 24 19:16:30.655098 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.655081    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ee838\"/\"test-model-2ee838-kserve-self-signed-certs\""
Jul 24 19:16:30.662366 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.662346    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"]
Jul 24 19:16:30.728476 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.728452    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tmp-dir\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.728591 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.728488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-home\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.728591 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.728510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tls-certs\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.728679 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.728596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckb9\" (UniqueName: \"kubernetes.io/projected/33e092ec-591d-4d32-8a56-2fda8c74e2f6-kube-api-access-9ckb9\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.728679 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.728628    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-dshm\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.728679 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.728651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-model-cache\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.829544 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.829509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckb9\" (UniqueName: \"kubernetes.io/projected/33e092ec-591d-4d32-8a56-2fda8c74e2f6-kube-api-access-9ckb9\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.829544 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.829546    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-dshm\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.829758 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.829570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-model-cache\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.829758 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.829611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tmp-dir\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.829758 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.829646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-home\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.829758 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.829667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tls-certs\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.830042 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.830017    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-model-cache\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.830128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.830051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-home\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.830128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.830083    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tmp-dir\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.831707 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.831680    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-dshm\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.831959 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.831942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tls-certs\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.837901 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.837879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckb9\" (UniqueName: \"kubernetes.io/projected/33e092ec-591d-4d32-8a56-2fda8c74e2f6-kube-api-access-9ckb9\") pod \"test-model-2ee838-kserve-777c69f4f5-9phwl\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") " pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:30.961729 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:30.961663    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:31.088886 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:31.088811    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"]
Jul 24 19:16:31.091843 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:16:31.091812    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33e092ec_591d_4d32_8a56_2fda8c74e2f6.slice/crio-5a53288a68afa83f99a785a719c7f65656d3c3629d29d57196eb16f71f4e0b84 WatchSource:0}: Error finding container 5a53288a68afa83f99a785a719c7f65656d3c3629d29d57196eb16f71f4e0b84: Status 404 returned error can't find the container with id 5a53288a68afa83f99a785a719c7f65656d3c3629d29d57196eb16f71f4e0b84
Jul 24 19:16:31.231647 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:31.231575    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl" event={"ID":"33e092ec-591d-4d32-8a56-2fda8c74e2f6","Type":"ContainerStarted","Data":"fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07"}
Jul 24 19:16:31.231647 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:31.231615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl" event={"ID":"33e092ec-591d-4d32-8a56-2fda8c74e2f6","Type":"ContainerStarted","Data":"5a53288a68afa83f99a785a719c7f65656d3c3629d29d57196eb16f71f4e0b84"}
Jul 24 19:16:31.249199 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:31.249150    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl" podStartSLOduration=1.249133544 podStartE2EDuration="1.249133544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:16:31.248436463 +0000 UTC m=+2183.166287982" watchObservedRunningTime="2026-07-24 19:16:31.249133544 +0000 UTC m=+2183.166985065"
Jul 24 19:16:40.962089 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:40.962037    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:40.962607 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:40.962117    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:40.974589 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:40.974564    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:41.298005 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:41.297928    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:16:52.357688 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.357652    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"]
Jul 24 19:16:52.360992 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.360972    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.363604 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.363581    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-31c4fa\"/\"openshift-service-ca.crt\""
Jul 24 19:16:52.364819 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.364789    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-31c4fa\"/\"kube-root-ca.crt\""
Jul 24 19:16:52.365022 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.364987    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-31c4fa\"/\"default-dockercfg-b6rz8\""
Jul 24 19:16:52.365178 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.365160    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-31c4fa\"/\"test-model-31c4fa-kserve-self-signed-certs\""
Jul 24 19:16:52.371330 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.371312    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"]
Jul 24 19:16:52.505265 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.505233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tls-certs\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.505265 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.505267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkkg\" (UniqueName: \"kubernetes.io/projected/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-kube-api-access-rmkkg\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.505459 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.505286    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-model-cache\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.505459 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.505315    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-dshm\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.505459 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.505351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tmp-dir\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.505577 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.505480    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-home\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606263 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-home\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606407 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tls-certs\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606407 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkkg\" (UniqueName: \"kubernetes.io/projected/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-kube-api-access-rmkkg\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606407 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-model-cache\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606407 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606365    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-dshm\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606407 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tmp-dir\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606701 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-home\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606762 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606735    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-model-cache\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.606847 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.606826    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tmp-dir\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.608611 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.608559    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-dshm\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.608776 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.608758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tls-certs\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.614432 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.614410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkkg\" (UniqueName: \"kubernetes.io/projected/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-kube-api-access-rmkkg\") pod \"test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") " pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.671453 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.671422    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:16:52.799145 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:52.799115    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"]
Jul 24 19:16:52.800048 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:16:52.800021    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c0c8b3d_f9e6_40f4_ab1a_f499653af04b.slice/crio-ea097ff38df8c6fc56c03758e6b5a25f4e935e61127eb83df7cc3d64bf6a60d2 WatchSource:0}: Error finding container ea097ff38df8c6fc56c03758e6b5a25f4e935e61127eb83df7cc3d64bf6a60d2: Status 404 returned error can't find the container with id ea097ff38df8c6fc56c03758e6b5a25f4e935e61127eb83df7cc3d64bf6a60d2
Jul 24 19:16:53.353536 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:53.353498    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq" event={"ID":"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b","Type":"ContainerStarted","Data":"ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d"}
Jul 24 19:16:53.353700 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:53.353547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq" event={"ID":"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b","Type":"ContainerStarted","Data":"ea097ff38df8c6fc56c03758e6b5a25f4e935e61127eb83df7cc3d64bf6a60d2"}
Jul 24 19:16:53.372692 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:16:53.372628    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq" podStartSLOduration=1.372614081 podStartE2EDuration="1.372614081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:16:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:16:53.370540528 +0000 UTC m=+2205.288392052" watchObservedRunningTime="2026-07-24 19:16:53.372614081 +0000 UTC m=+2205.290465606"
Jul 24 19:17:02.672105 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:17:02.672051    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:17:02.672491 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:17:02.672120    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:17:02.684560 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:17:02.684535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:17:03.413781 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:17:03.413753    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:17:47.045579 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:17:47.045505    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"]
Jul 24 19:17:47.907450 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:17:47.907410    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"]
Jul 24 19:18:02.064023 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.063959    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl" podUID="33e092ec-591d-4d32-8a56-2fda8c74e2f6" containerName="main" containerID="cri-o://fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07" gracePeriod=45
Jul 24 19:18:02.313217 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.313193    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:18:02.454874 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.454844    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tmp-dir\") pod \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") "
Jul 24 19:18:02.454874 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.454876    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ckb9\" (UniqueName: \"kubernetes.io/projected/33e092ec-591d-4d32-8a56-2fda8c74e2f6-kube-api-access-9ckb9\") pod \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") "
Jul 24 19:18:02.455128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.454901    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-dshm\") pod \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") "
Jul 24 19:18:02.455128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.454922    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-model-cache\") pod \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") "
Jul 24 19:18:02.455128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455016    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tls-certs\") pod \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") "
Jul 24 19:18:02.455128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455040    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-home\") pod \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\" (UID: \"33e092ec-591d-4d32-8a56-2fda8c74e2f6\") "
Jul 24 19:18:02.455351 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455173    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33e092ec-591d-4d32-8a56-2fda8c74e2f6" (UID: "33e092ec-591d-4d32-8a56-2fda8c74e2f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:02.455351 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455259    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "33e092ec-591d-4d32-8a56-2fda8c74e2f6" (UID: "33e092ec-591d-4d32-8a56-2fda8c74e2f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:02.455447 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455348    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:02.455447 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455397    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:02.455447 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.455414    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-home" (OuterVolumeSpecName: "home") pod "33e092ec-591d-4d32-8a56-2fda8c74e2f6" (UID: "33e092ec-591d-4d32-8a56-2fda8c74e2f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:02.457212 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.457187    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-dshm" (OuterVolumeSpecName: "dshm") pod "33e092ec-591d-4d32-8a56-2fda8c74e2f6" (UID: "33e092ec-591d-4d32-8a56-2fda8c74e2f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:02.457320 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.457253    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e092ec-591d-4d32-8a56-2fda8c74e2f6-kube-api-access-9ckb9" (OuterVolumeSpecName: "kube-api-access-9ckb9") pod "33e092ec-591d-4d32-8a56-2fda8c74e2f6" (UID: "33e092ec-591d-4d32-8a56-2fda8c74e2f6"). InnerVolumeSpecName "kube-api-access-9ckb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:18:02.457320 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.457254    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33e092ec-591d-4d32-8a56-2fda8c74e2f6" (UID: "33e092ec-591d-4d32-8a56-2fda8c74e2f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:18:02.556820 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.556784    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:02.556820 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.556816    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e092ec-591d-4d32-8a56-2fda8c74e2f6-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:02.556820 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.556826    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e092ec-591d-4d32-8a56-2fda8c74e2f6-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:02.556991 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.556834    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ckb9\" (UniqueName: \"kubernetes.io/projected/33e092ec-591d-4d32-8a56-2fda8c74e2f6-kube-api-access-9ckb9\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:02.701037 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.701009    2584 generic.go:356] "Generic (PLEG): container finished" podID="33e092ec-591d-4d32-8a56-2fda8c74e2f6" containerID="fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07" exitCode=0
Jul 24 19:18:02.701156 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.701053    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"
Jul 24 19:18:02.701156 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.701072    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl" event={"ID":"33e092ec-591d-4d32-8a56-2fda8c74e2f6","Type":"ContainerDied","Data":"fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07"}
Jul 24 19:18:02.701246 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.701188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl" event={"ID":"33e092ec-591d-4d32-8a56-2fda8c74e2f6","Type":"ContainerDied","Data":"5a53288a68afa83f99a785a719c7f65656d3c3629d29d57196eb16f71f4e0b84"}
Jul 24 19:18:02.701246 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.701214    2584 scope.go:117] "RemoveContainer" containerID="fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07"
Jul 24 19:18:02.709671 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.709652    2584 scope.go:117] "RemoveContainer" containerID="fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07"
Jul 24 19:18:02.709909 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:18:02.709893    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07\": container with ID starting with fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07 not found: ID does not exist" containerID="fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07"
Jul 24 19:18:02.709962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.709917    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07"} err="failed to get container status \"fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07\": rpc error: code = NotFound desc = could not find container \"fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07\": container with ID starting with fa22b5baea7131e8dd9e27974a043833ba5884f084afc193ca3fdebd70220a07 not found: ID does not exist"
Jul 24 19:18:02.718799 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.718780    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"]
Jul 24 19:18:02.722450 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.722430    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2ee838/test-model-2ee838-kserve-777c69f4f5-9phwl"]
Jul 24 19:18:02.926074 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:02.926020    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq" podUID="2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" containerName="main" containerID="cri-o://ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d" gracePeriod=45
Jul 24 19:18:03.174908 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.174887    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:18:03.263013 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.262991    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-home\") pod \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") "
Jul 24 19:18:03.263155 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263100    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmkkg\" (UniqueName: \"kubernetes.io/projected/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-kube-api-access-rmkkg\") pod \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") "
Jul 24 19:18:03.263200 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263161    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tls-certs\") pod \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") "
Jul 24 19:18:03.263200 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263188    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tmp-dir\") pod \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") "
Jul 24 19:18:03.263279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263241    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-dshm\") pod \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") "
Jul 24 19:18:03.263279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263246    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-home" (OuterVolumeSpecName: "home") pod "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" (UID: "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:03.263279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263275    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-model-cache\") pod \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\" (UID: \"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b\") "
Jul 24 19:18:03.263444 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263417    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" (UID: "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:03.263542 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263527    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:03.263603 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263544    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:03.263663 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.263634    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" (UID: "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:03.265350 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.265330    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-dshm" (OuterVolumeSpecName: "dshm") pod "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" (UID: "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:18:03.265527 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.265507    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-kube-api-access-rmkkg" (OuterVolumeSpecName: "kube-api-access-rmkkg") pod "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" (UID: "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b"). InnerVolumeSpecName "kube-api-access-rmkkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:18:03.265596 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.265552    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" (UID: "2c0c8b3d-f9e6-40f4-ab1a-f499653af04b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:18:03.364633 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.364602    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmkkg\" (UniqueName: \"kubernetes.io/projected/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-kube-api-access-rmkkg\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:03.364633 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.364627    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:03.364633 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.364636    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:03.364851 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.364644    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:03.708390 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.708300    2584 generic.go:356] "Generic (PLEG): container finished" podID="2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" containerID="ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d" exitCode=0
Jul 24 19:18:03.708390 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.708331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq" event={"ID":"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b","Type":"ContainerDied","Data":"ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d"}
Jul 24 19:18:03.708390 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.708356    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"
Jul 24 19:18:03.708390 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.708376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq" event={"ID":"2c0c8b3d-f9e6-40f4-ab1a-f499653af04b","Type":"ContainerDied","Data":"ea097ff38df8c6fc56c03758e6b5a25f4e935e61127eb83df7cc3d64bf6a60d2"}
Jul 24 19:18:03.708727 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.708395    2584 scope.go:117] "RemoveContainer" containerID="ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d"
Jul 24 19:18:03.717967 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.717951    2584 scope.go:117] "RemoveContainer" containerID="ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d"
Jul 24 19:18:03.718245 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:18:03.718227    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d\": container with ID starting with ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d not found: ID does not exist" containerID="ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d"
Jul 24 19:18:03.718308 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.718252    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d"} err="failed to get container status \"ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d\": rpc error: code = NotFound desc = could not find container \"ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d\": container with ID starting with ba6fa3266a4e064508d0ab97e811056754b17a25c7b8e463bb9768820b10496d not found: ID does not exist"
Jul 24 19:18:03.730901 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.730880    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"]
Jul 24 19:18:03.733170 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:03.733150    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-31c4fa/test-model-31c4fa-kserve-7bbd6d8d7c-v7kdq"]
Jul 24 19:18:04.574114 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:04.574072    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" path="/var/lib/kubelet/pods/2c0c8b3d-f9e6-40f4-ab1a-f499653af04b/volumes"
Jul 24 19:18:04.574583 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:04.574464    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e092ec-591d-4d32-8a56-2fda8c74e2f6" path="/var/lib/kubelet/pods/33e092ec-591d-4d32-8a56-2fda8c74e2f6/volumes"
Jul 24 19:18:10.105272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105238    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"]
Jul 24 19:18:10.105640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105585    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e092ec-591d-4d32-8a56-2fda8c74e2f6" containerName="main"
Jul 24 19:18:10.105640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105596    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e092ec-591d-4d32-8a56-2fda8c74e2f6" containerName="main"
Jul 24 19:18:10.105640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105615    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" containerName="main"
Jul 24 19:18:10.105640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105620    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" containerName="main"
Jul 24 19:18:10.105779 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105674    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0c8b3d-f9e6-40f4-ab1a-f499653af04b" containerName="main"
Jul 24 19:18:10.105779 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.105685    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e092ec-591d-4d32-8a56-2fda8c74e2f6" containerName="main"
Jul 24 19:18:10.110300 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.110277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:10.113285 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.113260    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:18:10.114641 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.114618    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:18:10.116108 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.116084    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"]
Jul 24 19:18:10.217423 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.217390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eca93f2c-2187-479f-ab2e-9bc7f39f13d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf\" (UID: \"eca93f2c-2187-479f-ab2e-9bc7f39f13d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:10.318357 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.318324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eca93f2c-2187-479f-ab2e-9bc7f39f13d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf\" (UID: \"eca93f2c-2187-479f-ab2e-9bc7f39f13d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:10.318985 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.318958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eca93f2c-2187-479f-ab2e-9bc7f39f13d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf\" (UID: \"eca93f2c-2187-479f-ab2e-9bc7f39f13d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:10.423009 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.422938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:10.559592 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.559566    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"]
Jul 24 19:18:10.561263 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:18:10.561239    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca93f2c_2187_479f_ab2e_9bc7f39f13d4.slice/crio-1dbc7e9c83812b00b7fea06111d072acc8ee36a665fa58cb1aea196830c9948c WatchSource:0}: Error finding container 1dbc7e9c83812b00b7fea06111d072acc8ee36a665fa58cb1aea196830c9948c: Status 404 returned error can't find the container with id 1dbc7e9c83812b00b7fea06111d072acc8ee36a665fa58cb1aea196830c9948c
Jul 24 19:18:10.747188 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:10.747098    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf" event={"ID":"eca93f2c-2187-479f-ab2e-9bc7f39f13d4","Type":"ContainerStarted","Data":"1dbc7e9c83812b00b7fea06111d072acc8ee36a665fa58cb1aea196830c9948c"}
Jul 24 19:18:11.754011 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:11.753980    2584 generic.go:356] "Generic (PLEG): container finished" podID="eca93f2c-2187-479f-ab2e-9bc7f39f13d4" containerID="9fe074af3073e331eddf18db5e3ae739955a34cb9e48af3eb1b81c52cefab397" exitCode=0
Jul 24 19:18:11.754011 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:11.754016    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf" event={"ID":"eca93f2c-2187-479f-ab2e-9bc7f39f13d4","Type":"ContainerDied","Data":"9fe074af3073e331eddf18db5e3ae739955a34cb9e48af3eb1b81c52cefab397"}
Jul 24 19:18:12.890415 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:12.890392    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:13.038265 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:13.038197    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eca93f2c-2187-479f-ab2e-9bc7f39f13d4-maas-api-service-ca\") pod \"eca93f2c-2187-479f-ab2e-9bc7f39f13d4\" (UID: \"eca93f2c-2187-479f-ab2e-9bc7f39f13d4\") "
Jul 24 19:18:13.038491 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:13.038469    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eca93f2c-2187-479f-ab2e-9bc7f39f13d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eca93f2c-2187-479f-ab2e-9bc7f39f13d4" (UID: "eca93f2c-2187-479f-ab2e-9bc7f39f13d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:18:13.139029 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:13.139006    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eca93f2c-2187-479f-ab2e-9bc7f39f13d4-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:18:13.765008 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:13.764978    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"
Jul 24 19:18:13.765193 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:13.765008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf" event={"ID":"eca93f2c-2187-479f-ab2e-9bc7f39f13d4","Type":"ContainerDied","Data":"1dbc7e9c83812b00b7fea06111d072acc8ee36a665fa58cb1aea196830c9948c"}
Jul 24 19:18:13.765193 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:13.765078    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dbc7e9c83812b00b7fea06111d072acc8ee36a665fa58cb1aea196830c9948c"
Jul 24 19:18:25.187980 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:25.187935    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"]
Jul 24 19:18:25.190739 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:25.190717    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-31c4fa-92xcf"]
Jul 24 19:18:26.574240 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:26.574208    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca93f2c-2187-479f-ab2e-9bc7f39f13d4" path="/var/lib/kubelet/pods/eca93f2c-2187-479f-ab2e-9bc7f39f13d4/volumes"
Jul 24 19:18:32.501433 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.501399    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"]
Jul 24 19:18:32.501804 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.501796    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca93f2c-2187-479f-ab2e-9bc7f39f13d4" containerName="revoke-keys"
Jul 24 19:18:32.501866 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.501808    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca93f2c-2187-479f-ab2e-9bc7f39f13d4" containerName="revoke-keys"
Jul 24 19:18:32.501906 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.501872    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca93f2c-2187-479f-ab2e-9bc7f39f13d4" containerName="revoke-keys"
Jul 24 19:18:32.505281 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.505263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.508666 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.508645    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5e9947-openshift-default-dockercfg-mvhqc\""
Jul 24 19:18:32.522170 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.522135    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"]
Jul 24 19:18:32.695091 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695036    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-socket\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695097    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istiod-ca-cert\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmcxb\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-kube-api-access-gmcxb\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695159    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-envoy\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695250    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-data\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695296    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-podinfo\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695542 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-credential-socket\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695542 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-token\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.695542 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.695437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-certs\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796701 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-envoy\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796701 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796653    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-data\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796701 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-podinfo\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796958 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796738    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-credential-socket\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796958 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-token\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796958 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796819    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-certs\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796958 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796878    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-socket\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.796958 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istiod-ca-cert\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.797245 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.796962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcxb\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-kube-api-access-gmcxb\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.797245 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.797090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-data\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.797245 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.797176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-credential-socket\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.797406 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.797388    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-certs\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.797468 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.797444    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-socket\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.797778 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.797756    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istiod-ca-cert\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.799007 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.798984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-envoy\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.799153 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.799135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-podinfo\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.805175 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.805156    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-token\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.805387 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.805364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmcxb\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-kube-api-access-gmcxb\") pod \"e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") " pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.816172 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.816148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:32.954394 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.954361    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"]
Jul 24 19:18:32.955532 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:18:32.955504    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f9e20e_abd8_4ddb_870d_4998a1e17039.slice/crio-e2b3e65e65b745791b7bb4c76cc933328c3031abf8e35c0295809f1e42568ba0 WatchSource:0}: Error finding container e2b3e65e65b745791b7bb4c76cc933328c3031abf8e35c0295809f1e42568ba0: Status 404 returned error can't find the container with id e2b3e65e65b745791b7bb4c76cc933328c3031abf8e35c0295809f1e42568ba0
Jul 24 19:18:32.957735 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.957697    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:32.957815 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.957787    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:32.957858 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:32.957831    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:33.871865 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:33.871835    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" event={"ID":"b1f9e20e-abd8-4ddb-870d-4998a1e17039","Type":"ContainerStarted","Data":"46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"}
Jul 24 19:18:33.872325 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:33.871890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" event={"ID":"b1f9e20e-abd8-4ddb-870d-4998a1e17039","Type":"ContainerStarted","Data":"e2b3e65e65b745791b7bb4c76cc933328c3031abf8e35c0295809f1e42568ba0"}
Jul 24 19:18:33.893886 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:33.893840    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podStartSLOduration=1.893825796 podStartE2EDuration="1.893825796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:18:33.891788099 +0000 UTC m=+2305.809639625" watchObservedRunningTime="2026-07-24 19:18:33.893825796 +0000 UTC m=+2305.811677320"
Jul 24 19:18:34.816673 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:34.816642    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:34.821018 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:34.820994    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:34.877818 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:34.877792    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:34.878585 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:34.878566    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:50.501955 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.501745    2584 patch_prober.go:28] interesting pod/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:52506->10.133.0.52:15021: read: connection reset by peer" start-of-body=
Jul 24 19:18:50.501955 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.501832    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:52506->10.133.0.52:15021: read: connection reset by peer"
Jul 24 19:18:50.969655 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.969624    2584 generic.go:356] "Generic (PLEG): container finished" podID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerID="46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6" exitCode=0
Jul 24 19:18:50.969814 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.969705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" event={"ID":"b1f9e20e-abd8-4ddb-870d-4998a1e17039","Type":"ContainerDied","Data":"46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"}
Jul 24 19:18:50.970073 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.970041    2584 scope.go:117] "RemoveContainer" containerID="46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"
Jul 24 19:18:50.971034 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.971009    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:50.971130 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.971100    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:50.971171 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:50.971134    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:18:51.980544 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:51.980490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" event={"ID":"b1f9e20e-abd8-4ddb-870d-4998a1e17039","Type":"ContainerStarted","Data":"63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b"}
Jul 24 19:18:52.817003 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:52.816966    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:52.817220 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:52.817200    2584 patch_prober.go:28] interesting pod/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:18:52.817269 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:52.817248    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 19:18:53.817146 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:53.817106    2584 patch_prober.go:28] interesting pod/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:18:53.817527 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:53.817159    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 19:18:54.816795 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:54.816757    2584 patch_prober.go:28] interesting pod/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:18:54.816973 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:54.816808    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 19:18:55.816752 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:55.816712    2584 patch_prober.go:28] interesting pod/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 24 19:18:55.817187 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:55.816768    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 24 19:18:56.820435 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:56.820403    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:56.820800 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:56.820755    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:18:56.821497 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:18:56.821479    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:19:23.200403 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:23.200370    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"]
Jul 24 19:19:23.200926 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:23.200619    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" containerID="cri-o://63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b" gracePeriod=30
Jul 24 19:19:26.822832 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:26.822793    2584 patch_prober.go:28] interesting pod/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:19:26.823214 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:26.822857    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:19:28.446455 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.446432    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:19:28.477314 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477262    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-certs\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477438 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-envoy\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477438 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477369    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-credential-socket\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477438 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477404    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-token\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477438 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477432    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmcxb\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-kube-api-access-gmcxb\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477658 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477473    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-socket\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477658 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477497    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-podinfo\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477658 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477510    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:28.477658 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477541    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istiod-ca-cert\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477658 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477568    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-data\") pod \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\" (UID: \"b1f9e20e-abd8-4ddb-870d-4998a1e17039\") "
Jul 24 19:19:28.477917 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477706    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:28.477917 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477699    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:28.478038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477939    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.478038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477956    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.478038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477970    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.478038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.477987    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:19:28.478390 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.478371    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:28.479687 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.479663    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:19:28.479900 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.479872    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:19:28.479982 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.479916    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-kube-api-access-gmcxb" (OuterVolumeSpecName: "kube-api-access-gmcxb") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "kube-api-access-gmcxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:19:28.480159 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.480142    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1f9e20e-abd8-4ddb-870d-4998a1e17039" (UID: "b1f9e20e-abd8-4ddb-870d-4998a1e17039"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:19:28.578711 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.578674    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.578844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.578717    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.578844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.578738    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmcxb\" (UniqueName: \"kubernetes.io/projected/b1f9e20e-abd8-4ddb-870d-4998a1e17039-kube-api-access-gmcxb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.578844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.578760    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.578844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.578774    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:28.578844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:28.578786    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1f9e20e-abd8-4ddb-870d-4998a1e17039-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:19:29.172232 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.172196    2584 generic.go:356] "Generic (PLEG): container finished" podID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerID="63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b" exitCode=0
Jul 24 19:19:29.172399 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.172259    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"
Jul 24 19:19:29.172399 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.172281    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" event={"ID":"b1f9e20e-abd8-4ddb-870d-4998a1e17039","Type":"ContainerDied","Data":"63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b"}
Jul 24 19:19:29.172399 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.172339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm" event={"ID":"b1f9e20e-abd8-4ddb-870d-4998a1e17039","Type":"ContainerDied","Data":"e2b3e65e65b745791b7bb4c76cc933328c3031abf8e35c0295809f1e42568ba0"}
Jul 24 19:19:29.172399 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.172361    2584 scope.go:117] "RemoveContainer" containerID="63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b"
Jul 24 19:19:29.181250 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.181233    2584 scope.go:117] "RemoveContainer" containerID="46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"
Jul 24 19:19:29.193987 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.193962    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"]
Jul 24 19:19:29.194822 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.194799    2584 scope.go:117] "RemoveContainer" containerID="63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b"
Jul 24 19:19:29.195106 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:19:29.195084    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b\": container with ID starting with 63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b not found: ID does not exist" containerID="63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b"
Jul 24 19:19:29.195174 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.195114    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b"} err="failed to get container status \"63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b\": rpc error: code = NotFound desc = could not find container \"63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b\": container with ID starting with 63fc4720396fa4018fa182fe69da83ac42ec3e6e018fa47d245681981c7b982b not found: ID does not exist"
Jul 24 19:19:29.195174 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.195137    2584 scope.go:117] "RemoveContainer" containerID="46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"
Jul 24 19:19:29.195383 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:19:29.195365    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6\": container with ID starting with 46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6 not found: ID does not exist" containerID="46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"
Jul 24 19:19:29.195434 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.195388    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6"} err="failed to get container status \"46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6\": rpc error: code = NotFound desc = could not find container \"46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6\": container with ID starting with 46497b3704f28cf0d029b05015a5e8cfca9863b4708e9190e10bc994ebfac1e6 not found: ID does not exist"
Jul 24 19:19:29.196097 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:29.196078    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5e9947-openshift-default-574b4b65c8-m9cvm"]
Jul 24 19:19:30.573690 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:30.573657    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" path="/var/lib/kubelet/pods/b1f9e20e-abd8-4ddb-870d-4998a1e17039/volumes"
Jul 24 19:19:59.605273 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605241    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"]
Jul 24 19:19:59.605838 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605797    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy"
Jul 24 19:19:59.605838 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605816    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy"
Jul 24 19:19:59.605965 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605842    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy"
Jul 24 19:19:59.605965 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605850    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy"
Jul 24 19:19:59.605965 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605929    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy"
Jul 24 19:19:59.605965 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.605946    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f9e20e-abd8-4ddb-870d-4998a1e17039" containerName="istio-proxy"
Jul 24 19:19:59.609067 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.609035    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.612566 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.612547    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d391c5-openshift-default-dockercfg-knrcz\""
Jul 24 19:19:59.628390 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.628366    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"]
Jul 24 19:19:59.731264 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731242    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-credential-socket\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731391 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731278    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-socket\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731391 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731301    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-certs\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731391 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731320    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-token\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731391 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731360    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdtxc\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-kube-api-access-hdtxc\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731391 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-podinfo\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731561 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731417    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-data\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731561 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731440    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9248b57-4dce-4df8-adeb-cf892c781c52-istiod-ca-cert\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.731561 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.731467    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-envoy\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832115 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832082    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-credential-socket\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-socket\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832147    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-certs\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-token\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdtxc\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-kube-api-access-hdtxc\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-podinfo\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-data\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832249    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9248b57-4dce-4df8-adeb-cf892c781c52-istiod-ca-cert\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832637 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-envoy\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832637 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832511    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-credential-socket\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832637 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-socket\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832637 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832578    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-data\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832795    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-certs\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.832983 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.832958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9248b57-4dce-4df8-adeb-cf892c781c52-istiod-ca-cert\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.834592 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.834571    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-envoy\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.834776 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.834758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-podinfo\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.840214 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.840193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-token\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.840369 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.840353    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdtxc\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-kube-api-access-hdtxc\") pod \"e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") " pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:19:59.920638 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:19:59.920579    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:00.075973 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.075939    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"]
Jul 24 19:20:00.077085 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:20:00.077046    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9248b57_4dce_4df8_adeb_cf892c781c52.slice/crio-89eb657c4647931398dc5b5c28df9c5c2faa523f40239923db3181f6dc25d6b5 WatchSource:0}: Error finding container 89eb657c4647931398dc5b5c28df9c5c2faa523f40239923db3181f6dc25d6b5: Status 404 returned error can't find the container with id 89eb657c4647931398dc5b5c28df9c5c2faa523f40239923db3181f6dc25d6b5
Jul 24 19:20:00.079331 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.079293    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:00.079416 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.079388    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:00.079456 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.079434    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:00.333398 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.333315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" event={"ID":"d9248b57-4dce-4df8-adeb-cf892c781c52","Type":"ContainerStarted","Data":"5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"}
Jul 24 19:20:00.333398 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.333368    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" event={"ID":"d9248b57-4dce-4df8-adeb-cf892c781c52","Type":"ContainerStarted","Data":"89eb657c4647931398dc5b5c28df9c5c2faa523f40239923db3181f6dc25d6b5"}
Jul 24 19:20:00.352073 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.352009    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" podStartSLOduration=1.351993043 podStartE2EDuration="1.351993043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:20:00.351582228 +0000 UTC m=+2392.269433761" watchObservedRunningTime="2026-07-24 19:20:00.351993043 +0000 UTC m=+2392.269844565"
Jul 24 19:20:00.921651 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:00.921601    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:01.926468 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:01.926439    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:02.345091 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:02.345039    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:02.346035 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:02.346003    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:14.418766 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:14.418729    2584 generic.go:356] "Generic (PLEG): container finished" podID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerID="5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb" exitCode=0
Jul 24 19:20:14.419192 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:14.418810    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" event={"ID":"d9248b57-4dce-4df8-adeb-cf892c781c52","Type":"ContainerDied","Data":"5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"}
Jul 24 19:20:14.419192 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:14.419186    2584 scope.go:117] "RemoveContainer" containerID="5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"
Jul 24 19:20:14.420126 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:14.420099    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:14.420233 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:14.420162    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:14.420233 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:14.420194    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:20:15.427876 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:15.427838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" event={"ID":"d9248b57-4dce-4df8-adeb-cf892c781c52","Type":"ContainerStarted","Data":"35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93"}
Jul 24 19:20:15.921005 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:15.920972    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:15.922193 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:15.922163    2584 patch_prober.go:28] interesting pod/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:20:15.922310 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:15.922213    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:20:16.921763 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:16.921729    2584 patch_prober.go:28] interesting pod/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:20:16.922199 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:16.921779    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:20:17.344955 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:17.344928    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:17.921044 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:17.921009    2584 patch_prober.go:28] interesting pod/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:20:17.921225 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:17.921080    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:20:18.921125 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:18.921087    2584 patch_prober.go:28] interesting pod/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:20:18.921500 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:18.921141    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:20:19.924516 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:19.924485    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:19.925445 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:19.925423    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:20:45.661084 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.661000    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"]
Jul 24 19:20:45.664485 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.664469    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.670162 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.670129    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"auth-test-model-d391c5-kserve-self-signed-certs\""
Jul 24 19:20:45.670162 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.670129    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"default-dockercfg-2gq2j\""
Jul 24 19:20:45.670352 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.670248    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"kube-root-ca.crt\""
Jul 24 19:20:45.670417 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.670381    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"openshift-service-ca.crt\""
Jul 24 19:20:45.675268 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.675244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"]
Jul 24 19:20:45.710936 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.710910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-home\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.711070 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.710958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-model-cache\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.711070 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.710984    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-tmp-dir\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.711162 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.711095    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8nlp\" (UniqueName: \"kubernetes.io/projected/d37aec8e-7998-4450-a0a0-3a10d1536b82-kube-api-access-c8nlp\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.711162 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.711126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37aec8e-7998-4450-a0a0-3a10d1536b82-tls-certs\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.711248 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.711229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-dshm\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812444 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-dshm\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812444 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-home\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812631 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-model-cache\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812631 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812491    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-tmp-dir\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812631 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8nlp\" (UniqueName: \"kubernetes.io/projected/d37aec8e-7998-4450-a0a0-3a10d1536b82-kube-api-access-c8nlp\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812631 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37aec8e-7998-4450-a0a0-3a10d1536b82-tls-certs\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812898 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-home\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812898 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812845    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-model-cache\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.812969 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.812945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-tmp-dir\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.814661 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.814643    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-dshm\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.815164 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.815147    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37aec8e-7998-4450-a0a0-3a10d1536b82-tls-certs\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.821513 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.821492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8nlp\" (UniqueName: \"kubernetes.io/projected/d37aec8e-7998-4450-a0a0-3a10d1536b82-kube-api-access-c8nlp\") pod \"auth-test-model-d391c5-kserve-5c6f4869b7-7xshq\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") " pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:45.974253 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:45.974173    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:46.100869 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:46.100843    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"]
Jul 24 19:20:46.102468 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:20:46.102438    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd37aec8e_7998_4450_a0a0_3a10d1536b82.slice/crio-c6ca853a6bbec694a17f32a7fad82e6b99a4b7ec12b303c1e8d859f6953fb7d7 WatchSource:0}: Error finding container c6ca853a6bbec694a17f32a7fad82e6b99a4b7ec12b303c1e8d859f6953fb7d7: Status 404 returned error can't find the container with id c6ca853a6bbec694a17f32a7fad82e6b99a4b7ec12b303c1e8d859f6953fb7d7
Jul 24 19:20:46.596628 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:46.596595    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq" event={"ID":"d37aec8e-7998-4450-a0a0-3a10d1536b82","Type":"ContainerStarted","Data":"a8844a2cf68cb5fd07bd612fc0e788be8bc02121233daf38596f10a05770dc81"}
Jul 24 19:20:46.596628 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:46.596632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq" event={"ID":"d37aec8e-7998-4450-a0a0-3a10d1536b82","Type":"ContainerStarted","Data":"c6ca853a6bbec694a17f32a7fad82e6b99a4b7ec12b303c1e8d859f6953fb7d7"}
Jul 24 19:20:46.617349 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:46.617308    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq" podStartSLOduration=1.617292513 podStartE2EDuration="1.617292513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:20:46.615680434 +0000 UTC m=+2438.533531961" watchObservedRunningTime="2026-07-24 19:20:46.617292513 +0000 UTC m=+2438.535144071"
Jul 24 19:20:55.975184 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:55.975141    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:55.975657 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:55.975194    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:55.987378 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:55.987355    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:20:56.666222 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:20:56.666186    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:23:02.143919 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:02.143886    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"]
Jul 24 19:23:17.162649 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.162611    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq" podUID="d37aec8e-7998-4450-a0a0-3a10d1536b82" containerName="main" containerID="cri-o://a8844a2cf68cb5fd07bd612fc0e788be8bc02121233daf38596f10a05770dc81" gracePeriod=45
Jul 24 19:23:17.395282 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.395253    2584 generic.go:356] "Generic (PLEG): container finished" podID="d37aec8e-7998-4450-a0a0-3a10d1536b82" containerID="a8844a2cf68cb5fd07bd612fc0e788be8bc02121233daf38596f10a05770dc81" exitCode=0
Jul 24 19:23:17.395398 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.395312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq" event={"ID":"d37aec8e-7998-4450-a0a0-3a10d1536b82","Type":"ContainerDied","Data":"a8844a2cf68cb5fd07bd612fc0e788be8bc02121233daf38596f10a05770dc81"}
Jul 24 19:23:17.413966 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.413908    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:23:17.469781 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.469754    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37aec8e-7998-4450-a0a0-3a10d1536b82-tls-certs\") pod \"d37aec8e-7998-4450-a0a0-3a10d1536b82\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") "
Jul 24 19:23:17.469918 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.469791    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-model-cache\") pod \"d37aec8e-7998-4450-a0a0-3a10d1536b82\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") "
Jul 24 19:23:17.469918 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.469837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8nlp\" (UniqueName: \"kubernetes.io/projected/d37aec8e-7998-4450-a0a0-3a10d1536b82-kube-api-access-c8nlp\") pod \"d37aec8e-7998-4450-a0a0-3a10d1536b82\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") "
Jul 24 19:23:17.470038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.469933    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-home\") pod \"d37aec8e-7998-4450-a0a0-3a10d1536b82\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") "
Jul 24 19:23:17.470038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.469964    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-tmp-dir\") pod \"d37aec8e-7998-4450-a0a0-3a10d1536b82\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") "
Jul 24 19:23:17.470038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470010    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-dshm\") pod \"d37aec8e-7998-4450-a0a0-3a10d1536b82\" (UID: \"d37aec8e-7998-4450-a0a0-3a10d1536b82\") "
Jul 24 19:23:17.470225 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470162    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-model-cache" (OuterVolumeSpecName: "model-cache") pod "d37aec8e-7998-4450-a0a0-3a10d1536b82" (UID: "d37aec8e-7998-4450-a0a0-3a10d1536b82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:17.470279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470251    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-home" (OuterVolumeSpecName: "home") pod "d37aec8e-7998-4450-a0a0-3a10d1536b82" (UID: "d37aec8e-7998-4450-a0a0-3a10d1536b82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:17.470320 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d37aec8e-7998-4450-a0a0-3a10d1536b82" (UID: "d37aec8e-7998-4450-a0a0-3a10d1536b82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:17.470441 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470420    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:23:17.470522 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470464    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:23:17.470522 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.470480    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:23:17.472321 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.472291    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-dshm" (OuterVolumeSpecName: "dshm") pod "d37aec8e-7998-4450-a0a0-3a10d1536b82" (UID: "d37aec8e-7998-4450-a0a0-3a10d1536b82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:23:17.472451 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.472430    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37aec8e-7998-4450-a0a0-3a10d1536b82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d37aec8e-7998-4450-a0a0-3a10d1536b82" (UID: "d37aec8e-7998-4450-a0a0-3a10d1536b82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:23:17.472519 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.472492    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37aec8e-7998-4450-a0a0-3a10d1536b82-kube-api-access-c8nlp" (OuterVolumeSpecName: "kube-api-access-c8nlp") pod "d37aec8e-7998-4450-a0a0-3a10d1536b82" (UID: "d37aec8e-7998-4450-a0a0-3a10d1536b82"). InnerVolumeSpecName "kube-api-access-c8nlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:23:17.571339 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.571322    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d37aec8e-7998-4450-a0a0-3a10d1536b82-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:23:17.571429 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.571341    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d37aec8e-7998-4450-a0a0-3a10d1536b82-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:23:17.571429 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:17.571352    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8nlp\" (UniqueName: \"kubernetes.io/projected/d37aec8e-7998-4450-a0a0-3a10d1536b82-kube-api-access-c8nlp\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:23:18.401672 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:18.401645    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"
Jul 24 19:23:18.402095 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:18.401689    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq" event={"ID":"d37aec8e-7998-4450-a0a0-3a10d1536b82","Type":"ContainerDied","Data":"c6ca853a6bbec694a17f32a7fad82e6b99a4b7ec12b303c1e8d859f6953fb7d7"}
Jul 24 19:23:18.402095 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:18.401743    2584 scope.go:117] "RemoveContainer" containerID="a8844a2cf68cb5fd07bd612fc0e788be8bc02121233daf38596f10a05770dc81"
Jul 24 19:23:18.424741 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:18.424452    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"]
Jul 24 19:23:18.428668 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:18.428643    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/auth-test-model-d391c5-kserve-5c6f4869b7-7xshq"]
Jul 24 19:23:18.575468 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:18.575441    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37aec8e-7998-4450-a0a0-3a10d1536b82" path="/var/lib/kubelet/pods/d37aec8e-7998-4450-a0a0-3a10d1536b82/volumes"
Jul 24 19:23:39.949740 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.949653    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"]
Jul 24 19:23:39.950297 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.950201    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37aec8e-7998-4450-a0a0-3a10d1536b82" containerName="main"
Jul 24 19:23:39.950297 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.950221    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37aec8e-7998-4450-a0a0-3a10d1536b82" containerName="main"
Jul 24 19:23:39.950415 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.950317    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37aec8e-7998-4450-a0a0-3a10d1536b82" containerName="main"
Jul 24 19:23:39.954495 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.954474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:39.958640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.958554    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"sub-test-model-d391c5-kserve-self-signed-certs\""
Jul 24 19:23:39.958640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.958605    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"openshift-service-ca.crt\""
Jul 24 19:23:39.958640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.958620    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"kube-root-ca.crt\""
Jul 24 19:23:39.958640 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.958615    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d391c5\"/\"default-dockercfg-2gq2j\""
Jul 24 19:23:39.962425 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:39.962248    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"]
Jul 24 19:23:40.048421 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.048382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbsm\" (UniqueName: \"kubernetes.io/projected/d05b38ed-7afa-4a6b-925f-93e870744441-kube-api-access-bzbsm\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.048548 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.048428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-tmp-dir\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.048548 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.048493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-dshm\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.048548 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.048544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-home\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.048650 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.048566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-model-cache\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.048650 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.048585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d05b38ed-7afa-4a6b-925f-93e870744441-tls-certs\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.149888 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.149856    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbsm\" (UniqueName: \"kubernetes.io/projected/d05b38ed-7afa-4a6b-925f-93e870744441-kube-api-access-bzbsm\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.149898    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-tmp-dir\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.149926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-dshm\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.149971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-home\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.149997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-model-cache\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.150016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d05b38ed-7afa-4a6b-925f-93e870744441-tls-certs\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150402 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.150338    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-tmp-dir\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150402 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.150382    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-home\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.150478 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.150441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-model-cache\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.152249 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.152229    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-dshm\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.152502 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.152485    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d05b38ed-7afa-4a6b-925f-93e870744441-tls-certs\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.158367 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.158339    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbsm\" (UniqueName: \"kubernetes.io/projected/d05b38ed-7afa-4a6b-925f-93e870744441-kube-api-access-bzbsm\") pod \"sub-test-model-d391c5-kserve-fccc8d9df-js68n\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") " pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.265812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.265759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:40.403648 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.403624    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"]
Jul 24 19:23:40.405084 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:23:40.405042    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd05b38ed_7afa_4a6b_925f_93e870744441.slice/crio-c5efbbffa88fdd875352c0d94d961e60f39eec7baeaba5187b7027863e48ba31 WatchSource:0}: Error finding container c5efbbffa88fdd875352c0d94d961e60f39eec7baeaba5187b7027863e48ba31: Status 404 returned error can't find the container with id c5efbbffa88fdd875352c0d94d961e60f39eec7baeaba5187b7027863e48ba31
Jul 24 19:23:40.517370 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.517281    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n" event={"ID":"d05b38ed-7afa-4a6b-925f-93e870744441","Type":"ContainerStarted","Data":"5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb"}
Jul 24 19:23:40.517370 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.517339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n" event={"ID":"d05b38ed-7afa-4a6b-925f-93e870744441","Type":"ContainerStarted","Data":"c5efbbffa88fdd875352c0d94d961e60f39eec7baeaba5187b7027863e48ba31"}
Jul 24 19:23:40.533444 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:40.533403    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n" podStartSLOduration=1.5333876260000001 podStartE2EDuration="1.533387626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:23:40.533290032 +0000 UTC m=+2612.451141556" watchObservedRunningTime="2026-07-24 19:23:40.533387626 +0000 UTC m=+2612.451239153"
Jul 24 19:23:50.266160 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:50.266122    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:50.266630 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:50.266224    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:50.278931 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:50.278912    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:23:50.585240 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:23:50.585168    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:24:26.444716 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:26.444679    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"]
Jul 24 19:24:32.634666 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.634632    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"]
Jul 24 19:24:32.638033 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.638014    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.641991 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.641967    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"kube-root-ca.crt\""
Jul 24 19:24:32.642118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.642000    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"openshift-service-ca.crt\""
Jul 24 19:24:32.642118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.642031    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"default-dockercfg-sbqkj\""
Jul 24 19:24:32.642118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.642000    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-65184f\"/\"rate-test-model-65184f-kserve-self-signed-certs\""
Jul 24 19:24:32.646119 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.646097    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"]
Jul 24 19:24:32.671768 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.671742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-tmp-dir\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.671880 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.671772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-home\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.671880 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.671804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c38af5-32d2-4a48-b562-50513123c698-tls-certs\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.671975 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.671903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-dshm\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.672022 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.671997    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nvdt\" (UniqueName: \"kubernetes.io/projected/d2c38af5-32d2-4a48-b562-50513123c698-kube-api-access-8nvdt\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.672076 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.672041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-model-cache\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773402 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773382    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c38af5-32d2-4a48-b562-50513123c698-tls-certs\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-dshm\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773452    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nvdt\" (UniqueName: \"kubernetes.io/projected/d2c38af5-32d2-4a48-b562-50513123c698-kube-api-access-8nvdt\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-model-cache\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773641 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773513    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-tmp-dir\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773641 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-home\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773917 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773890    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-home\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.773917 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-model-cache\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.774105 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.773951    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-tmp-dir\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.775658 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.775633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-dshm\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.776101 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.776079    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c38af5-32d2-4a48-b562-50513123c698-tls-certs\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.780948 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.780929    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nvdt\" (UniqueName: \"kubernetes.io/projected/d2c38af5-32d2-4a48-b562-50513123c698-kube-api-access-8nvdt\") pod \"rate-test-model-65184f-kserve-64c9787d8c-skn4j\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") " pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:32.948328 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:32.948259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:33.082417 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:33.082390    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"]
Jul 24 19:24:33.083471 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:24:33.083438    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2c38af5_32d2_4a48_b562_50513123c698.slice/crio-ad3cdf7cf709ad52b4135e5543d3ded1ea8a42d0ad0b6b9a4be3d27c8fa428f5 WatchSource:0}: Error finding container ad3cdf7cf709ad52b4135e5543d3ded1ea8a42d0ad0b6b9a4be3d27c8fa428f5: Status 404 returned error can't find the container with id ad3cdf7cf709ad52b4135e5543d3ded1ea8a42d0ad0b6b9a4be3d27c8fa428f5
Jul 24 19:24:33.812326 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:33.812291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j" event={"ID":"d2c38af5-32d2-4a48-b562-50513123c698","Type":"ContainerStarted","Data":"b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301"}
Jul 24 19:24:33.812691 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:33.812337    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j" event={"ID":"d2c38af5-32d2-4a48-b562-50513123c698","Type":"ContainerStarted","Data":"ad3cdf7cf709ad52b4135e5543d3ded1ea8a42d0ad0b6b9a4be3d27c8fa428f5"}
Jul 24 19:24:33.829707 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:33.829658    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j" podStartSLOduration=1.8296441890000001 podStartE2EDuration="1.829644189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:24:33.827237261 +0000 UTC m=+2665.745088786" watchObservedRunningTime="2026-07-24 19:24:33.829644189 +0000 UTC m=+2665.747495714"
Jul 24 19:24:41.463439 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.463395    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n" podUID="d05b38ed-7afa-4a6b-925f-93e870744441" containerName="main" containerID="cri-o://5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb" gracePeriod=45
Jul 24 19:24:41.707541 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.707516    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:24:41.748832 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.748753    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzbsm\" (UniqueName: \"kubernetes.io/projected/d05b38ed-7afa-4a6b-925f-93e870744441-kube-api-access-bzbsm\") pod \"d05b38ed-7afa-4a6b-925f-93e870744441\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") "
Jul 24 19:24:41.748832 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.748801    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-model-cache\") pod \"d05b38ed-7afa-4a6b-925f-93e870744441\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") "
Jul 24 19:24:41.748832 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.748833    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-tmp-dir\") pod \"d05b38ed-7afa-4a6b-925f-93e870744441\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") "
Jul 24 19:24:41.749124 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.748872    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-dshm\") pod \"d05b38ed-7afa-4a6b-925f-93e870744441\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") "
Jul 24 19:24:41.749124 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.748905    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-home\") pod \"d05b38ed-7afa-4a6b-925f-93e870744441\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") "
Jul 24 19:24:41.749124 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.748928    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d05b38ed-7afa-4a6b-925f-93e870744441-tls-certs\") pod \"d05b38ed-7afa-4a6b-925f-93e870744441\" (UID: \"d05b38ed-7afa-4a6b-925f-93e870744441\") "
Jul 24 19:24:41.749301 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.749131    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-model-cache" (OuterVolumeSpecName: "model-cache") pod "d05b38ed-7afa-4a6b-925f-93e870744441" (UID: "d05b38ed-7afa-4a6b-925f-93e870744441"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.749301 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.749146    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d05b38ed-7afa-4a6b-925f-93e870744441" (UID: "d05b38ed-7afa-4a6b-925f-93e870744441"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.749413 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.749311    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-home" (OuterVolumeSpecName: "home") pod "d05b38ed-7afa-4a6b-925f-93e870744441" (UID: "d05b38ed-7afa-4a6b-925f-93e870744441"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.749413 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.749364    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.749413 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.749404    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.751033 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.750986    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d05b38ed-7afa-4a6b-925f-93e870744441-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d05b38ed-7afa-4a6b-925f-93e870744441" (UID: "d05b38ed-7afa-4a6b-925f-93e870744441"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:24:41.751182 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.751052    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d05b38ed-7afa-4a6b-925f-93e870744441-kube-api-access-bzbsm" (OuterVolumeSpecName: "kube-api-access-bzbsm") pod "d05b38ed-7afa-4a6b-925f-93e870744441" (UID: "d05b38ed-7afa-4a6b-925f-93e870744441"). InnerVolumeSpecName "kube-api-access-bzbsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:24:41.751456 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.751436    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-dshm" (OuterVolumeSpecName: "dshm") pod "d05b38ed-7afa-4a6b-925f-93e870744441" (UID: "d05b38ed-7afa-4a6b-925f-93e870744441"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:24:41.850811 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.850779    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzbsm\" (UniqueName: \"kubernetes.io/projected/d05b38ed-7afa-4a6b-925f-93e870744441-kube-api-access-bzbsm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.850811 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.850801    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.850811 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.850815    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d05b38ed-7afa-4a6b-925f-93e870744441-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.851015 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.850828    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d05b38ed-7afa-4a6b-925f-93e870744441-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:24:41.852921 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.852896    2584 generic.go:356] "Generic (PLEG): container finished" podID="d05b38ed-7afa-4a6b-925f-93e870744441" containerID="5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb" exitCode=0
Jul 24 19:24:41.853024 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.852944    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"
Jul 24 19:24:41.853024 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.852989    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n" event={"ID":"d05b38ed-7afa-4a6b-925f-93e870744441","Type":"ContainerDied","Data":"5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb"}
Jul 24 19:24:41.853171 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.853043    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n" event={"ID":"d05b38ed-7afa-4a6b-925f-93e870744441","Type":"ContainerDied","Data":"c5efbbffa88fdd875352c0d94d961e60f39eec7baeaba5187b7027863e48ba31"}
Jul 24 19:24:41.853171 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.853086    2584 scope.go:117] "RemoveContainer" containerID="5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb"
Jul 24 19:24:41.865387 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.865367    2584 scope.go:117] "RemoveContainer" containerID="5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb"
Jul 24 19:24:41.865632 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:24:41.865616    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb\": container with ID starting with 5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb not found: ID does not exist" containerID="5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb"
Jul 24 19:24:41.865682 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.865642    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb"} err="failed to get container status \"5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb\": rpc error: code = NotFound desc = could not find container \"5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb\": container with ID starting with 5a808ac180cfa4204a447d54936f4a35e14a960a17fd347807463aa4d672e8bb not found: ID does not exist"
Jul 24 19:24:41.876261 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.876241    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"]
Jul 24 19:24:41.880126 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:41.880106    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d391c5/sub-test-model-d391c5-kserve-fccc8d9df-js68n"]
Jul 24 19:24:42.574231 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:42.574203    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d05b38ed-7afa-4a6b-925f-93e870744441" path="/var/lib/kubelet/pods/d05b38ed-7afa-4a6b-925f-93e870744441/volumes"
Jul 24 19:24:42.948564 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:42.948523    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:42.948564 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:42.948576    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:42.960951 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:42.960927    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:24:43.878602 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:24:43.878566    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:25:08.841028 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:08.841001    2584 scope.go:117] "RemoveContainer" containerID="9fe074af3073e331eddf18db5e3ae739955a34cb9e48af3eb1b81c52cefab397"
Jul 24 19:25:35.188875 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:35.188841    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"]
Jul 24 19:25:49.393582 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.393545    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:49.394050 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.393921    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d05b38ed-7afa-4a6b-925f-93e870744441" containerName="main"
Jul 24 19:25:49.394050 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.393932    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d05b38ed-7afa-4a6b-925f-93e870744441" containerName="main"
Jul 24 19:25:49.394050 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.394005    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d05b38ed-7afa-4a6b-925f-93e870744441" containerName="main"
Jul 24 19:25:49.397997 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.397972    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:49.398219 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.398157    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:49.400999 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.400976    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9k27v\""
Jul 24 19:25:49.517595 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.517568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tcdq\" (UniqueName: \"kubernetes.io/projected/a74f1072-d82c-4f98-b272-daeae6aa029b-kube-api-access-6tcdq\") pod \"test-curl-7690-139959303452112\" (UID: \"a74f1072-d82c-4f98-b272-daeae6aa029b\") " pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:49.618183 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.618149    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tcdq\" (UniqueName: \"kubernetes.io/projected/a74f1072-d82c-4f98-b272-daeae6aa029b-kube-api-access-6tcdq\") pod \"test-curl-7690-139959303452112\" (UID: \"a74f1072-d82c-4f98-b272-daeae6aa029b\") " pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:49.627243 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.627219    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tcdq\" (UniqueName: \"kubernetes.io/projected/a74f1072-d82c-4f98-b272-daeae6aa029b-kube-api-access-6tcdq\") pod \"test-curl-7690-139959303452112\" (UID: \"a74f1072-d82c-4f98-b272-daeae6aa029b\") " pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:49.707686 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.707627    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:49.841989 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.841967    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:49.843328 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:25:49.843297    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda74f1072_d82c_4f98_b272_daeae6aa029b.slice/crio-dd4a6056acc354995847a1209743910506d0237ede750e86bec6a44b1f8435b4 WatchSource:0}: Error finding container dd4a6056acc354995847a1209743910506d0237ede750e86bec6a44b1f8435b4: Status 404 returned error can't find the container with id dd4a6056acc354995847a1209743910506d0237ede750e86bec6a44b1f8435b4
Jul 24 19:25:49.844749 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:49.844730    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:25:50.207961 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.207892    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j" podUID="d2c38af5-32d2-4a48-b562-50513123c698" containerName="main" containerID="cri-o://b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301" gracePeriod=45
Jul 24 19:25:50.218472 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.218444    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303452112" event={"ID":"a74f1072-d82c-4f98-b272-daeae6aa029b","Type":"ContainerStarted","Data":"dd4a6056acc354995847a1209743910506d0237ede750e86bec6a44b1f8435b4"}
Jul 24 19:25:50.613990 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.613965    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:25:50.727944 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.727916    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-model-cache\") pod \"d2c38af5-32d2-4a48-b562-50513123c698\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") "
Jul 24 19:25:50.728090 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.727961    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c38af5-32d2-4a48-b562-50513123c698-tls-certs\") pod \"d2c38af5-32d2-4a48-b562-50513123c698\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") "
Jul 24 19:25:50.728090 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728020    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-dshm\") pod \"d2c38af5-32d2-4a48-b562-50513123c698\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") "
Jul 24 19:25:50.728090 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728038    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nvdt\" (UniqueName: \"kubernetes.io/projected/d2c38af5-32d2-4a48-b562-50513123c698-kube-api-access-8nvdt\") pod \"d2c38af5-32d2-4a48-b562-50513123c698\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") "
Jul 24 19:25:50.728267 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728115    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-home\") pod \"d2c38af5-32d2-4a48-b562-50513123c698\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") "
Jul 24 19:25:50.728267 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728131    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-tmp-dir\") pod \"d2c38af5-32d2-4a48-b562-50513123c698\" (UID: \"d2c38af5-32d2-4a48-b562-50513123c698\") "
Jul 24 19:25:50.728267 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728205    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2c38af5-32d2-4a48-b562-50513123c698" (UID: "d2c38af5-32d2-4a48-b562-50513123c698"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:50.728419 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728316    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-home" (OuterVolumeSpecName: "home") pod "d2c38af5-32d2-4a48-b562-50513123c698" (UID: "d2c38af5-32d2-4a48-b562-50513123c698"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:50.728468 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728411    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2c38af5-32d2-4a48-b562-50513123c698" (UID: "d2c38af5-32d2-4a48-b562-50513123c698"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:50.728468 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728456    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:50.728538 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.728471    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:50.730204 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.730173    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c38af5-32d2-4a48-b562-50513123c698-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2c38af5-32d2-4a48-b562-50513123c698" (UID: "d2c38af5-32d2-4a48-b562-50513123c698"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:25:50.730273 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.730211    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c38af5-32d2-4a48-b562-50513123c698-kube-api-access-8nvdt" (OuterVolumeSpecName: "kube-api-access-8nvdt") pod "d2c38af5-32d2-4a48-b562-50513123c698" (UID: "d2c38af5-32d2-4a48-b562-50513123c698"). InnerVolumeSpecName "kube-api-access-8nvdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:50.730273 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.730263    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-dshm" (OuterVolumeSpecName: "dshm") pod "d2c38af5-32d2-4a48-b562-50513123c698" (UID: "d2c38af5-32d2-4a48-b562-50513123c698"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:50.829279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.829222    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:50.829279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.829244    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c38af5-32d2-4a48-b562-50513123c698-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:50.829279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.829252    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c38af5-32d2-4a48-b562-50513123c698-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:50.829279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:50.829260    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nvdt\" (UniqueName: \"kubernetes.io/projected/d2c38af5-32d2-4a48-b562-50513123c698-kube-api-access-8nvdt\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:51.225154 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.225119    2584 generic.go:356] "Generic (PLEG): container finished" podID="d2c38af5-32d2-4a48-b562-50513123c698" containerID="b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301" exitCode=0
Jul 24 19:25:51.225332 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.225160    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"
Jul 24 19:25:51.225332 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.225206    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j" event={"ID":"d2c38af5-32d2-4a48-b562-50513123c698","Type":"ContainerDied","Data":"b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301"}
Jul 24 19:25:51.225332 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.225246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j" event={"ID":"d2c38af5-32d2-4a48-b562-50513123c698","Type":"ContainerDied","Data":"ad3cdf7cf709ad52b4135e5543d3ded1ea8a42d0ad0b6b9a4be3d27c8fa428f5"}
Jul 24 19:25:51.225332 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.225268    2584 scope.go:117] "RemoveContainer" containerID="b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301"
Jul 24 19:25:51.226962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.226938    2584 generic.go:356] "Generic (PLEG): container finished" podID="a74f1072-d82c-4f98-b272-daeae6aa029b" containerID="b5e79c83c001da6dd3327e1464f61cddfe08293d127b4a4b28a88b7587335a39" exitCode=0
Jul 24 19:25:51.227119 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.227018    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303452112" event={"ID":"a74f1072-d82c-4f98-b272-daeae6aa029b","Type":"ContainerDied","Data":"b5e79c83c001da6dd3327e1464f61cddfe08293d127b4a4b28a88b7587335a39"}
Jul 24 19:25:51.234328 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.234313    2584 scope.go:117] "RemoveContainer" containerID="b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301"
Jul 24 19:25:51.234579 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:25:51.234561    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301\": container with ID starting with b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301 not found: ID does not exist" containerID="b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301"
Jul 24 19:25:51.234636 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.234588    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301"} err="failed to get container status \"b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301\": rpc error: code = NotFound desc = could not find container \"b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301\": container with ID starting with b1065902f1b045038d8acc52f24e55740c32916911c7d073884e5a2f6b53a301 not found: ID does not exist"
Jul 24 19:25:51.259281 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.259246    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"]
Jul 24 19:25:51.262854 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:51.262832    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-65184f/rate-test-model-65184f-kserve-64c9787d8c-skn4j"]
Jul 24 19:25:52.366283 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.366258    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:52.402010 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.401985    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7690-139959303452112_a74f1072-d82c-4f98-b272-daeae6aa029b/test-curl-7690-139959303452112/0.log"
Jul 24 19:25:52.425630 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.425608    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:52.429118 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.429100    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:52.441266 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.441243    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tcdq\" (UniqueName: \"kubernetes.io/projected/a74f1072-d82c-4f98-b272-daeae6aa029b-kube-api-access-6tcdq\") pod \"a74f1072-d82c-4f98-b272-daeae6aa029b\" (UID: \"a74f1072-d82c-4f98-b272-daeae6aa029b\") "
Jul 24 19:25:52.443268 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.443243    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74f1072-d82c-4f98-b272-daeae6aa029b-kube-api-access-6tcdq" (OuterVolumeSpecName: "kube-api-access-6tcdq") pod "a74f1072-d82c-4f98-b272-daeae6aa029b" (UID: "a74f1072-d82c-4f98-b272-daeae6aa029b"). InnerVolumeSpecName "kube-api-access-6tcdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:52.541079 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541010    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:52.541394 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541380    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c38af5-32d2-4a48-b562-50513123c698" containerName="main"
Jul 24 19:25:52.541440 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541396    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c38af5-32d2-4a48-b562-50513123c698" containerName="main"
Jul 24 19:25:52.541440 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541404    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74f1072-d82c-4f98-b272-daeae6aa029b" containerName="test-curl-7690-139959303452112"
Jul 24 19:25:52.541440 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541411    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74f1072-d82c-4f98-b272-daeae6aa029b" containerName="test-curl-7690-139959303452112"
Jul 24 19:25:52.541538 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541462    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c38af5-32d2-4a48-b562-50513123c698" containerName="main"
Jul 24 19:25:52.541538 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.541472    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74f1072-d82c-4f98-b272-daeae6aa029b" containerName="test-curl-7690-139959303452112"
Jul 24 19:25:52.542431 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.542414    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tcdq\" (UniqueName: \"kubernetes.io/projected/a74f1072-d82c-4f98-b272-daeae6aa029b-kube-api-access-6tcdq\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:52.544617 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.544603    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:52.548574 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.548552    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:52.574616 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.574594    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a74f1072-d82c-4f98-b272-daeae6aa029b" path="/var/lib/kubelet/pods/a74f1072-d82c-4f98-b272-daeae6aa029b/volumes"
Jul 24 19:25:52.574987 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.574974    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c38af5-32d2-4a48-b562-50513123c698" path="/var/lib/kubelet/pods/d2c38af5-32d2-4a48-b562-50513123c698/volumes"
Jul 24 19:25:52.643552 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.643527    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4zpb\" (UniqueName: \"kubernetes.io/projected/7b902a2f-0fa8-48f2-a718-a4f217d03ae4-kube-api-access-f4zpb\") pod \"test-curl-7690-139959303452112\" (UID: \"7b902a2f-0fa8-48f2-a718-a4f217d03ae4\") " pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:52.744017 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.743995    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4zpb\" (UniqueName: \"kubernetes.io/projected/7b902a2f-0fa8-48f2-a718-a4f217d03ae4-kube-api-access-f4zpb\") pod \"test-curl-7690-139959303452112\" (UID: \"7b902a2f-0fa8-48f2-a718-a4f217d03ae4\") " pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:52.751966 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.751944    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4zpb\" (UniqueName: \"kubernetes.io/projected/7b902a2f-0fa8-48f2-a718-a4f217d03ae4-kube-api-access-f4zpb\") pod \"test-curl-7690-139959303452112\" (UID: \"7b902a2f-0fa8-48f2-a718-a4f217d03ae4\") " pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:52.854103 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.854082    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:52.983485 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:52.983460    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:52.985034 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:25:52.985007    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b902a2f_0fa8_48f2_a718_a4f217d03ae4.slice/crio-dd43c84cb969a1ef2a8b6519d3c8bcbf1c61cdf4958c007a5a174c7d00c5e319 WatchSource:0}: Error finding container dd43c84cb969a1ef2a8b6519d3c8bcbf1c61cdf4958c007a5a174c7d00c5e319: Status 404 returned error can't find the container with id dd43c84cb969a1ef2a8b6519d3c8bcbf1c61cdf4958c007a5a174c7d00c5e319
Jul 24 19:25:53.239028 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:53.238952    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:53.239028 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:53.238989    2584 scope.go:117] "RemoveContainer" containerID="b5e79c83c001da6dd3327e1464f61cddfe08293d127b4a4b28a88b7587335a39"
Jul 24 19:25:53.240307 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:53.240278    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303452112" event={"ID":"7b902a2f-0fa8-48f2-a718-a4f217d03ae4","Type":"ContainerStarted","Data":"dd43c84cb969a1ef2a8b6519d3c8bcbf1c61cdf4958c007a5a174c7d00c5e319"}
Jul 24 19:25:54.246840 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:54.246806    2584 generic.go:356] "Generic (PLEG): container finished" podID="7b902a2f-0fa8-48f2-a718-a4f217d03ae4" containerID="3f1fa841842641c388b9cdfe27e12658216052d739df64471119eb06bba8b698" exitCode=0
Jul 24 19:25:54.247276 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:54.246891    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7690-139959303452112" event={"ID":"7b902a2f-0fa8-48f2-a718-a4f217d03ae4","Type":"ContainerDied","Data":"3f1fa841842641c388b9cdfe27e12658216052d739df64471119eb06bba8b698"}
Jul 24 19:25:55.378096 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.378053    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:55.398901 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.398860    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7690-139959303452112_7b902a2f-0fa8-48f2-a718-a4f217d03ae4/test-curl-7690-139959303452112/0.log"
Jul 24 19:25:55.421473 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.421440    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:55.427083 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.427043    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7690-139959303452112"]
Jul 24 19:25:55.466881 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.466863    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4zpb\" (UniqueName: \"kubernetes.io/projected/7b902a2f-0fa8-48f2-a718-a4f217d03ae4-kube-api-access-f4zpb\") pod \"7b902a2f-0fa8-48f2-a718-a4f217d03ae4\" (UID: \"7b902a2f-0fa8-48f2-a718-a4f217d03ae4\") "
Jul 24 19:25:55.468727 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.468706    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b902a2f-0fa8-48f2-a718-a4f217d03ae4-kube-api-access-f4zpb" (OuterVolumeSpecName: "kube-api-access-f4zpb") pod "7b902a2f-0fa8-48f2-a718-a4f217d03ae4" (UID: "7b902a2f-0fa8-48f2-a718-a4f217d03ae4"). InnerVolumeSpecName "kube-api-access-f4zpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:55.567691 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:55.567638    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4zpb\" (UniqueName: \"kubernetes.io/projected/7b902a2f-0fa8-48f2-a718-a4f217d03ae4-kube-api-access-f4zpb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:25:56.258859 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:56.258833    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:56.259049 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:56.258874    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd43c84cb969a1ef2a8b6519d3c8bcbf1c61cdf4958c007a5a174c7d00c5e319"
Jul 24 19:25:56.269235 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:25:56.269208    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7690-139959303452112\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7b902a2f-0fa8-48f2-a718-a4f217d03ae4" pod="opendatahub/test-curl-7690-139959303452112"
Jul 24 19:25:56.574517 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:25:56.574433    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b902a2f-0fa8-48f2-a718-a4f217d03ae4" path="/var/lib/kubelet/pods/7b902a2f-0fa8-48f2-a718-a4f217d03ae4/volumes"
Jul 24 19:26:19.023813 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.023782    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"]
Jul 24 19:26:19.024202 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.024136    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b902a2f-0fa8-48f2-a718-a4f217d03ae4" containerName="test-curl-7690-139959303452112"
Jul 24 19:26:19.024202 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.024148    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b902a2f-0fa8-48f2-a718-a4f217d03ae4" containerName="test-curl-7690-139959303452112"
Jul 24 19:26:19.024279 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.024217    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b902a2f-0fa8-48f2-a718-a4f217d03ae4" containerName="test-curl-7690-139959303452112"
Jul 24 19:26:19.027135 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.027107    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.030425 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.030407    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-8a409a\""
Jul 24 19:26:19.030931 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.030913    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-8a409a-dockercfg-dbg2h\""
Jul 24 19:26:19.038247 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.038224    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"]
Jul 24 19:26:19.165200 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.165160    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lcgc\" (UniqueName: \"kubernetes.io/projected/2f8e375c-19d6-495f-8341-1b0f562a6dc2-kube-api-access-9lcgc\") pod \"payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.165385 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.165323    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8e375c-19d6-495f-8341-1b0f562a6dc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.265848 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.265813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8e375c-19d6-495f-8341-1b0f562a6dc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.265997 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.265921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lcgc\" (UniqueName: \"kubernetes.io/projected/2f8e375c-19d6-495f-8341-1b0f562a6dc2-kube-api-access-9lcgc\") pod \"payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.266685 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.266654    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8e375c-19d6-495f-8341-1b0f562a6dc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.274641 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.274579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lcgc\" (UniqueName: \"kubernetes.io/projected/2f8e375c-19d6-495f-8341-1b0f562a6dc2-kube-api-access-9lcgc\") pod \"payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.337534 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.337509    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:19.466847 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:19.466816    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"]
Jul 24 19:26:19.467803 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:26:19.467780    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8e375c_19d6_495f_8341_1b0f562a6dc2.slice/crio-dd5554ff81c28ca906e900650d043f49339b6d2d602d96ea51a01d6baa39891c WatchSource:0}: Error finding container dd5554ff81c28ca906e900650d043f49339b6d2d602d96ea51a01d6baa39891c: Status 404 returned error can't find the container with id dd5554ff81c28ca906e900650d043f49339b6d2d602d96ea51a01d6baa39891c
Jul 24 19:26:20.388938 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:20.388893    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq" event={"ID":"2f8e375c-19d6-495f-8341-1b0f562a6dc2","Type":"ContainerStarted","Data":"dd5554ff81c28ca906e900650d043f49339b6d2d602d96ea51a01d6baa39891c"}
Jul 24 19:26:21.395459 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:21.395419    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq" event={"ID":"2f8e375c-19d6-495f-8341-1b0f562a6dc2","Type":"ContainerStarted","Data":"996b31e752fc5d1ad0484b12014abaadd18295433ebf4f8c1820eeb254c4516c"}
Jul 24 19:26:21.395871 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:21.395489    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:21.412801 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:21.412754    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq" podStartSLOduration=0.687318098 podStartE2EDuration="2.412739447s" totalImagesPullingTime="1.725421349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:21.410378929 +0000 UTC m=+2773.328230457" watchObservedRunningTime="2026-07-24 19:26:21.412739447 +0000 UTC m=+2773.330590971"
Jul 24 19:26:32.402739 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:32.402658    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:26:47.100688 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.100656    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"]
Jul 24 19:26:47.105100 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.105079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.109360 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.109338    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-2d5d53\"/\"kube-root-ca.crt\""
Jul 24 19:26:47.109360 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.109352    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-2d5d53\"/\"ipp-route-2d5d53-kserve-self-signed-certs\""
Jul 24 19:26:47.109535 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.109340    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-2d5d53\"/\"openshift-service-ca.crt\""
Jul 24 19:26:47.109535 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.109344    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-2d5d53\"/\"default-dockercfg-zxrzh\""
Jul 24 19:26:47.114447 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.114424    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"]
Jul 24 19:26:47.185067 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.185036    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrzs\" (UniqueName: \"kubernetes.io/projected/05b053a4-a233-44d0-97d2-57f6b236b105-kube-api-access-hrrzs\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.185204 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.185098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-model-cache\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.185204 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.185135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05b053a4-a233-44d0-97d2-57f6b236b105-tls-certs\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.185204 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.185158    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-dshm\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.185372 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.185245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-home\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.185372 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.185282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-tmp-dir\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286481 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrzs\" (UniqueName: \"kubernetes.io/projected/05b053a4-a233-44d0-97d2-57f6b236b105-kube-api-access-hrrzs\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286651 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-model-cache\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286651 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05b053a4-a233-44d0-97d2-57f6b236b105-tls-certs\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286792 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286656    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-dshm\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286792 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286746    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-home\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286883 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286794    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-model-cache\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.286883 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.286796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-tmp-dir\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.287086 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.287046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-home\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.287163 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.287116    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-tmp-dir\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.288844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.288821    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-dshm\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.289029 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.289011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05b053a4-a233-44d0-97d2-57f6b236b105-tls-certs\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.296970 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.296949    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrzs\" (UniqueName: \"kubernetes.io/projected/05b053a4-a233-44d0-97d2-57f6b236b105-kube-api-access-hrrzs\") pod \"ipp-route-2d5d53-kserve-5447db45cf-h52xm\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") " pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.415520 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.415453    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:47.550272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:47.550248    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"]
Jul 24 19:26:47.552142 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:26:47.552101    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05b053a4_a233_44d0_97d2_57f6b236b105.slice/crio-a3a80c8bd3ff02f813945f66f003d94feb60dc96ac9a270d0f74643198874f60 WatchSource:0}: Error finding container a3a80c8bd3ff02f813945f66f003d94feb60dc96ac9a270d0f74643198874f60: Status 404 returned error can't find the container with id a3a80c8bd3ff02f813945f66f003d94feb60dc96ac9a270d0f74643198874f60
Jul 24 19:26:48.536219 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:48.536176    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm" event={"ID":"05b053a4-a233-44d0-97d2-57f6b236b105","Type":"ContainerStarted","Data":"7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3"}
Jul 24 19:26:48.536596 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:48.536228    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm" event={"ID":"05b053a4-a233-44d0-97d2-57f6b236b105","Type":"ContainerStarted","Data":"a3a80c8bd3ff02f813945f66f003d94feb60dc96ac9a270d0f74643198874f60"}
Jul 24 19:26:48.559052 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:48.559004    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm" podStartSLOduration=1.558990225 podStartE2EDuration="1.558990225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:48.556916229 +0000 UTC m=+2800.474767782" watchObservedRunningTime="2026-07-24 19:26:48.558990225 +0000 UTC m=+2800.476841750"
Jul 24 19:26:57.415879 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:57.415848    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:57.416546 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:57.415894    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:57.428274 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:57.428253    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:26:57.601395 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:26:57.601367    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:27:22.575611 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.575582    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"]
Jul 24 19:27:22.578737 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.578720    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.581591 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.581570    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-9cf26b-openshift-default-dockercfg-h5zl7\""
Jul 24 19:27:22.585978 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.585955    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"]
Jul 24 19:27:22.674328 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-socket\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-credential-socket\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8kj\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-kube-api-access-7x8kj\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674421    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-istio-token\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674509 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-data\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674763 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674537    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0849274e-d208-4211-aae1-c6ece76dfea4-istio-podinfo\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674763 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-certs\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674763 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0849274e-d208-4211-aae1-c6ece76dfea4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.674763 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.674702    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-envoy\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-socket\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776285 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-credential-socket\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776285 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8kj\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-kube-api-access-7x8kj\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776436 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-istio-token\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776436 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-data\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776436 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0849274e-d208-4211-aae1-c6ece76dfea4-istio-podinfo\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776601 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776443    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-certs\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776601 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0849274e-d208-4211-aae1-c6ece76dfea4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776601 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-envoy\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776601 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776535    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-socket\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776601 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776568    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-credential-socket\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776811 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776670    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-data\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.776811 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.776799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-certs\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.777282 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.777259    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0849274e-d208-4211-aae1-c6ece76dfea4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.778729 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.778700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-envoy\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.778920 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.778905    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0849274e-d208-4211-aae1-c6ece76dfea4-istio-podinfo\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.784079 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.784039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-istio-token\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.784315 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.784297    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8kj\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-kube-api-access-7x8kj\") pod \"e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") " pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:22.891102 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:22.891074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:23.031507 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.031480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"]
Jul 24 19:27:23.032484 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:27:23.032461    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0849274e_d208_4211_aae1_c6ece76dfea4.slice/crio-7e1006e964ebb5b854af89e348a57fe1687e4fb5e08cfe32a72d6ad586c829bb WatchSource:0}: Error finding container 7e1006e964ebb5b854af89e348a57fe1687e4fb5e08cfe32a72d6ad586c829bb: Status 404 returned error can't find the container with id 7e1006e964ebb5b854af89e348a57fe1687e4fb5e08cfe32a72d6ad586c829bb
Jul 24 19:27:23.034682 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.034653    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:27:23.034774 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.034721    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:27:23.034774 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.034748    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:27:23.724086 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.724030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" event={"ID":"0849274e-d208-4211-aae1-c6ece76dfea4","Type":"ContainerStarted","Data":"52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"}
Jul 24 19:27:23.724443 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.724109    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" event={"ID":"0849274e-d208-4211-aae1-c6ece76dfea4","Type":"ContainerStarted","Data":"7e1006e964ebb5b854af89e348a57fe1687e4fb5e08cfe32a72d6ad586c829bb"}
Jul 24 19:27:23.746249 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.746200    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" podStartSLOduration=1.746185613 podStartE2EDuration="1.746185613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:23.745678157 +0000 UTC m=+2835.663529682" watchObservedRunningTime="2026-07-24 19:27:23.746185613 +0000 UTC m=+2835.664037138"
Jul 24 19:27:23.891826 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:23.891798    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:24.896543 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:24.896516    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:25.734493 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:25.734461    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:25.735273 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:25.735256    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:26.555593 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.555560    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"]
Jul 24 19:27:26.559235 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.559218    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.562253 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.562235    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-9cf26b\""
Jul 24 19:27:26.562569 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.562553    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-9cf26b-dockercfg-2tdsd\""
Jul 24 19:27:26.575615 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.575568    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"]
Jul 24 19:27:26.583635 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.583606    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"]
Jul 24 19:27:26.590518 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.590496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.595914 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.595891    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"]
Jul 24 19:27:26.713596 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.713563    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dece38a9-0e48-4bd1-a2b7-9ea937a96413-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.713765 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.713656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qphb\" (UniqueName: \"kubernetes.io/projected/fb967b16-c365-4395-8abd-461e6c480b12-kube-api-access-7qphb\") pod \"payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.713765 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.713689    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp7sc\" (UniqueName: \"kubernetes.io/projected/dece38a9-0e48-4bd1-a2b7-9ea937a96413-kube-api-access-bp7sc\") pod \"payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.713765 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.713714    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb967b16-c365-4395-8abd-461e6c480b12-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.815248 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.815178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dece38a9-0e48-4bd1-a2b7-9ea937a96413-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.815248 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.815244    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qphb\" (UniqueName: \"kubernetes.io/projected/fb967b16-c365-4395-8abd-461e6c480b12-kube-api-access-7qphb\") pod \"payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.815416 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.815272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp7sc\" (UniqueName: \"kubernetes.io/projected/dece38a9-0e48-4bd1-a2b7-9ea937a96413-kube-api-access-bp7sc\") pod \"payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.815416 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.815294    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb967b16-c365-4395-8abd-461e6c480b12-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.815936 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.815916    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dece38a9-0e48-4bd1-a2b7-9ea937a96413-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.815973 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.815934    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb967b16-c365-4395-8abd-461e6c480b12-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.825007 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.824982    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qphb\" (UniqueName: \"kubernetes.io/projected/fb967b16-c365-4395-8abd-461e6c480b12-kube-api-access-7qphb\") pod \"payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.833021 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.833001    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp7sc\" (UniqueName: \"kubernetes.io/projected/dece38a9-0e48-4bd1-a2b7-9ea937a96413-kube-api-access-bp7sc\") pod \"payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:26.870027 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.870002    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:26.903377 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:26.903352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:27.021737 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.021529    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"]
Jul 24 19:27:27.022333 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:27:27.022296    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb967b16_c365_4395_8abd_461e6c480b12.slice/crio-07e291ed966a0f73f88f2dd225cc9d4056db1a70d077f02bd17a704d02489b71 WatchSource:0}: Error finding container 07e291ed966a0f73f88f2dd225cc9d4056db1a70d077f02bd17a704d02489b71: Status 404 returned error can't find the container with id 07e291ed966a0f73f88f2dd225cc9d4056db1a70d077f02bd17a704d02489b71
Jul 24 19:27:27.049878 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.049855    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"]
Jul 24 19:27:27.056166 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:27:27.056143    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddece38a9_0e48_4bd1_a2b7_9ea937a96413.slice/crio-aaef0dadcea8f8ae2bc7ce70685ff0db4f6cf69331c574516a0fac7a3e9ed5e8 WatchSource:0}: Error finding container aaef0dadcea8f8ae2bc7ce70685ff0db4f6cf69331c574516a0fac7a3e9ed5e8: Status 404 returned error can't find the container with id aaef0dadcea8f8ae2bc7ce70685ff0db4f6cf69331c574516a0fac7a3e9ed5e8
Jul 24 19:27:27.747256 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.747216    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt" event={"ID":"fb967b16-c365-4395-8abd-461e6c480b12","Type":"ContainerStarted","Data":"49d5f33c73c06e40755779aa383c5f1a40a8a7f37ccaba85a1615cd86399be11"}
Jul 24 19:27:27.747707 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.747282    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt" event={"ID":"fb967b16-c365-4395-8abd-461e6c480b12","Type":"ContainerStarted","Data":"07e291ed966a0f73f88f2dd225cc9d4056db1a70d077f02bd17a704d02489b71"}
Jul 24 19:27:27.747707 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.747311    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:27.748867 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.748845    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97" event={"ID":"dece38a9-0e48-4bd1-a2b7-9ea937a96413","Type":"ContainerStarted","Data":"ae49c14f2784ab47ccf8bd94f4ae9733ff131931d940a9bbab3e57adf8610415"}
Jul 24 19:27:27.748918 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.748887    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97" event={"ID":"dece38a9-0e48-4bd1-a2b7-9ea937a96413","Type":"ContainerStarted","Data":"aaef0dadcea8f8ae2bc7ce70685ff0db4f6cf69331c574516a0fac7a3e9ed5e8"}
Jul 24 19:27:27.749038 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.749027    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:27.765780 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.765740    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt" podStartSLOduration=1.765725766 podStartE2EDuration="1.765725766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:27.763605908 +0000 UTC m=+2839.681457433" watchObservedRunningTime="2026-07-24 19:27:27.765725766 +0000 UTC m=+2839.683577290"
Jul 24 19:27:27.783830 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:27.783757    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97" podStartSLOduration=1.783740818 podStartE2EDuration="1.783740818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:27.782426151 +0000 UTC m=+2839.700277677" watchObservedRunningTime="2026-07-24 19:27:27.783740818 +0000 UTC m=+2839.701592344"
Jul 24 19:27:38.759491 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:38.759453    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:38.759900 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:38.759543    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:39.831186 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:39.831152    2584 generic.go:356] "Generic (PLEG): container finished" podID="0849274e-d208-4211-aae1-c6ece76dfea4" containerID="52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9" exitCode=0
Jul 24 19:27:39.831586 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:39.831226    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" event={"ID":"0849274e-d208-4211-aae1-c6ece76dfea4","Type":"ContainerDied","Data":"52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"}
Jul 24 19:27:39.831636 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:39.831606    2584 scope.go:117] "RemoveContainer" containerID="52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"
Jul 24 19:27:39.832730 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:39.832705    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:27:39.832778 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:39.832767    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:27:39.832815 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:39.832799    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 19:27:40.735124 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:40.735085    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:40.838768 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:40.838728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" event={"ID":"0849274e-d208-4211-aae1-c6ece76dfea4","Type":"ContainerStarted","Data":"1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4"}
Jul 24 19:27:40.892074 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:40.892026    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:40.893445 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:40.893410    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 24 19:27:40.893589 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:40.893464    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 24 19:27:41.892007 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:41.891968    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 24 19:27:41.892423 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:41.892033    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 24 19:27:42.892341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:42.892297    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 24 19:27:42.892835 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:42.892348    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 24 19:27:43.893081 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:43.892399    2584 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 24 19:27:43.893081 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:43.892457    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 24 19:27:44.895128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:44.895098    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:44.895558 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:44.895474    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:44.896050 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:44.896029    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:27:51.644661 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.644624    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"]
Jul 24 19:27:51.645126 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.644884    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97" podUID="dece38a9-0e48-4bd1-a2b7-9ea937a96413" containerName="payload-processing" containerID="cri-o://ae49c14f2784ab47ccf8bd94f4ae9733ff131931d940a9bbab3e57adf8610415" gracePeriod=30
Jul 24 19:27:51.652649 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.652597    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"]
Jul 24 19:27:51.652854 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.652807    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt" podUID="fb967b16-c365-4395-8abd-461e6c480b12" containerName="payload-pre-processing" containerID="cri-o://49d5f33c73c06e40755779aa383c5f1a40a8a7f37ccaba85a1615cd86399be11" gracePeriod=30
Jul 24 19:27:51.903018 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.902956    2584 generic.go:356] "Generic (PLEG): container finished" podID="dece38a9-0e48-4bd1-a2b7-9ea937a96413" containerID="ae49c14f2784ab47ccf8bd94f4ae9733ff131931d940a9bbab3e57adf8610415" exitCode=0
Jul 24 19:27:51.903160 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.903040    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97" event={"ID":"dece38a9-0e48-4bd1-a2b7-9ea937a96413","Type":"ContainerDied","Data":"ae49c14f2784ab47ccf8bd94f4ae9733ff131931d940a9bbab3e57adf8610415"}
Jul 24 19:27:51.903160 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.903120    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97" event={"ID":"dece38a9-0e48-4bd1-a2b7-9ea937a96413","Type":"ContainerDied","Data":"aaef0dadcea8f8ae2bc7ce70685ff0db4f6cf69331c574516a0fac7a3e9ed5e8"}
Jul 24 19:27:51.903160 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.903139    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaef0dadcea8f8ae2bc7ce70685ff0db4f6cf69331c574516a0fac7a3e9ed5e8"
Jul 24 19:27:51.904831 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.904809    2584 generic.go:356] "Generic (PLEG): container finished" podID="fb967b16-c365-4395-8abd-461e6c480b12" containerID="49d5f33c73c06e40755779aa383c5f1a40a8a7f37ccaba85a1615cd86399be11" exitCode=0
Jul 24 19:27:51.904937 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.904851    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt" event={"ID":"fb967b16-c365-4395-8abd-461e6c480b12","Type":"ContainerDied","Data":"49d5f33c73c06e40755779aa383c5f1a40a8a7f37ccaba85a1615cd86399be11"}
Jul 24 19:27:51.910690 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.910670    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:51.937858 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:51.937833    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:52.055080 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055034    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp7sc\" (UniqueName: \"kubernetes.io/projected/dece38a9-0e48-4bd1-a2b7-9ea937a96413-kube-api-access-bp7sc\") pod \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") "
Jul 24 19:27:52.055244 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055099    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dece38a9-0e48-4bd1-a2b7-9ea937a96413-plugins-config-volume\") pod \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\" (UID: \"dece38a9-0e48-4bd1-a2b7-9ea937a96413\") "
Jul 24 19:27:52.055244 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055147    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qphb\" (UniqueName: \"kubernetes.io/projected/fb967b16-c365-4395-8abd-461e6c480b12-kube-api-access-7qphb\") pod \"fb967b16-c365-4395-8abd-461e6c480b12\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") "
Jul 24 19:27:52.055244 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055222    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb967b16-c365-4395-8abd-461e6c480b12-plugins-config-volume\") pod \"fb967b16-c365-4395-8abd-461e6c480b12\" (UID: \"fb967b16-c365-4395-8abd-461e6c480b12\") "
Jul 24 19:27:52.055445 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055421    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dece38a9-0e48-4bd1-a2b7-9ea937a96413-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dece38a9-0e48-4bd1-a2b7-9ea937a96413" (UID: "dece38a9-0e48-4bd1-a2b7-9ea937a96413"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:27:52.055611 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055588    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb967b16-c365-4395-8abd-461e6c480b12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb967b16-c365-4395-8abd-461e6c480b12" (UID: "fb967b16-c365-4395-8abd-461e6c480b12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:27:52.055664 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.055617    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dece38a9-0e48-4bd1-a2b7-9ea937a96413-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:27:52.057136 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.057113    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dece38a9-0e48-4bd1-a2b7-9ea937a96413-kube-api-access-bp7sc" (OuterVolumeSpecName: "kube-api-access-bp7sc") pod "dece38a9-0e48-4bd1-a2b7-9ea937a96413" (UID: "dece38a9-0e48-4bd1-a2b7-9ea937a96413"). InnerVolumeSpecName "kube-api-access-bp7sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:27:52.057136 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.057125    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb967b16-c365-4395-8abd-461e6c480b12-kube-api-access-7qphb" (OuterVolumeSpecName: "kube-api-access-7qphb") pod "fb967b16-c365-4395-8abd-461e6c480b12" (UID: "fb967b16-c365-4395-8abd-461e6c480b12"). InnerVolumeSpecName "kube-api-access-7qphb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:27:52.156429 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.156369    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb967b16-c365-4395-8abd-461e6c480b12-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:27:52.156429 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.156395    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp7sc\" (UniqueName: \"kubernetes.io/projected/dece38a9-0e48-4bd1-a2b7-9ea937a96413-kube-api-access-bp7sc\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:27:52.156429 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.156408    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qphb\" (UniqueName: \"kubernetes.io/projected/fb967b16-c365-4395-8abd-461e6c480b12-kube-api-access-7qphb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:27:52.911648 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.911625    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"
Jul 24 19:27:52.912093 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.911665    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt" event={"ID":"fb967b16-c365-4395-8abd-461e6c480b12","Type":"ContainerDied","Data":"07e291ed966a0f73f88f2dd225cc9d4056db1a70d077f02bd17a704d02489b71"}
Jul 24 19:27:52.912093 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.911723    2584 scope.go:117] "RemoveContainer" containerID="49d5f33c73c06e40755779aa383c5f1a40a8a7f37ccaba85a1615cd86399be11"
Jul 24 19:27:52.912093 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.911870    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"
Jul 24 19:27:52.930032 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.930007    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"]
Jul 24 19:27:52.936893 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.936870    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-9cf26b-6597c6b9fb-pmdpt"]
Jul 24 19:27:52.949654 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.949625    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"]
Jul 24 19:27:52.952919 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:52.952899    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-9cf26b-7489646f9b-t2l97"]
Jul 24 19:27:54.574841 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:54.574807    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dece38a9-0e48-4bd1-a2b7-9ea937a96413" path="/var/lib/kubelet/pods/dece38a9-0e48-4bd1-a2b7-9ea937a96413/volumes"
Jul 24 19:27:54.575262 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:27:54.575246    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb967b16-c365-4395-8abd-461e6c480b12" path="/var/lib/kubelet/pods/fb967b16-c365-4395-8abd-461e6c480b12/volumes"
Jul 24 19:28:02.438801 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:02.438725    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"]
Jul 24 19:28:02.439271 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:02.438972    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy" containerID="cri-o://1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4" gracePeriod=30
Jul 24 19:28:07.692005 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.691979    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:28:07.887448 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887413    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-certs\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887594 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0849274e-d208-4211-aae1-c6ece76dfea4-istio-podinfo\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887594 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887521    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-socket\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887594 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887547    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x8kj\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-kube-api-access-7x8kj\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887594 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887580    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-envoy\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887605    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-istio-token\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887641    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-credential-socket\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887672    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0849274e-d208-4211-aae1-c6ece76dfea4-istiod-ca-cert\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.887812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887683    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:07.887812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887701    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-data\") pod \"0849274e-d208-4211-aae1-c6ece76dfea4\" (UID: \"0849274e-d208-4211-aae1-c6ece76dfea4\") "
Jul 24 19:28:07.888104 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887932    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:07.888104 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.887983    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.888222 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.888166    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0849274e-d208-4211-aae1-c6ece76dfea4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:28:07.888411 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.888374    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:07.888955 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.888930    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-data" (OuterVolumeSpecName: "istio-data") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:07.889988 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.889952    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:07.890180 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.890158    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0849274e-d208-4211-aae1-c6ece76dfea4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:28:07.890237 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.890176    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-kube-api-access-7x8kj" (OuterVolumeSpecName: "kube-api-access-7x8kj") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "kube-api-access-7x8kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:07.890237 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.890194    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-istio-token" (OuterVolumeSpecName: "istio-token") pod "0849274e-d208-4211-aae1-c6ece76dfea4" (UID: "0849274e-d208-4211-aae1-c6ece76dfea4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:07.989359 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989338    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0849274e-d208-4211-aae1-c6ece76dfea4-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989359 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989359    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989489 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989369    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x8kj\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-kube-api-access-7x8kj\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989489 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989378    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989489 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989387    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0849274e-d208-4211-aae1-c6ece76dfea4-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989489 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989395    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989489 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989403    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0849274e-d208-4211-aae1-c6ece76dfea4-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.989489 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.989410    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0849274e-d208-4211-aae1-c6ece76dfea4-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:07.991898 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.991879    2584 generic.go:356] "Generic (PLEG): container finished" podID="0849274e-d208-4211-aae1-c6ece76dfea4" containerID="1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4" exitCode=0
Jul 24 19:28:07.991991 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.991920    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"
Jul 24 19:28:07.991991 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.991967    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" event={"ID":"0849274e-d208-4211-aae1-c6ece76dfea4","Type":"ContainerDied","Data":"1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4"}
Jul 24 19:28:07.992085 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.992022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw" event={"ID":"0849274e-d208-4211-aae1-c6ece76dfea4","Type":"ContainerDied","Data":"7e1006e964ebb5b854af89e348a57fe1687e4fb5e08cfe32a72d6ad586c829bb"}
Jul 24 19:28:07.992085 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:07.992051    2584 scope.go:117] "RemoveContainer" containerID="1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4"
Jul 24 19:28:08.001109 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.001092    2584 scope.go:117] "RemoveContainer" containerID="52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"
Jul 24 19:28:08.008911 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.008897    2584 scope.go:117] "RemoveContainer" containerID="1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4"
Jul 24 19:28:08.009155 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:28:08.009138    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4\": container with ID starting with 1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4 not found: ID does not exist" containerID="1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4"
Jul 24 19:28:08.009270 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.009160    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4"} err="failed to get container status \"1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4\": rpc error: code = NotFound desc = could not find container \"1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4\": container with ID starting with 1f289611bd6a23b5c74d5fd26923ce429381d833a6553abd65e8b5998e855ce4 not found: ID does not exist"
Jul 24 19:28:08.009270 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.009176    2584 scope.go:117] "RemoveContainer" containerID="52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"
Jul 24 19:28:08.009426 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:28:08.009406    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9\": container with ID starting with 52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9 not found: ID does not exist" containerID="52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"
Jul 24 19:28:08.009469 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.009431    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9"} err="failed to get container status \"52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9\": rpc error: code = NotFound desc = could not find container \"52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9\": container with ID starting with 52f32a23414c760af3d3c4f6f8b5d5d0b02ca724d9488692f14ec0428db0abb9 not found: ID does not exist"
Jul 24 19:28:08.016045 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.016027    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"]
Jul 24 19:28:08.022958 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.022937    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9cf26b-openshift-default-7d6cb96448-99vqw"]
Jul 24 19:28:08.575320 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:08.575288    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" path="/var/lib/kubelet/pods/0849274e-d208-4211-aae1-c6ece76dfea4/volumes"
Jul 24 19:28:31.468073 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:31.468033    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"]
Jul 24 19:28:46.487069 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.487031    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm" podUID="05b053a4-a233-44d0-97d2-57f6b236b105" containerName="main" containerID="cri-o://7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3" gracePeriod=45
Jul 24 19:28:46.738447 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.738386    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:28:46.917353 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917313    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-home\") pod \"05b053a4-a233-44d0-97d2-57f6b236b105\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") "
Jul 24 19:28:46.917517 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917417    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrzs\" (UniqueName: \"kubernetes.io/projected/05b053a4-a233-44d0-97d2-57f6b236b105-kube-api-access-hrrzs\") pod \"05b053a4-a233-44d0-97d2-57f6b236b105\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") "
Jul 24 19:28:46.917517 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917447    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-model-cache\") pod \"05b053a4-a233-44d0-97d2-57f6b236b105\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") "
Jul 24 19:28:46.917517 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917462    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-dshm\") pod \"05b053a4-a233-44d0-97d2-57f6b236b105\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") "
Jul 24 19:28:46.917517 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917486    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-tmp-dir\") pod \"05b053a4-a233-44d0-97d2-57f6b236b105\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") "
Jul 24 19:28:46.917675 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917535    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05b053a4-a233-44d0-97d2-57f6b236b105-tls-certs\") pod \"05b053a4-a233-44d0-97d2-57f6b236b105\" (UID: \"05b053a4-a233-44d0-97d2-57f6b236b105\") "
Jul 24 19:28:46.917675 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917615    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-home" (OuterVolumeSpecName: "home") pod "05b053a4-a233-44d0-97d2-57f6b236b105" (UID: "05b053a4-a233-44d0-97d2-57f6b236b105"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:46.917754 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917695    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-model-cache" (OuterVolumeSpecName: "model-cache") pod "05b053a4-a233-44d0-97d2-57f6b236b105" (UID: "05b053a4-a233-44d0-97d2-57f6b236b105"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:46.917819 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917792    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "05b053a4-a233-44d0-97d2-57f6b236b105" (UID: "05b053a4-a233-44d0-97d2-57f6b236b105"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:46.917908 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917890    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:46.917908 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917907    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:46.918052 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.917916    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:46.919562 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.919544    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05b053a4-a233-44d0-97d2-57f6b236b105-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "05b053a4-a233-44d0-97d2-57f6b236b105" (UID: "05b053a4-a233-44d0-97d2-57f6b236b105"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:28:46.919889 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.919871    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-dshm" (OuterVolumeSpecName: "dshm") pod "05b053a4-a233-44d0-97d2-57f6b236b105" (UID: "05b053a4-a233-44d0-97d2-57f6b236b105"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:46.919956 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:46.919895    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b053a4-a233-44d0-97d2-57f6b236b105-kube-api-access-hrrzs" (OuterVolumeSpecName: "kube-api-access-hrrzs") pod "05b053a4-a233-44d0-97d2-57f6b236b105" (UID: "05b053a4-a233-44d0-97d2-57f6b236b105"). InnerVolumeSpecName "kube-api-access-hrrzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:47.018983 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.018925    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrzs\" (UniqueName: \"kubernetes.io/projected/05b053a4-a233-44d0-97d2-57f6b236b105-kube-api-access-hrrzs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:47.018983 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.018949    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05b053a4-a233-44d0-97d2-57f6b236b105-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:47.018983 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.018959    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05b053a4-a233-44d0-97d2-57f6b236b105-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:28:47.199545 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.199521    2584 generic.go:356] "Generic (PLEG): container finished" podID="05b053a4-a233-44d0-97d2-57f6b236b105" containerID="7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3" exitCode=0
Jul 24 19:28:47.199659 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.199565    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"
Jul 24 19:28:47.199659 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.199597    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm" event={"ID":"05b053a4-a233-44d0-97d2-57f6b236b105","Type":"ContainerDied","Data":"7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3"}
Jul 24 19:28:47.199659 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.199636    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm" event={"ID":"05b053a4-a233-44d0-97d2-57f6b236b105","Type":"ContainerDied","Data":"a3a80c8bd3ff02f813945f66f003d94feb60dc96ac9a270d0f74643198874f60"}
Jul 24 19:28:47.199659 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.199654    2584 scope.go:117] "RemoveContainer" containerID="7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3"
Jul 24 19:28:47.208486 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.208471    2584 scope.go:117] "RemoveContainer" containerID="7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3"
Jul 24 19:28:47.208708 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:28:47.208688    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3\": container with ID starting with 7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3 not found: ID does not exist" containerID="7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3"
Jul 24 19:28:47.208750 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.208715    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3"} err="failed to get container status \"7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3\": rpc error: code = NotFound desc = could not find container \"7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3\": container with ID starting with 7bdf8fdbcc64a2dce3c42b0af4f3e069fa6191ec4e64af2c1f0b5621386112f3 not found: ID does not exist"
Jul 24 19:28:47.222181 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.222157    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"]
Jul 24 19:28:47.225793 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:47.225773    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-2d5d53/ipp-route-2d5d53-kserve-5447db45cf-h52xm"]
Jul 24 19:28:48.573866 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:28:48.573836    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b053a4-a233-44d0-97d2-57f6b236b105" path="/var/lib/kubelet/pods/05b053a4-a233-44d0-97d2-57f6b236b105/volumes"
Jul 24 19:29:40.309607 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.309523    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"]
Jul 24 19:29:40.310171 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.309730    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq" podUID="2f8e375c-19d6-495f-8341-1b0f562a6dc2" containerName="payload-pre-processing" containerID="cri-o://996b31e752fc5d1ad0484b12014abaadd18295433ebf4f8c1820eeb254c4516c" gracePeriod=30
Jul 24 19:29:40.475104 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.475045    2584 generic.go:356] "Generic (PLEG): container finished" podID="2f8e375c-19d6-495f-8341-1b0f562a6dc2" containerID="996b31e752fc5d1ad0484b12014abaadd18295433ebf4f8c1820eeb254c4516c" exitCode=0
Jul 24 19:29:40.475257 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.475120    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq" event={"ID":"2f8e375c-19d6-495f-8341-1b0f562a6dc2","Type":"ContainerDied","Data":"996b31e752fc5d1ad0484b12014abaadd18295433ebf4f8c1820eeb254c4516c"}
Jul 24 19:29:40.559680 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.559625    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:29:40.641795 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.641767    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lcgc\" (UniqueName: \"kubernetes.io/projected/2f8e375c-19d6-495f-8341-1b0f562a6dc2-kube-api-access-9lcgc\") pod \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") "
Jul 24 19:29:40.641956 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.641864    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8e375c-19d6-495f-8341-1b0f562a6dc2-plugins-config-volume\") pod \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\" (UID: \"2f8e375c-19d6-495f-8341-1b0f562a6dc2\") "
Jul 24 19:29:40.642214 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.642184    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f8e375c-19d6-495f-8341-1b0f562a6dc2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f8e375c-19d6-495f-8341-1b0f562a6dc2" (UID: "2f8e375c-19d6-495f-8341-1b0f562a6dc2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:40.643783 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.643754    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f8e375c-19d6-495f-8341-1b0f562a6dc2-kube-api-access-9lcgc" (OuterVolumeSpecName: "kube-api-access-9lcgc") pod "2f8e375c-19d6-495f-8341-1b0f562a6dc2" (UID: "2f8e375c-19d6-495f-8341-1b0f562a6dc2"). InnerVolumeSpecName "kube-api-access-9lcgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:29:40.749009 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.744228    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lcgc\" (UniqueName: \"kubernetes.io/projected/2f8e375c-19d6-495f-8341-1b0f562a6dc2-kube-api-access-9lcgc\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:29:40.749009 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:40.744266    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8e375c-19d6-495f-8341-1b0f562a6dc2-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:29:41.482290 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:41.482258    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"
Jul 24 19:29:41.482290 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:41.482256    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq" event={"ID":"2f8e375c-19d6-495f-8341-1b0f562a6dc2","Type":"ContainerDied","Data":"dd5554ff81c28ca906e900650d043f49339b6d2d602d96ea51a01d6baa39891c"}
Jul 24 19:29:41.482833 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:41.482341    2584 scope.go:117] "RemoveContainer" containerID="996b31e752fc5d1ad0484b12014abaadd18295433ebf4f8c1820eeb254c4516c"
Jul 24 19:29:41.507357 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:41.507321    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"]
Jul 24 19:29:41.510147 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:41.510122    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8a409a-5dbb5c868-r6vzq"]
Jul 24 19:29:42.574424 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:42.574395    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f8e375c-19d6-495f-8341-1b0f562a6dc2" path="/var/lib/kubelet/pods/2f8e375c-19d6-495f-8341-1b0f562a6dc2/volumes"
Jul 24 19:29:51.808811 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.808775    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"]
Jul 24 19:29:51.809371 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809353    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dece38a9-0e48-4bd1-a2b7-9ea937a96413" containerName="payload-processing"
Jul 24 19:29:51.809427 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809374    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dece38a9-0e48-4bd1-a2b7-9ea937a96413" containerName="payload-processing"
Jul 24 19:29:51.809427 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809393    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b053a4-a233-44d0-97d2-57f6b236b105" containerName="main"
Jul 24 19:29:51.809427 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809402    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b053a4-a233-44d0-97d2-57f6b236b105" containerName="main"
Jul 24 19:29:51.809427 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809420    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809429    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809440    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809449    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809473    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb967b16-c365-4395-8abd-461e6c480b12" containerName="payload-pre-processing"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809483    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb967b16-c365-4395-8abd-461e6c480b12" containerName="payload-pre-processing"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809497    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f8e375c-19d6-495f-8341-1b0f562a6dc2" containerName="payload-pre-processing"
Jul 24 19:29:51.809570 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809506    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f8e375c-19d6-495f-8341-1b0f562a6dc2" containerName="payload-pre-processing"
Jul 24 19:29:51.809803 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809587    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb967b16-c365-4395-8abd-461e6c480b12" containerName="payload-pre-processing"
Jul 24 19:29:51.809803 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809597    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dece38a9-0e48-4bd1-a2b7-9ea937a96413" containerName="payload-processing"
Jul 24 19:29:51.809803 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809606    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f8e375c-19d6-495f-8341-1b0f562a6dc2" containerName="payload-pre-processing"
Jul 24 19:29:51.809803 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809613    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b053a4-a233-44d0-97d2-57f6b236b105" containerName="main"
Jul 24 19:29:51.809803 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.809621    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy"
Jul 24 19:29:51.813047 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.813031    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:51.816880 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.816831    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 19:29:51.816880 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.816866    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krdxl\""
Jul 24 19:29:51.863775 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.863750    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"]
Jul 24 19:29:51.935826 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:51.935798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9362f9e0-44e4-41df-9def-5146335e7419-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd\" (UID: \"9362f9e0-44e4-41df-9def-5146335e7419\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:52.036798 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:52.036773    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9362f9e0-44e4-41df-9def-5146335e7419-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd\" (UID: \"9362f9e0-44e4-41df-9def-5146335e7419\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:52.037347 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:52.037331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9362f9e0-44e4-41df-9def-5146335e7419-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd\" (UID: \"9362f9e0-44e4-41df-9def-5146335e7419\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:52.122957 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:52.122936    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:52.461780 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:52.461751    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"]
Jul 24 19:29:52.462783 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:29:52.462756    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9362f9e0_44e4_41df_9def_5146335e7419.slice/crio-315518dfc0eb9eeaae93f0f806f0a2526e73bf8db0c57f162edaf30170a03d4f WatchSource:0}: Error finding container 315518dfc0eb9eeaae93f0f806f0a2526e73bf8db0c57f162edaf30170a03d4f: Status 404 returned error can't find the container with id 315518dfc0eb9eeaae93f0f806f0a2526e73bf8db0c57f162edaf30170a03d4f
Jul 24 19:29:52.543538 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:52.543506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd" event={"ID":"9362f9e0-44e4-41df-9def-5146335e7419","Type":"ContainerStarted","Data":"315518dfc0eb9eeaae93f0f806f0a2526e73bf8db0c57f162edaf30170a03d4f"}
Jul 24 19:29:53.549915 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:53.549878    2584 generic.go:356] "Generic (PLEG): container finished" podID="9362f9e0-44e4-41df-9def-5146335e7419" containerID="5e0b9e835a6c3a69786111a95775049ce6ba1347a6436d34e5280aa321d7a436" exitCode=0
Jul 24 19:29:53.550287 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:53.549934    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd" event={"ID":"9362f9e0-44e4-41df-9def-5146335e7419","Type":"ContainerDied","Data":"5e0b9e835a6c3a69786111a95775049ce6ba1347a6436d34e5280aa321d7a436"}
Jul 24 19:29:54.688350 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:54.688324    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:54.863298 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:54.863268    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9362f9e0-44e4-41df-9def-5146335e7419-maas-api-service-ca\") pod \"9362f9e0-44e4-41df-9def-5146335e7419\" (UID: \"9362f9e0-44e4-41df-9def-5146335e7419\") "
Jul 24 19:29:54.863579 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:54.863558    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9362f9e0-44e4-41df-9def-5146335e7419-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9362f9e0-44e4-41df-9def-5146335e7419" (UID: "9362f9e0-44e4-41df-9def-5146335e7419"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:29:54.964600 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:54.964576    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9362f9e0-44e4-41df-9def-5146335e7419-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:29:55.561098 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:55.561050    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd" event={"ID":"9362f9e0-44e4-41df-9def-5146335e7419","Type":"ContainerDied","Data":"315518dfc0eb9eeaae93f0f806f0a2526e73bf8db0c57f162edaf30170a03d4f"}
Jul 24 19:29:55.561098 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:55.561081    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"
Jul 24 19:29:55.561292 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:29:55.561113    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="315518dfc0eb9eeaae93f0f806f0a2526e73bf8db0c57f162edaf30170a03d4f"
Jul 24 19:30:06.857327 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:06.857295    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"]
Jul 24 19:30:06.861185 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:06.861161    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-65184f-l8wjd"]
Jul 24 19:30:08.575197 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:08.575166    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9362f9e0-44e4-41df-9def-5146335e7419" path="/var/lib/kubelet/pods/9362f9e0-44e4-41df-9def-5146335e7419/volumes"
Jul 24 19:30:35.911269 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:35.911229    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"]
Jul 24 19:30:35.911716 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:35.911470    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy" containerID="cri-o://35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93" gracePeriod=30
Jul 24 19:30:36.586831 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:36.586789    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d6cb47465-gr8ql_c20fa890-7264-4d56-873f-cd30399c6441/authorino/0.log"
Jul 24 19:30:41.155364 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.155336    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:30:41.250284 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250218    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-podinfo\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250284 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250258    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9248b57-4dce-4df8-adeb-cf892c781c52-istiod-ca-cert\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250284 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250284    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-socket\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250540 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250303    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-token\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250540 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250338    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-certs\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250540 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250362    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-data\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250540 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250425    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-envoy\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250540 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250457    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-credential-socket\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250540 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250491    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdtxc\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-kube-api-access-hdtxc\") pod \"d9248b57-4dce-4df8-adeb-cf892c781c52\" (UID: \"d9248b57-4dce-4df8-adeb-cf892c781c52\") "
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250570    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250655    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250674    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9248b57-4dce-4df8-adeb-cf892c781c52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250799    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250927    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9248b57-4dce-4df8-adeb-cf892c781c52-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250946    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.250962 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250960    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.251272 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.250974    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.251344 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.251318    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:41.252934 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.252913    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-kube-api-access-hdtxc" (OuterVolumeSpecName: "kube-api-access-hdtxc") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "kube-api-access-hdtxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:41.253036 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.252942    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:41.253036 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.252995    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:30:41.253036 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.252998    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9248b57-4dce-4df8-adeb-cf892c781c52" (UID: "d9248b57-4dce-4df8-adeb-cf892c781c52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:41.352103 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.352079    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.352103 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.352100    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdtxc\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-kube-api-access-hdtxc\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.352240 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.352111    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.352240 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.352119    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.352240 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.352127    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9248b57-4dce-4df8-adeb-cf892c781c52-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 24 19:30:41.802345 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.802313    2584 generic.go:356] "Generic (PLEG): container finished" podID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerID="35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93" exitCode=0
Jul 24 19:30:41.802513 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.802366    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"
Jul 24 19:30:41.802513 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.802380    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" event={"ID":"d9248b57-4dce-4df8-adeb-cf892c781c52","Type":"ContainerDied","Data":"35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93"}
Jul 24 19:30:41.802513 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.802432    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5" event={"ID":"d9248b57-4dce-4df8-adeb-cf892c781c52","Type":"ContainerDied","Data":"89eb657c4647931398dc5b5c28df9c5c2faa523f40239923db3181f6dc25d6b5"}
Jul 24 19:30:41.802513 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.802463    2584 scope.go:117] "RemoveContainer" containerID="35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93"
Jul 24 19:30:41.814712 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.814691    2584 scope.go:117] "RemoveContainer" containerID="5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"
Jul 24 19:30:41.822904 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.822885    2584 scope.go:117] "RemoveContainer" containerID="35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93"
Jul 24 19:30:41.823169 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:30:41.823151    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93\": container with ID starting with 35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93 not found: ID does not exist" containerID="35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93"
Jul 24 19:30:41.823224 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.823178    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93"} err="failed to get container status \"35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93\": rpc error: code = NotFound desc = could not find container \"35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93\": container with ID starting with 35993dc84fe832347d4c6f5895b9da9c560a57ec73a972c6e8bb170cd0038a93 not found: ID does not exist"
Jul 24 19:30:41.823224 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.823197    2584 scope.go:117] "RemoveContainer" containerID="5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"
Jul 24 19:30:41.823453 ip-10-0-128-234 kubenswrapper[2584]: E0724 19:30:41.823434    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb\": container with ID starting with 5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb not found: ID does not exist" containerID="5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"
Jul 24 19:30:41.823497 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.823459    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb"} err="failed to get container status \"5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb\": rpc error: code = NotFound desc = could not find container \"5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb\": container with ID starting with 5bfbc37bf8dd1cf3510258e9722200a7069f4b4b17f2de98fa084f5ddd1609fb not found: ID does not exist"
Jul 24 19:30:41.833238 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.833217    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"]
Jul 24 19:30:41.836096 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:41.836053    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d391c5-openshift-default-8555f98bd-g28s5"]
Jul 24 19:30:42.548429 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:42.548400    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-gx4zz_1e27bb05-f9da-4dd6-b875-b8c6034ad4ec/copy-manifests/0.log"
Jul 24 19:30:42.567529 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:42.567500    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-gx4zz_1e27bb05-f9da-4dd6-b875-b8c6034ad4ec/manager/0.log"
Jul 24 19:30:42.573387 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:42.573354    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" path="/var/lib/kubelet/pods/d9248b57-4dce-4df8-adeb-cf892c781c52/volumes"
Jul 24 19:30:43.135608 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:43.135579    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748660-trgbz_6bb92b72-71f3-4116-99e2-a685dceafbd1/cleanup/0.log"
Jul 24 19:30:44.235872 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.235839    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp_b807edd2-dc63-4b76-aa7d-606fd30a9d22/extract/0.log"
Jul 24 19:30:44.241973 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.241951    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp_b807edd2-dc63-4b76-aa7d-606fd30a9d22/util/0.log"
Jul 24 19:30:44.248699 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.248681    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp_b807edd2-dc63-4b76-aa7d-606fd30a9d22/pull/0.log"
Jul 24 19:30:44.356430 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.356410    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs_998c35c6-fe56-4a5e-8374-4ee798fbe4ad/util/0.log"
Jul 24 19:30:44.364324 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.364294    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs_998c35c6-fe56-4a5e-8374-4ee798fbe4ad/pull/0.log"
Jul 24 19:30:44.371974 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.371955    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs_998c35c6-fe56-4a5e-8374-4ee798fbe4ad/extract/0.log"
Jul 24 19:30:44.483709 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.483692    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq_26ade546-7cb7-4224-bd70-80e3707585ba/util/0.log"
Jul 24 19:30:44.491329 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.491265    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq_26ade546-7cb7-4224-bd70-80e3707585ba/pull/0.log"
Jul 24 19:30:44.497977 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.497962    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq_26ade546-7cb7-4224-bd70-80e3707585ba/extract/0.log"
Jul 24 19:30:44.605289 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.605273    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd_af50f11a-3c06-4502-8ced-00fc32fdee23/util/0.log"
Jul 24 19:30:44.612120 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.612102    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd_af50f11a-3c06-4502-8ced-00fc32fdee23/pull/0.log"
Jul 24 19:30:44.618557 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.618532    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd_af50f11a-3c06-4502-8ced-00fc32fdee23/extract/0.log"
Jul 24 19:30:44.742691 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.742601    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d6cb47465-gr8ql_c20fa890-7264-4d56-873f-cd30399c6441/authorino/0.log"
Jul 24 19:30:44.862478 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.862455    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-44x6t_c2a2d85e-8f43-4044-804a-9666dbcd7554/manager/0.log"
Jul 24 19:30:44.971507 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:44.971487    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mqhmn_a2ed359a-e962-40b5-8578-c030ed5bc0ee/manager/0.log"
Jul 24 19:30:45.201548 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:45.201518    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5dqxf_a2d68396-b85c-4e25-aab5-a840bb9de325/registry-server/0.log"
Jul 24 19:30:45.324504 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:45.324477    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7gck5_3bc1aa37-436e-4442-8e3b-f01424a6650d/manager/0.log"
Jul 24 19:30:45.898041 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:45.898013    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p_a61208a4-06ac-4e82-ae1d-989a200ae196/istio-proxy/0.log"
Jul 24 19:30:46.359563 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:46.359538    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/1.log"
Jul 24 19:30:46.713844 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:46.713768    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5884c859b7-9s7wm_eee7d57c-578f-4a71-9396-997f51897678/router/0.log"
Jul 24 19:30:47.157114 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:47.157085    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dtn28_28a5cbb8-1572-4cab-8bd0-f86df6e46b28/main/0.log"
Jul 24 19:30:47.487978 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:47.487862    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-24xs6_cdf6bcde-44d8-4180-a113-88c8bcfda9c8/main/0.log"
Jul 24 19:30:47.601398 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:47.601369    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-9wzwq_a5c5a56b-f63e-42f0-8cc7-9e2cecdf9f87/main/0.log"
Jul 24 19:30:53.207197 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207157    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vd7mh/must-gather-pprnk"]
Jul 24 19:30:53.207595 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207522    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9362f9e0-44e4-41df-9def-5146335e7419" containerName="revoke-keys"
Jul 24 19:30:53.207595 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207539    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9362f9e0-44e4-41df-9def-5146335e7419" containerName="revoke-keys"
Jul 24 19:30:53.207595 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207570    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy"
Jul 24 19:30:53.207595 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207578    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy"
Jul 24 19:30:53.207817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207677    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9362f9e0-44e4-41df-9def-5146335e7419" containerName="revoke-keys"
Jul 24 19:30:53.207817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207690    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy"
Jul 24 19:30:53.207817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207700    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0849274e-d208-4211-aae1-c6ece76dfea4" containerName="istio-proxy"
Jul 24 19:30:53.207817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207712    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy"
Jul 24 19:30:53.207817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207775    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy"
Jul 24 19:30:53.207817 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.207784    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9248b57-4dce-4df8-adeb-cf892c781c52" containerName="istio-proxy"
Jul 24 19:30:53.210774 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.210758    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.213936 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.213914    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd7mh\"/\"openshift-service-ca.crt\""
Jul 24 19:30:53.215157 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.215141    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vd7mh\"/\"default-dockercfg-xcq4b\""
Jul 24 19:30:53.215258 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.215164    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd7mh\"/\"kube-root-ca.crt\""
Jul 24 19:30:53.219643 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.219620    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd7mh/must-gather-pprnk"]
Jul 24 19:30:53.344410 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.344381    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b5q7\" (UniqueName: \"kubernetes.io/projected/098d6950-58cf-4ac9-8259-807fa8ab15dd-kube-api-access-2b5q7\") pod \"must-gather-pprnk\" (UID: \"098d6950-58cf-4ac9-8259-807fa8ab15dd\") " pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.344512 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.344463    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/098d6950-58cf-4ac9-8259-807fa8ab15dd-must-gather-output\") pod \"must-gather-pprnk\" (UID: \"098d6950-58cf-4ac9-8259-807fa8ab15dd\") " pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.445054 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.445029    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/098d6950-58cf-4ac9-8259-807fa8ab15dd-must-gather-output\") pod \"must-gather-pprnk\" (UID: \"098d6950-58cf-4ac9-8259-807fa8ab15dd\") " pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.445158 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.445081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b5q7\" (UniqueName: \"kubernetes.io/projected/098d6950-58cf-4ac9-8259-807fa8ab15dd-kube-api-access-2b5q7\") pod \"must-gather-pprnk\" (UID: \"098d6950-58cf-4ac9-8259-807fa8ab15dd\") " pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.445346 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.445327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/098d6950-58cf-4ac9-8259-807fa8ab15dd-must-gather-output\") pod \"must-gather-pprnk\" (UID: \"098d6950-58cf-4ac9-8259-807fa8ab15dd\") " pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.453704 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.453680    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b5q7\" (UniqueName: \"kubernetes.io/projected/098d6950-58cf-4ac9-8259-807fa8ab15dd-kube-api-access-2b5q7\") pod \"must-gather-pprnk\" (UID: \"098d6950-58cf-4ac9-8259-807fa8ab15dd\") " pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.520381 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.520321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd7mh/must-gather-pprnk"
Jul 24 19:30:53.647634 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.647607    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd7mh/must-gather-pprnk"]
Jul 24 19:30:53.649421 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:30:53.649393    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod098d6950_58cf_4ac9_8259_807fa8ab15dd.slice/crio-1aeed2ea2f4ce9d90fe0f16a59fd3ff0704ead5013ddee7cc4e6fc0ae5ba7dda WatchSource:0}: Error finding container 1aeed2ea2f4ce9d90fe0f16a59fd3ff0704ead5013ddee7cc4e6fc0ae5ba7dda: Status 404 returned error can't find the container with id 1aeed2ea2f4ce9d90fe0f16a59fd3ff0704ead5013ddee7cc4e6fc0ae5ba7dda
Jul 24 19:30:53.651249 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.651230    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:30:53.870955 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:53.870926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/must-gather-pprnk" event={"ID":"098d6950-58cf-4ac9-8259-807fa8ab15dd","Type":"ContainerStarted","Data":"1aeed2ea2f4ce9d90fe0f16a59fd3ff0704ead5013ddee7cc4e6fc0ae5ba7dda"}
Jul 24 19:30:54.881459 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:54.881375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/must-gather-pprnk" event={"ID":"098d6950-58cf-4ac9-8259-807fa8ab15dd","Type":"ContainerStarted","Data":"a00735e9b89fa324528f9f4db2ea28f71937a8fbdb59e2c8ca4b559e200f6872"}
Jul 24 19:30:54.881459 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:54.881418    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/must-gather-pprnk" event={"ID":"098d6950-58cf-4ac9-8259-807fa8ab15dd","Type":"ContainerStarted","Data":"01117094cc29f82d4b821ab1e9e1c309af46e2f33995ab932a58ed4033a90fba"}
Jul 24 19:30:54.898241 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:54.898191    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vd7mh/must-gather-pprnk" podStartSLOduration=0.949543655 podStartE2EDuration="1.898173408s" totalImagesPullingTime="948.629753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:30:54.897954808 +0000 UTC m=+3046.815806334" watchObservedRunningTime="2026-07-24 19:30:54.898173408 +0000 UTC m=+3046.816024935"
Jul 24 19:30:56.091115 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:56.091082    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8p2g2_99185c08-404e-46af-9db0-6cf2685a34af/global-pull-secret-syncer/0.log"
Jul 24 19:30:56.308546 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:56.308514    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k7h9t_6761a61a-dc33-4cc2-8ae8-d81c932c884a/konnectivity-agent/0.log"
Jul 24 19:30:56.355887 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:56.355815    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-234.ec2.internal_c3223b98fdb2defd61f890e3a6a17d0f/haproxy/0.log"
Jul 24 19:30:59.911851 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:59.911799    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp_b807edd2-dc63-4b76-aa7d-606fd30a9d22/extract/0.log"
Jul 24 19:30:59.953365 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:59.953330    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp_b807edd2-dc63-4b76-aa7d-606fd30a9d22/util/0.log"
Jul 24 19:30:59.984265 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:30:59.984223    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598tsmp_b807edd2-dc63-4b76-aa7d-606fd30a9d22/pull/0.log"
Jul 24 19:31:00.010703 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.010667    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs_998c35c6-fe56-4a5e-8374-4ee798fbe4ad/extract/0.log"
Jul 24 19:31:00.035950 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.035912    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs_998c35c6-fe56-4a5e-8374-4ee798fbe4ad/util/0.log"
Jul 24 19:31:00.059327 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.059289    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b4lbs_998c35c6-fe56-4a5e-8374-4ee798fbe4ad/pull/0.log"
Jul 24 19:31:00.087072 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.087025    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq_26ade546-7cb7-4224-bd70-80e3707585ba/extract/0.log"
Jul 24 19:31:00.112608 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.112573    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq_26ade546-7cb7-4224-bd70-80e3707585ba/util/0.log"
Jul 24 19:31:00.134820 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.134788    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bnxvq_26ade546-7cb7-4224-bd70-80e3707585ba/pull/0.log"
Jul 24 19:31:00.169673 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.169578    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd_af50f11a-3c06-4502-8ced-00fc32fdee23/extract/0.log"
Jul 24 19:31:00.192950 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.192910    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd_af50f11a-3c06-4502-8ced-00fc32fdee23/util/0.log"
Jul 24 19:31:00.214965 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.214938    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1478kd_af50f11a-3c06-4502-8ced-00fc32fdee23/pull/0.log"
Jul 24 19:31:00.795428 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.795390    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d6cb47465-gr8ql_c20fa890-7264-4d56-873f-cd30399c6441/authorino/0.log"
Jul 24 19:31:00.838604 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.838266    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-44x6t_c2a2d85e-8f43-4044-804a-9666dbcd7554/manager/0.log"
Jul 24 19:31:00.884206 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:00.884129    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mqhmn_a2ed359a-e962-40b5-8578-c030ed5bc0ee/manager/0.log"
Jul 24 19:31:01.010796 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:01.010760    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5dqxf_a2d68396-b85c-4e25-aab5-a840bb9de325/registry-server/0.log"
Jul 24 19:31:01.276460 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:01.275767    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7gck5_3bc1aa37-436e-4442-8e3b-f01424a6650d/manager/0.log"
Jul 24 19:31:02.900762 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:02.900691    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/alertmanager/0.log"
Jul 24 19:31:02.929172 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:02.929140    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/config-reloader/0.log"
Jul 24 19:31:02.952341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:02.952310    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/kube-rbac-proxy-web/0.log"
Jul 24 19:31:02.976691 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:02.976652    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/kube-rbac-proxy/0.log"
Jul 24 19:31:02.999315 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:02.999282    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/kube-rbac-proxy-metric/0.log"
Jul 24 19:31:03.025498 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.025471    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/prom-label-proxy/0.log"
Jul 24 19:31:03.052207 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.052176    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff640631-4910-40dc-ab09-5793da4e3c4e/init-config-reloader/0.log"
Jul 24 19:31:03.261140 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.261020    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7485849964-r7dzb_02132501-3263-47d4-9275-7099e266c54b/metrics-server/0.log"
Jul 24 19:31:03.482856 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.482821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rxl78_9c89ec0b-98ec-44ee-acde-3e955fce0769/node-exporter/0.log"
Jul 24 19:31:03.514843 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.514641    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rxl78_9c89ec0b-98ec-44ee-acde-3e955fce0769/kube-rbac-proxy/0.log"
Jul 24 19:31:03.540978 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.539629    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rxl78_9c89ec0b-98ec-44ee-acde-3e955fce0769/init-textfile/0.log"
Jul 24 19:31:03.574341 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.574267    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xbscq_8c7696ea-c2cb-4f41-bf56-d3934e29d59a/kube-rbac-proxy-main/0.log"
Jul 24 19:31:03.597045 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.597013    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xbscq_8c7696ea-c2cb-4f41-bf56-d3934e29d59a/kube-rbac-proxy-self/0.log"
Jul 24 19:31:03.625968 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:03.625939    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xbscq_8c7696ea-c2cb-4f41-bf56-d3934e29d59a/openshift-state-metrics/0.log"
Jul 24 19:31:04.006812 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:04.006776    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8449f878-9nq85_f6e1ddb0-027b-4665-a186-bb416c47c8b6/thanos-query/0.log"
Jul 24 19:31:04.030463 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:04.030433    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8449f878-9nq85_f6e1ddb0-027b-4665-a186-bb416c47c8b6/kube-rbac-proxy-web/0.log"
Jul 24 19:31:04.052675 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:04.052632    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8449f878-9nq85_f6e1ddb0-027b-4665-a186-bb416c47c8b6/kube-rbac-proxy/0.log"
Jul 24 19:31:04.074372 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:04.074342    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8449f878-9nq85_f6e1ddb0-027b-4665-a186-bb416c47c8b6/prom-label-proxy/0.log"
Jul 24 19:31:04.101146 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:04.101118    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8449f878-9nq85_f6e1ddb0-027b-4665-a186-bb416c47c8b6/kube-rbac-proxy-rules/0.log"
Jul 24 19:31:04.124035 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:04.124008    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b8449f878-9nq85_f6e1ddb0-027b-4665-a186-bb416c47c8b6/kube-rbac-proxy-metrics/0.log"
Jul 24 19:31:06.543112 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.543076    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"]
Jul 24 19:31:06.547392 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.547368    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.554610 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.554585    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"]
Jul 24 19:31:06.610321 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.610284    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-proc\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.610697 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.610671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-lib-modules\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.610930 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.610903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55xv\" (UniqueName: \"kubernetes.io/projected/132a5020-f674-4a3b-95f5-018194c194b9-kube-api-access-x55xv\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.611134 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.611114    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-podres\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.611598 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.611580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-sys\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.713386 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.713340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-proc\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.713681 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.713553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-proc\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.713869 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.713848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-lib-modules\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.714195 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.714173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55xv\" (UniqueName: \"kubernetes.io/projected/132a5020-f674-4a3b-95f5-018194c194b9-kube-api-access-x55xv\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.714369 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.714351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-podres\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.715005 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.714983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-sys\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.715288 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.714117    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-lib-modules\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.715418 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.715184    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-sys\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.715524 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.714873    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132a5020-f674-4a3b-95f5-018194c194b9-podres\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.724372 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.724348    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55xv\" (UniqueName: \"kubernetes.io/projected/132a5020-f674-4a3b-95f5-018194c194b9-kube-api-access-x55xv\") pod \"perf-node-gather-daemonset-2dlpb\" (UID: \"132a5020-f674-4a3b-95f5-018194c194b9\") " pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:06.861949 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:06.861906    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:07.045968 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:07.045922    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"]
Jul 24 19:31:07.049721 ip-10-0-128-234 kubenswrapper[2584]: W0724 19:31:07.049689    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod132a5020_f674_4a3b_95f5_018194c194b9.slice/crio-6ad1b3e085070f0965dbc478346de8ec75caf6ebfa12fc936010b1d76de8270e WatchSource:0}: Error finding container 6ad1b3e085070f0965dbc478346de8ec75caf6ebfa12fc936010b1d76de8270e: Status 404 returned error can't find the container with id 6ad1b3e085070f0965dbc478346de8ec75caf6ebfa12fc936010b1d76de8270e
Jul 24 19:31:08.008753 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.008706    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb" event={"ID":"132a5020-f674-4a3b-95f5-018194c194b9","Type":"ContainerStarted","Data":"af75dc470f8718645361719a5efce17f0883ea8203caf46264a2cb7720be10e2"}
Jul 24 19:31:08.009259 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.008781    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb" event={"ID":"132a5020-f674-4a3b-95f5-018194c194b9","Type":"ContainerStarted","Data":"6ad1b3e085070f0965dbc478346de8ec75caf6ebfa12fc936010b1d76de8270e"}
Jul 24 19:31:08.009615 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.009587    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:08.036338 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.036281    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb" podStartSLOduration=2.036259218 podStartE2EDuration="2.036259218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:31:08.033907776 +0000 UTC m=+3059.951759303" watchObservedRunningTime="2026-07-24 19:31:08.036259218 +0000 UTC m=+3059.954110744"
Jul 24 19:31:08.488087 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.487883    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hq7d8_672be5d8-e78c-48f2-8b1d-076fa1a61c2b/dns/0.log"
Jul 24 19:31:08.526105 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.526027    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hq7d8_672be5d8-e78c-48f2-8b1d-076fa1a61c2b/kube-rbac-proxy/0.log"
Jul 24 19:31:08.595977 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:08.595945    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6g8zt_84e84626-467b-4a32-88cd-e8f163e4d239/dns-node-resolver/0.log"
Jul 24 19:31:09.246635 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:09.246557    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h67c8_c12be58e-5ecc-4abb-b3e4-e039a6bfdc01/node-ca/0.log"
Jul 24 19:31:10.167770 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:10.167739    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p_a61208a4-06ac-4e82-ae1d-989a200ae196/istio-proxy/0.log"
Jul 24 19:31:10.381311 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:10.381282    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/0.log"
Jul 24 19:31:10.441242 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:10.441150    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/1.log"
Jul 24 19:31:10.542783 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:10.542753    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5884c859b7-9s7wm_eee7d57c-578f-4a71-9396-997f51897678/router/0.log"
Jul 24 19:31:11.372760 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:11.372675    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vllf4_b2ac3053-85af-4a76-b6ad-14738a999ed5/serve-healthcheck-canary/0.log"
Jul 24 19:31:11.917128 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:11.917095    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpcm9_93c975f2-1b02-464d-9c3c-6fd0afb03efa/kube-rbac-proxy/0.log"
Jul 24 19:31:11.937711 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:11.937682    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpcm9_93c975f2-1b02-464d-9c3c-6fd0afb03efa/exporter/0.log"
Jul 24 19:31:11.958944 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:11.958898    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpcm9_93c975f2-1b02-464d-9c3c-6fd0afb03efa/extractor/0.log"
Jul 24 19:31:14.769626 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:14.769568    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-gx4zz_1e27bb05-f9da-4dd6-b875-b8c6034ad4ec/manager/0.log"
Jul 24 19:31:14.785222 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:14.785200    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859dddff6f-gx4zz_1e27bb05-f9da-4dd6-b875-b8c6034ad4ec/copy-manifests/0.log"
Jul 24 19:31:15.037951 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:15.037871    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vd7mh/perf-node-gather-daemonset-2dlpb"
Jul 24 19:31:16.018982 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:16.018949    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8456f466bb-rqxgh_9eda87f9-bd62-4195-98a2-80fb4191b82a/manager/0.log"
Jul 24 19:31:16.386646 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:16.386612    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p_a61208a4-06ac-4e82-ae1d-989a200ae196/istio-proxy/0.log"
Jul 24 19:31:16.576765 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:16.576712    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/0.log"
Jul 24 19:31:16.634656 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:16.634599    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/1.log"
Jul 24 19:31:16.717526 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:16.717461    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5884c859b7-9s7wm_eee7d57c-578f-4a71-9396-997f51897678/router/0.log"
Jul 24 19:31:18.203472 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:18.203436    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-htd6p_a61208a4-06ac-4e82-ae1d-989a200ae196/istio-proxy/0.log"
Jul 24 19:31:18.397081 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:18.397030    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/0.log"
Jul 24 19:31:18.446596 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:18.446564    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fcmm9_f32fdf0f-6d4a-4b15-926d-15f3b5ec07a2/istio-proxy/1.log"
Jul 24 19:31:18.525214 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:18.525123    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5884c859b7-9s7wm_eee7d57c-578f-4a71-9396-997f51897678/router/0.log"
Jul 24 19:31:23.074633 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.074601    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/kube-multus-additional-cni-plugins/0.log"
Jul 24 19:31:23.095329 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.095294    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/egress-router-binary-copy/0.log"
Jul 24 19:31:23.117051 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.117028    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/cni-plugins/0.log"
Jul 24 19:31:23.140541 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.140513    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/bond-cni-plugin/0.log"
Jul 24 19:31:23.163466 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.163442    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/routeoverride-cni/0.log"
Jul 24 19:31:23.185925 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.185901    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/whereabouts-cni-bincopy/0.log"
Jul 24 19:31:23.208629 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.208607    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbmrr_94612fef-a392-4883-bf20-f6833abfc633/whereabouts-cni/0.log"
Jul 24 19:31:23.484369 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.484339    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w5khr_c25d5aec-fb62-4d91-889d-083638106e22/kube-multus/0.log"
Jul 24 19:31:23.601528 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.601496    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z85kl_e88c7e1b-b36d-4832-b697-5fc853aeac4e/network-metrics-daemon/0.log"
Jul 24 19:31:23.619617 ip-10-0-128-234 kubenswrapper[2584]: I0724 19:31:23.619587    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z85kl_e88c7e1b-b36d-4832-b697-5fc853aeac4e/kube-rbac-proxy/0.log"