Jul 26 15:16:32.028241 ip-10-0-137-96 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 26 15:16:32.028255 ip-10-0-137-96 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 26 15:16:32.028265 ip-10-0-137-96 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 26 15:16:32.028585 ip-10-0-137-96 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 26 15:16:41.581202 ip-10-0-137-96 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 26 15:16:41.581216 ip-10-0-137-96 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5b5850aa17c74fe185db8b394fe9b505 --
Jul 26 15:18:09.264840 ip-10-0-137-96 systemd[1]: Starting Kubernetes Kubelet...
Jul 26 15:18:09.670961 ip-10-0-137-96 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:18:09.670961 ip-10-0-137-96 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 26 15:18:09.670961 ip-10-0-137-96 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:18:09.670961 ip-10-0-137-96 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 26 15:18:09.670961 ip-10-0-137-96 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:18:09.673063 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.672927    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 26 15:18:09.676715 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676699    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:18:09.676715 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676715    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676719    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676723    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676726    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676728    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676731    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676735    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676738    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676741    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676743    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676751    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676754    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676757    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676760    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676763    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676765    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676768    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676770    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676773    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:18:09.676776 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676775    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676778    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676781    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676784    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676787    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676789    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676792    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676795    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676797    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676800    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676802    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676805    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676808    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676810    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676813    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676815    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676818    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676820    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676823    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676825    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:18:09.677242 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676828    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676830    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676833    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676835    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676838    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676840    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676843    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676846    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676849    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676851    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676854    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676856    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676859    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676861    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676864    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676867    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676869    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676872    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676875    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676878    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:18:09.677772 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676880    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676883    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676885    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676888    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676892    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676896    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676898    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676902    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676905    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676907    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676910    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676915    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676918    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676921    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676924    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676926    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676929    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676931    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676934    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:18:09.678258 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676937    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676939    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676942    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676944    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676947    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676949    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676952    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676954    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676957    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676959    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676962    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676965    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676968    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676970    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676973    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676975    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676987    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676992    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676995    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.676998    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:18:09.678727 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677777    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677785    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677788    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677791    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677794    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677797    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677800    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677804    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677807    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677809    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677812    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677815    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677818    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677820    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677823    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677825    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677828    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677830    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677833    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677836    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:18:09.679193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677839    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677841    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677844    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677847    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677849    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677852    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677854    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677857    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677859    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677862    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677864    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677867    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677869    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677872    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677875    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677879    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677883    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677886    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677889    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:18:09.679698 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677893    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677895    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677898    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677900    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677903    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677905    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677908    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677910    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677914    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677917    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677919    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677922    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677924    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677927    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677929    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677931    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677934    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677937    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677939    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677941    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:18:09.680155 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677944    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677946    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677949    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677951    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677954    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677956    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677960    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677963    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677966    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677969    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677972    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677974    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677979    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677982    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677984    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677987    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677989    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677993    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677996    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:18:09.680653 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.677999    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678002    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678005    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678008    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678011    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678014    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678017    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678020    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678022    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678025    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678028    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678030    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678033    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678035    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678038    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678040    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678043    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678045    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678048    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678050    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:18:09.681124 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678053    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678412    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678417    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678419    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678424    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678429    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678432    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678435    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678438    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678441    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678445    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678447    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678450    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678453    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678456    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678459    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678461    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678464    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678467    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:18:09.681647 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678470    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678473    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678475    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678478    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678481    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678483    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678486    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678489    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678491    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678494    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678497    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678499    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678502    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678504    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678506    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678509    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678511    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678514    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678517    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678520    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:18:09.682132 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678523    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678525    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678528    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678531    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678533    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678553    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678557    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678561    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678565    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678567    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678571    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678574    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678577    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678581    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678584    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678587    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678591    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678595    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678597    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:18:09.682662 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678600    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678602    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678605    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678608    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678610    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678613    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678615    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678618    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678620    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678623    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678626    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678628    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678631    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678634    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678637    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678640    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678642    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678645    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678647    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678650    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:18:09.683140 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678652    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678655    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678658    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678660    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678662    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678665    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678668    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678670    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678672    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678675    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678678    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678680    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678684    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678686    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678689    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678691    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678694    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678696    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678699    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678701    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:18:09.683628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678704    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.678706    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678784    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678792    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678800    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678807    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678815    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678820    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678825    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678829    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678832    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678835    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678839    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678842    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678845    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678848    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678851    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678854    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678856    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678859    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678864    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678867    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678870    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678873    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 26 15:18:09.684145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678876    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678880    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678883    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678886    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678889    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678892    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678895    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678898    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678901    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678904    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678908    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678911    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678914    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678917    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678920    2561 flags.go:64] FLAG: --enable-server="true"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678925    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678929    2561 flags.go:64] FLAG: --event-burst="100"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678932    2561 flags.go:64] FLAG: --event-qps="50"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678935    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678938    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678940    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678944    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678947    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678950    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678952    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 26 15:18:09.684738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678955    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678958    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678961    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678964    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678967    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678969    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678972    2561 flags.go:64] FLAG: --feature-gates=""
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678975    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678978    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678981    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678984    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678987    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678990    2561 flags.go:64] FLAG: --help="false"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678993    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678996    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.678999    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679002    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679005    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679008    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679011    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679014    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679017    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679020    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 26 15:18:09.685351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679023    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679026    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679028    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679031    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679034    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679037    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679039    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679042    2561 flags.go:64] FLAG: --lock-file=""
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679044    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679047    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679050    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679056    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679058    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679061    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679064    2561 flags.go:64] FLAG: --logging-format="text"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679067    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679070    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679073    2561 flags.go:64] FLAG: --manifest-url=""
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679075    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679079    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679082    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679086    2561 flags.go:64] FLAG: --max-pods="110"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679089    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679092    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679094    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 26 15:18:09.685968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679097    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679100    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679103    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679106    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679115    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679118    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679121    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679124    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679127    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679132    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679135    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679138    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679140    2561 flags.go:64] FLAG: --port="10250"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679144    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679147    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e0c5d88b2114772e"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679150    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679153    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679155    2561 flags.go:64] FLAG: --register-node="true"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679158    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679162    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679165    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679168    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679171    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679174    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679177    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 26 15:18:09.686604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679180    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679184    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679186    2561 flags.go:64] FLAG: --runonce="false"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679189    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679192    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679195    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679198    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679201    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679204    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679207    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679210    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679215    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679218    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679220    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679223    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679226    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679229    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679232    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679237    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679240    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679243    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679247    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679250    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679253    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679256    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 26 15:18:09.687213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679259    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679261    2561 flags.go:64] FLAG: --v="2"
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679266    2561 flags.go:64] FLAG: --version="false"
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679273    2561 flags.go:64] FLAG: --vmodule=""
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679277    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.679280    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679393    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679396    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679399    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679401    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679404    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679407    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679409    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679413    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679416    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679419    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679422    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679425    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679429    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679432    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:18:09.687863 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679434    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679437    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679440    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679442    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679445    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679448    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679451    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679453    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679456    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679458    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679461    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679463    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679466    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679468    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679471    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679474    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679477    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679480    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679482    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679485    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:18:09.688357 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679488    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679491    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679493    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679496    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679499    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679501    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679504    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679506    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679509    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679511    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679516    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679519    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679521    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679525    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679528    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679531    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679551    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679556    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679561    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679565    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:18:09.688885 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679568    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679571    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679573    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679576    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679578    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679581    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679583    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679587    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679590    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679592    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679595    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679597    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679600    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679603    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679605    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679608    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679611    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679613    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679616    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679618    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:18:09.689371 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679621    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679623    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679627    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679629    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679632    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679634    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679637    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679640    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679643    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679647    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679650    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679653    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679656    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679659    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679661    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679664    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679667    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679669    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679672    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:18:09.689880 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679676    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679679    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679681    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679684    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679687    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.679690    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.680625    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.688009    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.688028    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.688871    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.688882    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688952    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688957    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688961    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688964    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:18:09.690342 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688967    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688969    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688972    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688975    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688978    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688988    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688991    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688994    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.688997    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689000    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689003    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689005    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689008    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689011    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689014    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689016    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689019    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689022    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689024    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689026    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:18:09.690824 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689029    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689032    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689034    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689037    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689040    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689050    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689053    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689055    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689058    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689060    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689064    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689068    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689071    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689074    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689076    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689079    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689081    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689084    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689086    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689089    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:18:09.691308 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689091    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689094    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689096    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689099    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689101    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689103    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689106    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689108    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689111    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689113    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689116    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689119    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689121    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689123    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689126    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689130    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689134    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689137    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689145    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:18:09.691814 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689148    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689151    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689154    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689157    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689159    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689162    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689164    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689167    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689169    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689171    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689174    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689176    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689179    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689182    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689184    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689187    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689189    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689191    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689194    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689196    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:18:09.692260 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689198    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689201    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689203    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689206    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689208    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689210    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689214    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689217    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689220    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689223    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689226    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689234    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689244    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689247    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689250    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:18:09.692827 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689252    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.689258    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689407    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689412    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689415    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689418    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689421    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689424    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689427    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689429    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689432    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689434    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689437    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689440    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689442    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:18:09.693215 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689445    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689447    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689450    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689452    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689455    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689457    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689460    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689462    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689464    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689467    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689469    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689472    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689474    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689477    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689481    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689490    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689493    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689496    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689499    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689502    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:18:09.693604 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689505    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689508    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689510    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689513    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689515    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689518    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689520    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689523    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689525    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689527    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689530    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689532    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689547    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689550    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689553    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689555    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689558    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689561    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689563    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:18:09.694091 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689566    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689568    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689571    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689573    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689576    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689579    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689582    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689584    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689586    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689595    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689597    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689600    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689602    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689605    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689608    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689610    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689613    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689615    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689617    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689620    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:18:09.694532 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689622    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689625    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689627    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689630    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689632    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689635    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689637    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689640    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689642    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689644    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689647    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689649    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689652    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689654    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689656    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689659    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689662    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689664    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689666    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:18:09.695024 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689670    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689673    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689675    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689684    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689688    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689691    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689693    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:09.689696    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.689701    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.689829    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.691940    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.693339    2561 server.go:1019] "Starting client certificate rotation"
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.693440    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:18:09.695483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.693470    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:18:09.695907 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.695891    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:18:09.701370 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.701344    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:18:09.714387 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.714361    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 26 15:18:09.716670 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.716652    2561 log.go:25] "Validated CRI v1 image API"
Jul 26 15:18:09.718464 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.718448    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 26 15:18:09.730110 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.730088    2561 fs.go:135] Filesystem UUIDs: map[21785157-f5be-431a-8088-0f18f0011b5a:/dev/nvme0n1p4 28f2e9e5-7e44-4845-9e0a-0bd5c5a978a0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 26 15:18:09.730180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.730108    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 26 15:18:09.732425 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.732406    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:18:09.735277 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.735163    2561 manager.go:216] Machine: {Timestamp:2026-07-26 15:18:09.733892218 +0000 UTC m=+0.352782822 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094804 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f91c858b0edf5b596170befc2172 SystemUUID:ec21f91c-858b-0edf-5b59-6170befc2172 BootID:5b5850aa-17c7-4fe1-85db-8b394fe9b505 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:a5:f5:3e:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:a5:f5:3e:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:72:da:b3:ae:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 26 15:18:09.735277 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.735273    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 26 15:18:09.735386 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.735357    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 26 15:18:09.738268 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.738239    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 26 15:18:09.738422 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.738271    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 26 15:18:09.739042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.739032    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 26 15:18:09.739079 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.739045    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 26 15:18:09.739079 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.739053    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:18:09.739835 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.739825    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:18:09.740663 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.740653    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 26 15:18:09.742356 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742344    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:18:09.742487 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742478    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 26 15:18:09.742525 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742511    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 26 15:18:09.742525 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742523    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 26 15:18:09.742632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742562    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 26 15:18:09.742632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742580    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 26 15:18:09.742632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742594    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 26 15:18:09.742757 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.742671    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b5vcc"
Jul 26 15:18:09.743152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.743132    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:18:09.743262 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.743164    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:18:09.745561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.745525    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 26 15:18:09.748531 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.748508    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 26 15:18:09.748621 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.748564    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 26 15:18:09.750245 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750215    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 26 15:18:09.750245 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750257    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 26 15:18:09.750245 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750269    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 26 15:18:09.750473 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750280    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 26 15:18:09.750473 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750302    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 26 15:18:09.750473 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750452    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 26 15:18:09.750583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750479    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 26 15:18:09.750583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750455    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b5vcc"
Jul 26 15:18:09.750583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750558    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 26 15:18:09.750583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750573    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 26 15:18:09.750583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750580    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 26 15:18:09.750725 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750590    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 26 15:18:09.750725 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.750598    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 26 15:18:09.751942 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.751917    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 26 15:18:09.751942 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.751940    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 26 15:18:09.752673 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.752640    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 26 15:18:09.752757 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.752651    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 26 15:18:09.755457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.755443    2561 server.go:1268] "Started kubelet"
Jul 26 15:18:09.755594 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.755556    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 26 15:18:09.755643 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.755586    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 26 15:18:09.755699 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.755673    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 26 15:18:09.756955 ip-10-0-137-96 systemd[1]: Started Kubernetes Kubelet.
Jul 26 15:18:09.757629 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.757195    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 26 15:18:09.757752 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.757632    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 26 15:18:09.761248 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.761230    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 26 15:18:09.766494 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.766474    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 26 15:18:09.766608 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.766490    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 26 15:18:09.766667 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.766622    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-96.ec2.internal" not found
Jul 26 15:18:09.767183 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.766900    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:09.767389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767370    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 26 15:18:09.767475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767353    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 26 15:18:09.767475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767400    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 26 15:18:09.767566 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767483    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 26 15:18:09.767566 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767493    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 26 15:18:09.767566 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767551    2561 factory.go:55] Registering systemd factory
Jul 26 15:18:09.767686 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767568    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 26 15:18:09.767810 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767790    2561 factory.go:153] Registering CRI-O factory
Jul 26 15:18:09.767810 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767809    2561 factory.go:223] Registration of the crio container factory successfully
Jul 26 15:18:09.767960 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767870    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 26 15:18:09.767960 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767895    2561 factory.go:103] Registering Raw factory
Jul 26 15:18:09.767960 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.767913    2561 manager.go:1196] Started watching for new ooms in manager
Jul 26 15:18:09.768590 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.768575    2561 manager.go:349] Starting recovery of all containers
Jul 26 15:18:09.769100 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.769079    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:18:09.771775 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.771741    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.776267 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.776237    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 26 15:18:09.782443 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.782152    2561 manager.go:354] Recovery completed
Jul 26 15:18:09.784930 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.784910    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-96.ec2.internal" not found
Jul 26 15:18:09.787717 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.787704    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.789921 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.789904    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.789986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.789936    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.789986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.789946    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.790464 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.790450    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 26 15:18:09.790510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.790465    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 26 15:18:09.790510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.790479    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.790510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.790486    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:18:09.791288 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.791275    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.791332 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.791301    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.791332 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.791311    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.792261 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.792249    2561 policy_none.go:49] "None policy: Start"
Jul 26 15:18:09.792294 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.792266    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 26 15:18:09.792294 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.792276    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 26 15:18:09.793262 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.793251    2561 policy_none.go:47] "Start"
Jul 26 15:18:09.830197 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830170    2561 manager.go:337] "Starting Device Plugin manager"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.830209    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830222    2561 server.go:87] "Starting device plugin registration server"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830567    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830581    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830766    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830851    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.830859    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.831466    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.831520    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.840522    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.840585    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.840611    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 26 15:18:09.841380 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.840646    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 26 15:18:09.842193 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.842178    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-96.ec2.internal" not found
Jul 26 15:18:09.842602 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.842589    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:18:09.931165 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.931082    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.932182 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.932165    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.932255 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.932201    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.932255 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.932216    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.932255 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.932242    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.941250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.941230    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.941312 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.941254    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-96.ec2.internal\": node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:09.941354 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.941325    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"]
Jul 26 15:18:09.941387 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.941382    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.942731 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.942717    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.942797 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.942743    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.942797 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.942753    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.944085 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944070    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.944234 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944215    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.944234 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944252    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.944830 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944817    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.944912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944840    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.944912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944849    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.944912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944869    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.944912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944852    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.945100 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.944880    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.946232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.946217    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.946318 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.946247    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:18:09.946906 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.946889    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:18:09.946974 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.946920    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:18:09.946974 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.946936    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:18:09.954733 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.954714    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:09.968983 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.968955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed24229b0d66c2926ce6bc32dc10d92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"4ed24229b0d66c2926ce6bc32dc10d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.969086 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.968995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed24229b0d66c2926ce6bc32dc10d92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"4ed24229b0d66c2926ce6bc32dc10d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.969086 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:09.969019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ead0cc72982e9e04768074e71044edc-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"5ead0cc72982e9e04768074e71044edc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.976334 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.976315    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal"
Jul 26 15:18:09.981067 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:09.981049    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.054956 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.054920    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.069724 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.069677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed24229b0d66c2926ce6bc32dc10d92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"4ed24229b0d66c2926ce6bc32dc10d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.069869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.069729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed24229b0d66c2926ce6bc32dc10d92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"4ed24229b0d66c2926ce6bc32dc10d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.069869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.069752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ead0cc72982e9e04768074e71044edc-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"5ead0cc72982e9e04768074e71044edc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.069869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.069776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ed24229b0d66c2926ce6bc32dc10d92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"4ed24229b0d66c2926ce6bc32dc10d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.069869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.069786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ed24229b0d66c2926ce6bc32dc10d92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"4ed24229b0d66c2926ce6bc32dc10d92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.069869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.069788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ead0cc72982e9e04768074e71044edc-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"5ead0cc72982e9e04768074e71044edc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.155471 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.155428    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.256250 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.256166    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.278792 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.278760    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.284739 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.284721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:10.356686 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.356640    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.457214 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.457173    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.557873 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.557782    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.658479 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.658445    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.693971 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.693928    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 26 15:18:10.694522 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.694116    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:18:10.694522 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.694143    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:18:10.754607 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.754554    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 15:13:11 +0000 UTC" deadline="2028-01-27 14:58:49.337562723 +0000 UTC"
Jul 26 15:18:10.754607 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.754594    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13199h40m38.582972916s"
Jul 26 15:18:10.758676 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.758651    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.814481 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:10.814398    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ead0cc72982e9e04768074e71044edc.slice/crio-7085d6a1a71de450477fcfd70c43a1ba0b1a3a352c90457fe2fb46f36f8a7990 WatchSource:0}: Error finding container 7085d6a1a71de450477fcfd70c43a1ba0b1a3a352c90457fe2fb46f36f8a7990: Status 404 returned error can't find the container with id 7085d6a1a71de450477fcfd70c43a1ba0b1a3a352c90457fe2fb46f36f8a7990
Jul 26 15:18:10.815690 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:10.815650    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed24229b0d66c2926ce6bc32dc10d92.slice/crio-3c8eb1ee1aab55ea2a6762007cf95c0ed0b2c262a086ed6d5d1cbaac69915e6e WatchSource:0}: Error finding container 3c8eb1ee1aab55ea2a6762007cf95c0ed0b2c262a086ed6d5d1cbaac69915e6e: Status 404 returned error can't find the container with id 3c8eb1ee1aab55ea2a6762007cf95c0ed0b2c262a086ed6d5d1cbaac69915e6e
Jul 26 15:18:10.822176 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.822150    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:18:10.844267 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.844216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" event={"ID":"5ead0cc72982e9e04768074e71044edc","Type":"ContainerStarted","Data":"7085d6a1a71de450477fcfd70c43a1ba0b1a3a352c90457fe2fb46f36f8a7990"}
Jul 26 15:18:10.845233 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:10.845208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"4ed24229b0d66c2926ce6bc32dc10d92","Type":"ContainerStarted","Data":"3c8eb1ee1aab55ea2a6762007cf95c0ed0b2c262a086ed6d5d1cbaac69915e6e"}
Jul 26 15:18:10.859433 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.859399    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:10.959941 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:10.959903    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:11.060481 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:11.060446    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found"
Jul 26 15:18:11.095460 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:11.095403    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:18:11.167680 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:11.167649    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:11.175932 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:11.175907    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:18:11.178127 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:11.178110    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal"
Jul 26 15:18:11.187332 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:11.187312    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:18:11.197141 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:11.197110    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:18:13.000816 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.000780    2561 apiserver.go:52] "Watching apiserver"
Jul 26 15:18:13.009396 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.009330    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 26 15:18:13.009858 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.009830    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jzqx7","openshift-image-registry/node-ca-qgw6g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal","openshift-multus/multus-additional-cni-plugins-gkk2x","openshift-network-diagnostics/network-check-target-dqsgj","openshift-ovn-kubernetes/ovnkube-node-rzcm5","kube-system/global-pull-secret-syncer-hg694","kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7gk4k","openshift-multus/multus-57m67","openshift-multus/network-metrics-daemon-nx9dd","openshift-network-operator/iptables-alerter-xkbzh","kube-system/konnectivity-agent-q54g6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"]
Jul 26 15:18:13.011509 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.011489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.011612 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.011581    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:13.012527 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.012505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.013846 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.013824    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.015199    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.015213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wbqwn\""
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.015221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.015269    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.016218    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88brf\""
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.016269    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.016292    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.016328    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.016380    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.016634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.016448    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.017661 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.017642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.018127 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.018091    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 26 15:18:13.018752 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.018733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bh7ll\""
Jul 26 15:18:13.018847 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.018753    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.018947 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.018853    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 26 15:18:13.019023 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.019007    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 26 15:18:13.019084 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.019068    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.019353 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.019334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.020463 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.020378    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 26 15:18:13.020603 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.020588    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 26 15:18:13.020773 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.020754    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.021042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.021022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.021499 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.021483    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 26 15:18:13.021744 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.021728    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.021859 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.021842    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.022058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.021920    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.022058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.021953    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k896s\""
Jul 26 15:18:13.022058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.022055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 26 15:18:13.022252 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.022175    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j9czv\""
Jul 26 15:18:13.023489 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.023455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wtv6j\""
Jul 26 15:18:13.023623 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.023607    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.023685 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.023661    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.024026 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.024007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.024838 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.024283    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.025461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.026709    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.026859    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.026880    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ktrxr\""
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.027359    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.028342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.028417    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:13.029678 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.029535    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 26 15:18:13.030215 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.029691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k8c96\""
Jul 26 15:18:13.031007 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.030985    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.033876 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.033859    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:18:13.033989 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.033888    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 26 15:18:13.034045 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.033998    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 26 15:18:13.034126 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.034110    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4z5t2\""
Jul 26 15:18:13.036652 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-var-lib-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.036734 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb078cf6-f693-4498-b29d-df0c253f1636-ovn-node-metrics-cert\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.036734 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-serviceca\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.036808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-cnibin\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.036808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-k8s-cni-cncf-io\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.036808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-multus-certs\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.036909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.036909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036834    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:18:13.036909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-env-overrides\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.036909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3161f551-cb17-41b1-af1d-6a103b2f303d-hosts-file\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.036909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036893    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fd9c967-865a-487c-bacd-26c2ce1c9052-kubelet-config\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-host\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-device-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-node-log\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.036999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-modprobe-d\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysconfig\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-kubelet\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/10df3e54-9a17-4a24-a7a8-33ccda9aa4b0-agent-certs\") pod \"konnectivity-agent-q54g6\" (UID: \"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0\") " pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-sys-fs\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.037152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-log-socket\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-sys\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-os-release\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-cni-netd\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-etc-kubernetes\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-slash\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysctl-conf\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.037513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037503    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-ovn\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-ovnkube-script-lib\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbpc\" (UniqueName: \"kubernetes.io/projected/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-kube-api-access-kjbpc\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-os-release\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-systemd\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-cni-multus\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-hostroot\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-registration-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whkvb\" (UniqueName: \"kubernetes.io/projected/0060eb95-a294-4382-8890-620760afa604-kube-api-access-whkvb\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fkcz\" (UniqueName: \"kubernetes.io/projected/d97b3f07-324b-4e65-b119-43905a95b3a9-kube-api-access-2fkcz\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-kubernetes\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysctl-d\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-lib-modules\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-system-cni-dir\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.038036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-conf-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-systemd-units\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.037996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-run-netns\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlmnh\" (UniqueName: \"kubernetes.io/projected/3161f551-cb17-41b1-af1d-6a103b2f303d-kube-api-access-wlmnh\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-host\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-etc-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-run-ovn-kubernetes\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9ng\" (UniqueName: \"kubernetes.io/projected/eb078cf6-f693-4498-b29d-df0c253f1636-kube-api-access-9d9ng\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-var-lib-kubelet\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbmps\" (UniqueName: \"kubernetes.io/projected/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-kube-api-access-cbmps\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2097d08e-f05c-4fd4-84d9-548d6ade8195-cni-binary-copy\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-netns\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-cni-bin\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038302    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-run\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-tmp\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3161f551-cb17-41b1-af1d-6a103b2f303d-tmp-dir\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.038785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fd9c967-865a-487c-bacd-26c2ce1c9052-dbus\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-socket-dir-parent\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-daemon-config\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-etc-selinux\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-cnibin\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-cni-bin\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-ovnkube-config\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-cni-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/10df3e54-9a17-4a24-a7a8-33ccda9aa4b0-konnectivity-ca\") pod \"konnectivity-agent-q54g6\" (UID: \"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0\") " pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-socket-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038662    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-systemd\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-tuned\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-system-cni-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xznxq\" (UniqueName: \"kubernetes.io/projected/2097d08e-f05c-4fd4-84d9-548d6ade8195-kube-api-access-xznxq\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.039598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.038743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-kubelet\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.061033 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.061002    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rm4fc"
Jul 26 15:18:13.071493 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.071469    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rm4fc"
Jul 26 15:18:13.125847 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.125819    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 26 15:18:13.139397 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/10df3e54-9a17-4a24-a7a8-33ccda9aa4b0-agent-certs\") pod \"konnectivity-agent-q54g6\" (UID: \"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0\") " pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-sys-fs\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-log-socket\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-sys\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-os-release\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-log-socket\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-sys-fs\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-sys\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.139561 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-cni-netd\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-etc-kubernetes\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-os-release\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-cni-netd\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139660    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-etc-kubernetes\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-slash\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysctl-conf\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-slash\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss2ln\" (UniqueName: \"kubernetes.io/projected/f5de0024-336f-4175-9c20-7d8957818f89-kube-api-access-ss2ln\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.139829    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-iptables-alerter-script\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139834    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysctl-conf\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.139924    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:13.63989868 +0000 UTC m=+3.001398465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:13.139953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.139992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-ovn\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-ovnkube-script-lib\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbpc\" (UniqueName: \"kubernetes.io/projected/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-kube-api-access-kjbpc\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-os-release\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-ovn\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140247    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-os-release\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-systemd\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-cni-multus\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-hostroot\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-registration-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whkvb\" (UniqueName: \"kubernetes.io/projected/0060eb95-a294-4382-8890-620760afa604-kube-api-access-whkvb\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-systemd\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-hostroot\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.140697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-registration-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.141971 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.141950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-ovnkube-script-lib\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.142235 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.142218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-cni-multus\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.142358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.142322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.144846 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.140554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fkcz\" (UniqueName: \"kubernetes.io/projected/d97b3f07-324b-4e65-b119-43905a95b3a9-kube-api-access-2fkcz\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.144968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.144901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-kubernetes\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145029 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.144974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysctl-d\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145142 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-lib-modules\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145142 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-kubernetes\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.145250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-lib-modules\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.145250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysctl-d\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-system-cni-dir\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.145250 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/10df3e54-9a17-4a24-a7a8-33ccda9aa4b0-agent-certs\") pod \"konnectivity-agent-q54g6\" (UID: \"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0\") " pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-system-cni-dir\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-conf-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-systemd-units\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-systemd-units\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-conf-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.145524 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-run-netns\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlmnh\" (UniqueName: \"kubernetes.io/projected/3161f551-cb17-41b1-af1d-6a103b2f303d-kube-api-access-wlmnh\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-host\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-host-slash\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-run-netns\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-etc-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-host\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-run-ovn-kubernetes\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9ng\" (UniqueName: \"kubernetes.io/projected/eb078cf6-f693-4498-b29d-df0c253f1636-kube-api-access-9d9ng\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-etc-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-var-lib-kubelet\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbmps\" (UniqueName: \"kubernetes.io/projected/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-kube-api-access-cbmps\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-var-lib-kubelet\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.145854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145820    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-run-ovn-kubernetes\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2097d08e-f05c-4fd4-84d9-548d6ade8195-cni-binary-copy\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-netns\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-netns\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.145985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-cni-bin\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-run\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-cni-bin\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-tmp\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3161f551-cb17-41b1-af1d-6a103b2f303d-tmp-dir\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fd9c967-865a-487c-bacd-26c2ce1c9052-dbus\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-socket-dir-parent\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-run\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-daemon-config\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-etc-selinux\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-socket-dir-parent\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3161f551-cb17-41b1-af1d-6a103b2f303d-tmp-dir\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.146500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146477    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fd9c967-865a-487c-bacd-26c2ce1c9052-dbus\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2097d08e-f05c-4fd4-84d9-548d6ade8195-cni-binary-copy\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-etc-selinux\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-cnibin\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d97b3f07-324b-4e65-b119-43905a95b3a9-cnibin\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-cni-bin\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-daemon-config\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-ovnkube-config\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.146991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-cni-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f4dn\" (UniqueName: \"kubernetes.io/projected/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-kube-api-access-9f4dn\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-cni-bin\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/10df3e54-9a17-4a24-a7a8-33ccda9aa4b0-konnectivity-ca\") pod \"konnectivity-agent-q54g6\" (UID: \"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0\") " pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-socket-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-systemd\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-multus-cni-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-tuned\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-system-cni-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xznxq\" (UniqueName: \"kubernetes.io/projected/2097d08e-f05c-4fd4-84d9-548d6ade8195-kube-api-access-xznxq\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-kubelet\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-socket-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-var-lib-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147352    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d97b3f07-324b-4e65-b119-43905a95b3a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb078cf6-f693-4498-b29d-df0c253f1636-ovn-node-metrics-cert\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147416    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-system-cni-dir\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-kubelet\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-systemd\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-var-lib-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-serviceca\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-cnibin\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-k8s-cni-cncf-io\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-multus-certs\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-env-overrides\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.147895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3161f551-cb17-41b1-af1d-6a103b2f303d-hosts-file\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-k8s-cni-cncf-io\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-cnibin\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-env-overrides\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-run-multus-certs\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-run-openvswitch\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148390    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/10df3e54-9a17-4a24-a7a8-33ccda9aa4b0-konnectivity-ca\") pod \"konnectivity-agent-q54g6\" (UID: \"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0\") " pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3161f551-cb17-41b1-af1d-6a103b2f303d-hosts-file\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fd9c967-865a-487c-bacd-26c2ce1c9052-kubelet-config\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-host\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-device-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-node-log\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.148747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.147851    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb078cf6-f693-4498-b29d-df0c253f1636-ovnkube-config\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148773    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fd9c967-865a-487c-bacd-26c2ce1c9052-kubelet-config\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-node-log\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0060eb95-a294-4382-8890-620760afa604-device-dir\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-modprobe-d\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.148986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-host\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysconfig\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-kubelet\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb078cf6-f693-4498-b29d-df0c253f1636-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-sysconfig\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2097d08e-f05c-4fd4-84d9-548d6ade8195-host-var-lib-kubelet\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-modprobe-d\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.149286    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:13.149322 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.149317    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:13.150028 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.149379    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:13.150028 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.149531    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:18:13.649508019 +0000 UTC m=+3.011007824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:13.150028 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-tmp\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.150028 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149821    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-etc-tuned\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.150028 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.149982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-serviceca\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.152896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.152379    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbpc\" (UniqueName: \"kubernetes.io/projected/eb958b2d-6ce7-4d68-9fc4-c02f2dce305c-kube-api-access-kjbpc\") pod \"node-ca-qgw6g\" (UID: \"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c\") " pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.152896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.152539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whkvb\" (UniqueName: \"kubernetes.io/projected/0060eb95-a294-4382-8890-620760afa604-kube-api-access-whkvb\") pod \"aws-ebs-csi-driver-node-nx2hg\" (UID: \"0060eb95-a294-4382-8890-620760afa604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.154265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.154216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fkcz\" (UniqueName: \"kubernetes.io/projected/d97b3f07-324b-4e65-b119-43905a95b3a9-kube-api-access-2fkcz\") pod \"multus-additional-cni-plugins-gkk2x\" (UID: \"d97b3f07-324b-4e65-b119-43905a95b3a9\") " pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.154656 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.154628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbmps\" (UniqueName: \"kubernetes.io/projected/77f5af91-8592-492b-8a9c-a2d7c6f82fb2-kube-api-access-cbmps\") pod \"tuned-7gk4k\" (UID: \"77f5af91-8592-492b-8a9c-a2d7c6f82fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.155478 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.155430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9ng\" (UniqueName: \"kubernetes.io/projected/eb078cf6-f693-4498-b29d-df0c253f1636-kube-api-access-9d9ng\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.155881 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.155858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xznxq\" (UniqueName: \"kubernetes.io/projected/2097d08e-f05c-4fd4-84d9-548d6ade8195-kube-api-access-xznxq\") pod \"multus-57m67\" (UID: \"2097d08e-f05c-4fd4-84d9-548d6ade8195\") " pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.156017 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.155994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlmnh\" (UniqueName: \"kubernetes.io/projected/3161f551-cb17-41b1-af1d-6a103b2f303d-kube-api-access-wlmnh\") pod \"node-resolver-jzqx7\" (UID: \"3161f551-cb17-41b1-af1d-6a103b2f303d\") " pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.156333 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.156311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb078cf6-f693-4498-b29d-df0c253f1636-ovn-node-metrics-cert\") pod \"ovnkube-node-rzcm5\" (UID: \"eb078cf6-f693-4498-b29d-df0c253f1636\") " pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.160746 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.160728    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:18:13.185252 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.185226    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:18:13.249644 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.249610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss2ln\" (UniqueName: \"kubernetes.io/projected/f5de0024-336f-4175-9c20-7d8957818f89-kube-api-access-ss2ln\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.249644 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.249647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-iptables-alerter-script\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.249868 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.249717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-host-slash\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.249868 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.249778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f4dn\" (UniqueName: \"kubernetes.io/projected/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-kube-api-access-9f4dn\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.249868 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.249832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.250049 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.249964    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:13.250049 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.250025    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:13.750003318 +0000 UTC m=+3.111503114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:13.250260 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.250241    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-host-slash\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.250521 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.250502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-iptables-alerter-script\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.261552 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.261492    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss2ln\" (UniqueName: \"kubernetes.io/projected/f5de0024-336f-4175-9c20-7d8957818f89-kube-api-access-ss2ln\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.261552 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.261513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f4dn\" (UniqueName: \"kubernetes.io/projected/67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171-kube-api-access-9f4dn\") pod \"iptables-alerter-xkbzh\" (UID: \"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171\") " pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.324485 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.324451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:13.332590 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.332558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg"
Jul 26 15:18:13.342505 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.342483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gkk2x"
Jul 26 15:18:13.347243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.347220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:13.353480 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.353446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7gk4k"
Jul 26 15:18:13.359721 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.359700    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzqx7"
Jul 26 15:18:13.366638 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.366620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgw6g"
Jul 26 15:18:13.373040 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.373024    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-57m67"
Jul 26 15:18:13.379341 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.379317    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xkbzh"
Jul 26 15:18:13.652530 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.652449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:13.652530 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.652489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:13.652742 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.652639    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:13.652742 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.652647    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:13.652742 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.652671    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:13.652742 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.652683    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:13.652742 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.652710    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:14.652689684 +0000 UTC m=+4.014189481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:13.652996 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.652748    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:18:14.652731068 +0000 UTC m=+4.014230868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:13.753080 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:13.753040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:13.753259 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.753212    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:13.753332 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:13.753291    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:14.753268423 +0000 UTC m=+4.114768223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:13.972590 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:13.972545    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb958b2d_6ce7_4d68_9fc4_c02f2dce305c.slice/crio-9c1eb5830f1bf25366ed158d47a02e8421bec0dc4bcaefe1964487885c9da19a WatchSource:0}: Error finding container 9c1eb5830f1bf25366ed158d47a02e8421bec0dc4bcaefe1964487885c9da19a: Status 404 returned error can't find the container with id 9c1eb5830f1bf25366ed158d47a02e8421bec0dc4bcaefe1964487885c9da19a
Jul 26 15:18:13.974210 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:13.974037    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97b3f07_324b_4e65_b119_43905a95b3a9.slice/crio-02da7567d336ab9ef4083202f09532f907457f0e820465f1e607b2c018a26f06 WatchSource:0}: Error finding container 02da7567d336ab9ef4083202f09532f907457f0e820465f1e607b2c018a26f06: Status 404 returned error can't find the container with id 02da7567d336ab9ef4083202f09532f907457f0e820465f1e607b2c018a26f06
Jul 26 15:18:13.978713 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:13.978691    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3161f551_cb17_41b1_af1d_6a103b2f303d.slice/crio-80272be8a3c1bb38170f4172741801b4315039228f77d7eeaf2fd48eb8187348 WatchSource:0}: Error finding container 80272be8a3c1bb38170f4172741801b4315039228f77d7eeaf2fd48eb8187348: Status 404 returned error can't find the container with id 80272be8a3c1bb38170f4172741801b4315039228f77d7eeaf2fd48eb8187348
Jul 26 15:18:13.979877 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:13.979816    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb078cf6_f693_4498_b29d_df0c253f1636.slice/crio-9d8e1cbcba3c585b691465ef002a557ffea56c637641b7381d429bcb47ebc4c3 WatchSource:0}: Error finding container 9d8e1cbcba3c585b691465ef002a557ffea56c637641b7381d429bcb47ebc4c3: Status 404 returned error can't find the container with id 9d8e1cbcba3c585b691465ef002a557ffea56c637641b7381d429bcb47ebc4c3
Jul 26 15:18:13.984899 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:13.983397    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2097d08e_f05c_4fd4_84d9_548d6ade8195.slice/crio-f0b418c73666646926fb5ee5f73bd4649df62fc6c965fc16ab0505880d89983c WatchSource:0}: Error finding container f0b418c73666646926fb5ee5f73bd4649df62fc6c965fc16ab0505880d89983c: Status 404 returned error can't find the container with id f0b418c73666646926fb5ee5f73bd4649df62fc6c965fc16ab0505880d89983c
Jul 26 15:18:13.986755 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:13.986721    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0060eb95_a294_4382_8890_620760afa604.slice/crio-918c61cd8f71da57f213ddbabd176ba50c269daad555b028d08457e82286951e WatchSource:0}: Error finding container 918c61cd8f71da57f213ddbabd176ba50c269daad555b028d08457e82286951e: Status 404 returned error can't find the container with id 918c61cd8f71da57f213ddbabd176ba50c269daad555b028d08457e82286951e
Jul 26 15:18:14.074378 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.074331    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:13:13 +0000 UTC" deadline="2028-04-15 18:22:35.798861486 +0000 UTC"
Jul 26 15:18:14.074378 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.074364    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15099h4m21.724500598s"
Jul 26 15:18:14.098830 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.098800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:14.099010 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.098913    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:14.106344 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.106314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7gk4k" event={"ID":"77f5af91-8592-492b-8a9c-a2d7c6f82fb2","Type":"ContainerStarted","Data":"aef3158a966e77b1128d816db3f356eba34f7bb5f3f6e5b2031354263c769263"}
Jul 26 15:18:14.107589 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.107561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"9d8e1cbcba3c585b691465ef002a557ffea56c637641b7381d429bcb47ebc4c3"}
Jul 26 15:18:14.108760 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.108734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgw6g" event={"ID":"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c","Type":"ContainerStarted","Data":"9c1eb5830f1bf25366ed158d47a02e8421bec0dc4bcaefe1964487885c9da19a"}
Jul 26 15:18:14.109893 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.109871    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-57m67" event={"ID":"2097d08e-f05c-4fd4-84d9-548d6ade8195","Type":"ContainerStarted","Data":"f0b418c73666646926fb5ee5f73bd4649df62fc6c965fc16ab0505880d89983c"}
Jul 26 15:18:14.111034 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.111011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg" event={"ID":"0060eb95-a294-4382-8890-620760afa604","Type":"ContainerStarted","Data":"918c61cd8f71da57f213ddbabd176ba50c269daad555b028d08457e82286951e"}
Jul 26 15:18:14.112228 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.112203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q54g6" event={"ID":"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0","Type":"ContainerStarted","Data":"bd810681c68127c2eba45c2ab2e667b9f3a64cb1c30fb4681f98feb01add1c3b"}
Jul 26 15:18:14.113311 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.113287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzqx7" event={"ID":"3161f551-cb17-41b1-af1d-6a103b2f303d","Type":"ContainerStarted","Data":"80272be8a3c1bb38170f4172741801b4315039228f77d7eeaf2fd48eb8187348"}
Jul 26 15:18:14.114439 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.114415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerStarted","Data":"02da7567d336ab9ef4083202f09532f907457f0e820465f1e607b2c018a26f06"}
Jul 26 15:18:14.116302 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.116280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" event={"ID":"5ead0cc72982e9e04768074e71044edc","Type":"ContainerStarted","Data":"c416d681804bbc8081d482f8cd1ec23c9171e590852936de6c3445b70511b97c"}
Jul 26 15:18:14.117384 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.117365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xkbzh" event={"ID":"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171","Type":"ContainerStarted","Data":"5f8d09111bde8735c10abb1092a32f323a857bea3f5022d38c52465bfe17089e"}
Jul 26 15:18:14.131875 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.131827    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" podStartSLOduration=2.131814754 podStartE2EDuration="2.131814754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:14.130679543 +0000 UTC m=+3.492179338" watchObservedRunningTime="2026-07-26 15:18:14.131814754 +0000 UTC m=+3.493314603"
Jul 26 15:18:14.661326 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.661231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:14.661326 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.661291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:14.661608 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.661462    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:14.661608 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.661524    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:16.661504997 +0000 UTC m=+6.023004793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:14.662010 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.661986    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:14.662102 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.662015    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:14.662102 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.662028    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:14.662102 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.662077    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:18:16.662061452 +0000 UTC m=+6.023561247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:14.762983 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:14.762300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:14.762983 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.762526    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:14.762983 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:14.762601    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:16.76257919 +0000 UTC m=+6.124078987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:15.075652 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:15.075488    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:13:13 +0000 UTC" deadline="2028-01-17 23:35:27.485353908 +0000 UTC"
Jul 26 15:18:15.075652 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:15.075590    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12968h17m12.409770022s"
Jul 26 15:18:15.101655 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:15.101393    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:15.101655 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:15.101518    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:15.102741 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:15.102378    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:15.102741 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:15.102508    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:15.128871 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:15.128841    2561 generic.go:356] "Generic (PLEG): container finished" podID="4ed24229b0d66c2926ce6bc32dc10d92" containerID="db145a8c0366276bb61c67de7fb222b6d38dc0b8167155f31c046a35d97e85a4" exitCode=0
Jul 26 15:18:15.129593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:15.129569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"4ed24229b0d66c2926ce6bc32dc10d92","Type":"ContainerDied","Data":"db145a8c0366276bb61c67de7fb222b6d38dc0b8167155f31c046a35d97e85a4"}
Jul 26 15:18:16.099698 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:16.099170    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:16.099698 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.099314    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:16.156579 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:16.156539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"4ed24229b0d66c2926ce6bc32dc10d92","Type":"ContainerStarted","Data":"111ad4059ab0346904331f1242b63a1a9b2aa3f9cd1b3750d1ccb209eb3095f5"}
Jul 26 15:18:16.171542 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:16.171492    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" podStartSLOduration=4.171459317 podStartE2EDuration="4.171459317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:16.171288022 +0000 UTC m=+5.532787837" watchObservedRunningTime="2026-07-26 15:18:16.171459317 +0000 UTC m=+5.532959123"
Jul 26 15:18:16.681375 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:16.681334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:16.681573 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:16.681395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:16.681573 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.681560    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:16.681688 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.681627    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:20.68160741 +0000 UTC m=+10.043107205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:16.682127 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.682106    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:16.682214 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.682136    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:16.682214 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.682150    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:16.682214 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.682204    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:18:20.682186604 +0000 UTC m=+10.043686391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:16.782831 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:16.782792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:16.783036 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.782974    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:16.783097 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:16.783045    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:20.783025527 +0000 UTC m=+10.144525312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:17.099126 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:17.099041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:17.099279 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:17.099048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:17.099279 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:17.099163    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:17.099279 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:17.099236    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:18.099093 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:18.099054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:18.099574 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:18.099205    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:19.100940 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:19.100905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:19.101335 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:19.101060    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:19.101593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:19.101570    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:19.101661 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:19.101645    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:20.098392 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:20.098299    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:20.098562 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.098526    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:20.716944 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:20.716885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:20.717422 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:20.716960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:20.717422 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.717102    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:20.717422 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.717165    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:28.71714697 +0000 UTC m=+18.078646766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:20.717615 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.717604    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:20.717666 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.717625    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:20.717666 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.717639    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:20.717766 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.717680    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:18:28.717668195 +0000 UTC m=+18.079167982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:20.817775 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:20.817737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:20.817968 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.817905    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:20.818045 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:20.818003    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:28.817980438 +0000 UTC m=+18.179480235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:21.099182 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:21.099102    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:21.099334 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:21.099225    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:21.099901 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:21.099882    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:21.100025 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:21.100002    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:22.098794 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:22.098752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:22.099276 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:22.099019    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:23.101634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:23.101001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:23.101634 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:23.101126    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:23.101634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:23.101502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:23.101634 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:23.101586    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:24.098592 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:24.098550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:24.098774 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:24.098706    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:25.098699 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:25.098613    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:25.098699 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:25.098642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:25.099166 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:25.098748    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:25.099166 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:25.098873    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:26.098260 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:26.098224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:26.098478 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:26.098367    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:27.099022 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:27.098981    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:27.099022 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:27.099012    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:27.099570 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:27.099112    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:27.099570 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:27.099218    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:28.098414 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:28.098374    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:28.098622 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.098505    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:28.779129 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:28.779075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:28.779129 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:28.779123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:28.779706 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.779248    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:28.779706 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.779305    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:44.779290822 +0000 UTC m=+34.140790620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:28.779806 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.779732    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:28.779806 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.779751    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:28.779806 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.779766    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:28.779806 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.779804    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:18:44.779792125 +0000 UTC m=+34.141291907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:28.880223 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:28.880187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:28.880387 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.880356    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:28.880449 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:28.880429    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:44.880407298 +0000 UTC m=+34.241907095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:29.098451 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:29.098368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:29.098604 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:29.098503    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:29.098604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:29.098557    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:29.098703 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:29.098655    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:30.099091 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:30.099055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:30.099499 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:30.099167    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:31.099822 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:31.099790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:31.100228 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:31.099901    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:31.100228 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:31.099962    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:31.100228 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:31.100075    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:32.099148 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:32.099110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:32.099309 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:32.099251    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:33.099595 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.099303    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:33.100176 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.099359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:33.100176 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:33.099684    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:33.100176 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:33.099735    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:33.190320 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.190252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7gk4k" event={"ID":"77f5af91-8592-492b-8a9c-a2d7c6f82fb2","Type":"ContainerStarted","Data":"7048234b7e5d330f966d3c1ba47ea806b6cdc4dbb9748fe089630777eee3c462"}
Jul 26 15:18:33.193771 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.193742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"33d1f41388732948bc2963a57402a63f922d45b6fcc80a9d87974c648cf2d81b"}
Jul 26 15:18:33.193859 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.193833    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"cf7b23206a7cca3350b1fdb36c8829237bb08754620a3355769d12e9a63d3e15"}
Jul 26 15:18:33.193898 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.193881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"f5bb6a53eda57969f1042643d1a77ed43de06dce359c098f350aef1951b4338f"}
Jul 26 15:18:33.193972 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.193958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"a14fdd32eacb2cb467bc8aef40ad91e66a544b1419d9a219fd90e55519b38118"}
Jul 26 15:18:33.194014 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.193997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"5467a60b663226e4f798f6c9c2cf9531095c6fed4d5d2b2a128678796dfe73de"}
Jul 26 15:18:33.196298 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.196271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgw6g" event={"ID":"eb958b2d-6ce7-4d68-9fc4-c02f2dce305c","Type":"ContainerStarted","Data":"16784db87656e1692bf2317baec3cd179e4f996c30fe10816392aa4a85faff00"}
Jul 26 15:18:33.197887 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.197861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-57m67" event={"ID":"2097d08e-f05c-4fd4-84d9-548d6ade8195","Type":"ContainerStarted","Data":"ead9e4f148c4ccc00aa9479a663f733bdbe34123ca819db73bf381c02e1da32f"}
Jul 26 15:18:33.199559 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.199539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg" event={"ID":"0060eb95-a294-4382-8890-620760afa604","Type":"ContainerStarted","Data":"94edc96ba0ffe91280f30fd17af95a1b595c67327aa8ebd8b679903560739c3a"}
Jul 26 15:18:33.201318 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.201290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q54g6" event={"ID":"10df3e54-9a17-4a24-a7a8-33ccda9aa4b0","Type":"ContainerStarted","Data":"1656341d4ea02f1df7eb0a6880f867123b0ae4f1187397d4b15eef2de4796683"}
Jul 26 15:18:33.206199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.206168    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzqx7" event={"ID":"3161f551-cb17-41b1-af1d-6a103b2f303d","Type":"ContainerStarted","Data":"dbdb9bbdac94ec6628e03232084d51ce46c28f103f7284bbf678223976696573"}
Jul 26 15:18:33.208697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.208495    2561 generic.go:356] "Generic (PLEG): container finished" podID="d97b3f07-324b-4e65-b119-43905a95b3a9" containerID="f5f2bd0be3ef335e1ffd805fa36d951552a5532662a6409bacdc0f864649116b" exitCode=0
Jul 26 15:18:33.208697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.208529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerDied","Data":"f5f2bd0be3ef335e1ffd805fa36d951552a5532662a6409bacdc0f864649116b"}
Jul 26 15:18:33.209722 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.209688    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7gk4k" podStartSLOduration=3.604623341 podStartE2EDuration="22.20967315s" totalImagesPullingTime="18.605049809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:33.209549828 +0000 UTC m=+22.571049627" watchObservedRunningTime="2026-07-26 15:18:33.20967315 +0000 UTC m=+22.571172954"
Jul 26 15:18:33.247089 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.247039    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q54g6" podStartSLOduration=11.504378015 podStartE2EDuration="22.247019311s" totalImagesPullingTime="10.742641296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:33.224205547 +0000 UTC m=+22.585705356" watchObservedRunningTime="2026-07-26 15:18:33.247019311 +0000 UTC m=+22.608519117"
Jul 26 15:18:33.262644 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.262590    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qgw6g" podStartSLOduration=3.646458637 podStartE2EDuration="22.262571705s" totalImagesPullingTime="18.616113068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:33.262257911 +0000 UTC m=+22.623757727" watchObservedRunningTime="2026-07-26 15:18:33.262571705 +0000 UTC m=+22.624071509"
Jul 26 15:18:33.303658 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.303598    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jzqx7" podStartSLOduration=3.690855152 podStartE2EDuration="22.303576623s" totalImagesPullingTime="18.612721471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:33.281805983 +0000 UTC m=+22.643305789" watchObservedRunningTime="2026-07-26 15:18:33.303576623 +0000 UTC m=+22.665076429"
Jul 26 15:18:33.304276 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:33.304239    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-57m67" podStartSLOduration=3.641877601 podStartE2EDuration="22.30422886s" totalImagesPullingTime="18.662351259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:33.303441441 +0000 UTC m=+22.664941245" watchObservedRunningTime="2026-07-26 15:18:33.30422886 +0000 UTC m=+22.665728665"
Jul 26 15:18:34.098886 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.098858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:34.099092 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:34.099013    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:34.116775 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.116748    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 26 15:18:34.212812 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.212740    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xkbzh" event={"ID":"67ce56fb-9eef-4cf6-93b6-0e3f6a9e5171","Type":"ContainerStarted","Data":"86bb1be84f266bb345829c7165eceda34c2f84e257dfaa5cfa50cdf386180e66"}
Jul 26 15:18:34.216534 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.216505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"5e9aa37630c11b9087d11c16a5ece75b489e8e4c114658834a74782b83a6361b"}
Jul 26 15:18:34.218483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.218449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg" event={"ID":"0060eb95-a294-4382-8890-620760afa604","Type":"ContainerStarted","Data":"9917598ac9b0653c4c3bbfbe25c023d79c2fd9d739287721de28802328b8c90b"}
Jul 26 15:18:34.227301 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.227258    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xkbzh" podStartSLOduration=4.6234592679999995 podStartE2EDuration="23.227245393s" totalImagesPullingTime="18.603786125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:34.226967716 +0000 UTC m=+23.588467521" watchObservedRunningTime="2026-07-26 15:18:34.227245393 +0000 UTC m=+23.588745229"
Jul 26 15:18:34.613089 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.613045    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:34.613995 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:34.613771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:35.098433 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.098404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:35.098600 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.098404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:35.098916 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:35.098886    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:35.099159 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:35.099080    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:35.102235 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.102132    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T15:18:34.116771766Z","UUID":"d00ad660-c039-4aa2-995c-84afcbc67666","Handler":null,"Name":"","Endpoint":""}
Jul 26 15:18:35.104105 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.104086    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 26 15:18:35.104232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.104127    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 26 15:18:35.220734 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.220696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:35.221085 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:35.221065    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q54g6"
Jul 26 15:18:36.098798 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:36.098763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:36.099124 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:36.098911    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:36.226348 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:36.226306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"cd79425e0eb5cc01c691830688fde7bf0d5bc9244fe34438d6adce4fd139e6cb"}
Jul 26 15:18:36.228880 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:36.228847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg" event={"ID":"0060eb95-a294-4382-8890-620760afa604","Type":"ContainerStarted","Data":"db8949292f6006a4bdc02910b14119e87cf462649371b02d77bf87877b15a0ef"}
Jul 26 15:18:36.247968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:36.247904    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nx2hg" podStartSLOduration=4.460801764 podStartE2EDuration="25.247887723s" totalImagesPullingTime="20.787085959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:36.246469118 +0000 UTC m=+25.607968923" watchObservedRunningTime="2026-07-26 15:18:36.247887723 +0000 UTC m=+25.609387526"
Jul 26 15:18:37.098510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:37.098289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:37.098725 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:37.098618    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:37.098725 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:37.098289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:37.098725 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:37.098707    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:38.098808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.098727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:38.099573 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:38.098835    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:38.235613 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.235434    2561 generic.go:356] "Generic (PLEG): container finished" podID="d97b3f07-324b-4e65-b119-43905a95b3a9" containerID="5300c843e1b1fe71bf5a05c0ebe9a88172496893c28b57d486c7d336a19fc188" exitCode=0
Jul 26 15:18:38.235754 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.235520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerDied","Data":"5300c843e1b1fe71bf5a05c0ebe9a88172496893c28b57d486c7d336a19fc188"}
Jul 26 15:18:38.239459 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.239439    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" event={"ID":"eb078cf6-f693-4498-b29d-df0c253f1636","Type":"ContainerStarted","Data":"7ccde86bb2da67d90f18983c7417f12701270cab7a98a180bbd4e0e4a472733b"}
Jul 26 15:18:38.239676 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.239663    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:38.239722 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.239707    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:38.255738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.255717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:38.255828 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.255816    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:38.283841 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:38.283801    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5" podStartSLOduration=8.615920007 podStartE2EDuration="27.283787704s" totalImagesPullingTime="18.667867697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:38.282489805 +0000 UTC m=+27.643989610" watchObservedRunningTime="2026-07-26 15:18:38.283787704 +0000 UTC m=+27.645287505"
Jul 26 15:18:39.099158 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.099129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:39.099576 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:39.099223    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:39.099576 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.099320    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:39.099576 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:39.099417    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:39.241699 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.241666    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 26 15:18:39.876675 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.876643    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hg694"]
Jul 26 15:18:39.876857 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.876759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:39.876916 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:39.876852    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:39.879975 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.879924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nx9dd"]
Jul 26 15:18:39.880145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.880057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:39.880228 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:39.880200    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:39.880688 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.880664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqsgj"]
Jul 26 15:18:39.880783 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:39.880747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:39.880854 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:39.880834    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:40.245893 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:40.245860    2561 generic.go:356] "Generic (PLEG): container finished" podID="d97b3f07-324b-4e65-b119-43905a95b3a9" containerID="68425bcb995028dc15019da36a6264837a7eda262767d2b5bf1d66a94504e8e4" exitCode=0
Jul 26 15:18:40.246299 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:40.245969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerDied","Data":"68425bcb995028dc15019da36a6264837a7eda262767d2b5bf1d66a94504e8e4"}
Jul 26 15:18:40.246299 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:40.246217    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 26 15:18:41.099803 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:41.099782    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:41.099960 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:41.099847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:41.099960 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:41.099859    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:41.100054 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:41.099968    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:41.250798 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:41.250615    2561 generic.go:356] "Generic (PLEG): container finished" podID="d97b3f07-324b-4e65-b119-43905a95b3a9" containerID="0f652d3da9ad15e5d91b2cac99b7bf592f4a2f21923bf8eeaab357d94ef371aa" exitCode=0
Jul 26 15:18:41.251146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:41.250696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerDied","Data":"0f652d3da9ad15e5d91b2cac99b7bf592f4a2f21923bf8eeaab357d94ef371aa"}
Jul 26 15:18:41.789338 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:41.789239    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:18:42.098297 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:42.098221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:42.098457 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:42.098346    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:43.098807 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:43.098771    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:43.099389 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:43.098913    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:43.099389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:43.099001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:43.099389 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:43.099126    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:44.098818 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:44.098788    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:44.099363 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.098902    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqsgj" podUID="03a83db4-202b-4764-adee-f9870cefa1fd"
Jul 26 15:18:44.796537 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:44.796503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:44.796537 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:44.796540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:44.796752 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.796642    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:44.796752 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.796694    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret podName:1fd9c967-865a-487c-bacd-26c2ce1c9052 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:16.796680174 +0000 UTC m=+66.158179969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret") pod "global-pull-secret-syncer-hg694" (UID: "1fd9c967-865a-487c-bacd-26c2ce1c9052") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:18:44.796752 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.796690    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:18:44.796752 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.796729    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:18:44.796752 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.796742    2561 projected.go:196] Error preparing data for projected volume kube-api-access-pcbnq for pod openshift-network-diagnostics/network-check-target-dqsgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:44.796965 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.796799    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq podName:03a83db4-202b-4764-adee-f9870cefa1fd nodeName:}" failed. No retries permitted until 2026-07-26 15:19:16.796782879 +0000 UTC m=+66.158282678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcbnq" (UniqueName: "kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq") pod "network-check-target-dqsgj" (UID: "03a83db4-202b-4764-adee-f9870cefa1fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:18:44.897439 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:44.897404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:44.897632 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.897534    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:44.897632 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:44.897593    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs podName:f5de0024-336f-4175-9c20-7d8957818f89 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:16.897572298 +0000 UTC m=+66.259072080 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs") pod "network-metrics-daemon-nx9dd" (UID: "f5de0024-336f-4175-9c20-7d8957818f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:18:45.098564 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.098535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:45.098712 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.098536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:45.098712 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.098669    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hg694" podUID="1fd9c967-865a-487c-bacd-26c2ce1c9052"
Jul 26 15:18:45.098917 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.098767    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx9dd" podUID="f5de0024-336f-4175-9c20-7d8957818f89"
Jul 26 15:18:45.503697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.503468    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeReady"
Jul 26 15:18:45.506351 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.504111    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 26 15:18:45.539584 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.539551    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d84d78f65-sc6lv"]
Jul 26 15:18:45.556824 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.556798    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6pjm8"]
Jul 26 15:18:45.556963 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.556914    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.559489 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.559463    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 26 15:18:45.559612 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.559576    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 26 15:18:45.559612 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.559597    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l6h6k\""
Jul 26 15:18:45.559863 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.559850    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 26 15:18:45.566083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.566060    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 26 15:18:45.580885 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.580858    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kg2g6"]
Jul 26 15:18:45.581040 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.581004    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.583717 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.583693    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 26 15:18:45.583837 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.583719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4hft8\""
Jul 26 15:18:45.583837 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.583829    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 26 15:18:45.601192 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.601165    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d84d78f65-sc6lv"]
Jul 26 15:18:45.601338 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.601207    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kg2g6"]
Jul 26 15:18:45.601338 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.601225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pjm8"]
Jul 26 15:18:45.601338 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.601277    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.607402 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.607379    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 26 15:18:45.607537 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.607387    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s7dmz\""
Jul 26 15:18:45.607846 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.607832    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 26 15:18:45.619598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.619574    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 26 15:18:45.703820 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.703789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.703820 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.703822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b42dc95f-9578-4d2f-a323-978105b51494-tmp-dir\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.703841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-bound-sa-token\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.703865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b42dc95f-9578-4d2f-a323-978105b51494-config-volume\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.703890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fsfv\" (UniqueName: \"kubernetes.io/projected/40df5a6f-5aa3-415a-84d1-4a06df657748-kube-api-access-6fsfv\") pod \"ingress-canary-kg2g6\" (UID: \"40df5a6f-5aa3-415a-84d1-4a06df657748\") " pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.703974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-installation-pull-secrets\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7swmw\" (UniqueName: \"kubernetes.io/projected/b42dc95f-9578-4d2f-a323-978105b51494-kube-api-access-7swmw\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-certificates\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-trusted-ca\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704057    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqp6s\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-kube-api-access-wqp6s\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40df5a6f-5aa3-415a-84d1-4a06df657748-cert\") pod \"ingress-canary-kg2g6\" (UID: \"40df5a6f-5aa3-415a-84d1-4a06df657748\") " pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.704336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/999aa0bb-7734-4c71-a974-4dc7bf645ef7-ca-trust-extracted\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-image-registry-private-configuration\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.704336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.704240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.804656 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/999aa0bb-7734-4c71-a974-4dc7bf645ef7-ca-trust-extracted\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.804656 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-image-registry-private-configuration\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.804656 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804674    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b42dc95f-9578-4d2f-a323-978105b51494-tmp-dir\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-bound-sa-token\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b42dc95f-9578-4d2f-a323-978105b51494-config-volume\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.804762    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.804772    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.804783    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d84d78f65-sc6lv: secret "image-registry-tls" not found
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.804775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fsfv\" (UniqueName: \"kubernetes.io/projected/40df5a6f-5aa3-415a-84d1-4a06df657748-kube-api-access-6fsfv\") pod \"ingress-canary-kg2g6\" (UID: \"40df5a6f-5aa3-415a-84d1-4a06df657748\") " pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.804921 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.804847    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls podName:999aa0bb-7734-4c71-a974-4dc7bf645ef7 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:46.304825166 +0000 UTC m=+35.666324965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls") pod "image-registry-6d84d78f65-sc6lv" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7") : secret "image-registry-tls" not found
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:45.805006    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls podName:b42dc95f-9578-4d2f-a323-978105b51494 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:46.304991111 +0000 UTC m=+35.666490898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls") pod "dns-default-6pjm8" (UID: "b42dc95f-9578-4d2f-a323-978105b51494") : secret "dns-default-metrics-tls" not found
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/999aa0bb-7734-4c71-a974-4dc7bf645ef7-ca-trust-extracted\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-installation-pull-secrets\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7swmw\" (UniqueName: \"kubernetes.io/projected/b42dc95f-9578-4d2f-a323-978105b51494-kube-api-access-7swmw\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b42dc95f-9578-4d2f-a323-978105b51494-tmp-dir\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-certificates\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-trusted-ca\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqp6s\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-kube-api-access-wqp6s\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.805360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40df5a6f-5aa3-415a-84d1-4a06df657748-cert\") pod \"ingress-canary-kg2g6\" (UID: \"40df5a6f-5aa3-415a-84d1-4a06df657748\") " pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.805802 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.805430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b42dc95f-9578-4d2f-a323-978105b51494-config-volume\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.806310 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.806100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-certificates\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.806310 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.806187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-trusted-ca\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.809371 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.809343    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-installation-pull-secrets\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.809475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.809386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-image-registry-private-configuration\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.809475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.809457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40df5a6f-5aa3-415a-84d1-4a06df657748-cert\") pod \"ingress-canary-kg2g6\" (UID: \"40df5a6f-5aa3-415a-84d1-4a06df657748\") " pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.813806 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.813783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-bound-sa-token\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.814282 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.814257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7swmw\" (UniqueName: \"kubernetes.io/projected/b42dc95f-9578-4d2f-a323-978105b51494-kube-api-access-7swmw\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:45.814576 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.814558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqp6s\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-kube-api-access-wqp6s\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:45.814806 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.814787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fsfv\" (UniqueName: \"kubernetes.io/projected/40df5a6f-5aa3-415a-84d1-4a06df657748-kube-api-access-6fsfv\") pod \"ingress-canary-kg2g6\" (UID: \"40df5a6f-5aa3-415a-84d1-4a06df657748\") " pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:45.909887 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:45.909862    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kg2g6"
Jul 26 15:18:46.099053 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.098864    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:18:46.101843 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.101808    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bcjwm\""
Jul 26 15:18:46.101843 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.101823    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:18:46.102066 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.101848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:18:46.116404 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.116381    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kg2g6"]
Jul 26 15:18:46.121856 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:46.121827    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40df5a6f_5aa3_415a_84d1_4a06df657748.slice/crio-6e4ae7abcc276e44f523d2bf98f2676772aac59db6525536b64366bb3b350359 WatchSource:0}: Error finding container 6e4ae7abcc276e44f523d2bf98f2676772aac59db6525536b64366bb3b350359: Status 404 returned error can't find the container with id 6e4ae7abcc276e44f523d2bf98f2676772aac59db6525536b64366bb3b350359
Jul 26 15:18:46.265036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.264999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kg2g6" event={"ID":"40df5a6f-5aa3-415a-84d1-4a06df657748","Type":"ContainerStarted","Data":"6e4ae7abcc276e44f523d2bf98f2676772aac59db6525536b64366bb3b350359"}
Jul 26 15:18:46.267739 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.267712    2561 generic.go:356] "Generic (PLEG): container finished" podID="d97b3f07-324b-4e65-b119-43905a95b3a9" containerID="4a9f5b687d2282f156b9d8848bb62eb681da397f1807787333fd2742dba886f0" exitCode=0
Jul 26 15:18:46.267816 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.267771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerDied","Data":"4a9f5b687d2282f156b9d8848bb62eb681da397f1807787333fd2742dba886f0"}
Jul 26 15:18:46.308869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.308790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:46.308869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:46.308849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:46.309048 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:46.308982    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:18:46.309048 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:46.309003    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d84d78f65-sc6lv: secret "image-registry-tls" not found
Jul 26 15:18:46.309119 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:46.309064    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls podName:999aa0bb-7734-4c71-a974-4dc7bf645ef7 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:47.309044845 +0000 UTC m=+36.670544639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls") pod "image-registry-6d84d78f65-sc6lv" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7") : secret "image-registry-tls" not found
Jul 26 15:18:46.309119 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:46.309065    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:18:46.309189 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:46.309125    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls podName:b42dc95f-9578-4d2f-a323-978105b51494 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:47.309109354 +0000 UTC m=+36.670609156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls") pod "dns-default-6pjm8" (UID: "b42dc95f-9578-4d2f-a323-978105b51494") : secret "dns-default-metrics-tls" not found
Jul 26 15:18:47.098988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.098879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:18:47.099143 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.099096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:18:47.102003 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.101974    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:18:47.102109 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.101983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xwws\""
Jul 26 15:18:47.102162 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.101985    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:18:47.274128 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.274095    2561 generic.go:356] "Generic (PLEG): container finished" podID="d97b3f07-324b-4e65-b119-43905a95b3a9" containerID="4022e427d666c4214536d77a5a50308fcc584fcc1c9867882ab494626e1a5cd8" exitCode=0
Jul 26 15:18:47.274128 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.274137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerDied","Data":"4022e427d666c4214536d77a5a50308fcc584fcc1c9867882ab494626e1a5cd8"}
Jul 26 15:18:47.318637 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.318609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:47.318810 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:47.318654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:47.318810 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:47.318757    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:18:47.318810 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:47.318774    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:18:47.318810 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:47.318782    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d84d78f65-sc6lv: secret "image-registry-tls" not found
Jul 26 15:18:47.319033 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:47.318837    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls podName:b42dc95f-9578-4d2f-a323-978105b51494 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:49.318819827 +0000 UTC m=+38.680319624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls") pod "dns-default-6pjm8" (UID: "b42dc95f-9578-4d2f-a323-978105b51494") : secret "dns-default-metrics-tls" not found
Jul 26 15:18:47.319033 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:47.318857    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls podName:999aa0bb-7734-4c71-a974-4dc7bf645ef7 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:49.318846627 +0000 UTC m=+38.680346410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls") pod "image-registry-6d84d78f65-sc6lv" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7") : secret "image-registry-tls" not found
Jul 26 15:18:48.176585 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:48.176546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:48.256153 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:48.256099    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:48.279296 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:48.279052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" event={"ID":"d97b3f07-324b-4e65-b119-43905a95b3a9","Type":"ContainerStarted","Data":"0b67f821da7ada5e63df99d65c02d8d00ad7687fc6812c44f80224890d745b26"}
Jul 26 15:18:48.301770 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:48.301625    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gkk2x" podStartSLOduration=7.654303462 podStartE2EDuration="37.301605714s" totalImagesPullingTime="29.647302252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:48.300161151 +0000 UTC m=+37.661660969" watchObservedRunningTime="2026-07-26 15:18:48.301605714 +0000 UTC m=+37.663105519"
Jul 26 15:18:48.462745 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:48.462670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:48.518068 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:48.518032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:49.118707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.118673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:49.282968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.282917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kg2g6" event={"ID":"40df5a6f-5aa3-415a-84d1-4a06df657748","Type":"ContainerStarted","Data":"0191dc4183a2de99a1038c3fe18b6af2084f511ed3258c3da1f9b07bd7272650"}
Jul 26 15:18:49.334912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.334872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:49.334912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.334918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:49.335164 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:49.335036    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:18:49.335164 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:49.335053    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d84d78f65-sc6lv: secret "image-registry-tls" not found
Jul 26 15:18:49.335164 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:49.335053    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:18:49.335164 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:49.335110    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls podName:b42dc95f-9578-4d2f-a323-978105b51494 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:53.335094324 +0000 UTC m=+42.696594119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls") pod "dns-default-6pjm8" (UID: "b42dc95f-9578-4d2f-a323-978105b51494") : secret "dns-default-metrics-tls" not found
Jul 26 15:18:49.335164 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:49.335125    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls podName:999aa0bb-7734-4c71-a974-4dc7bf645ef7 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:53.335119684 +0000 UTC m=+42.696619465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls") pod "image-registry-6d84d78f65-sc6lv" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7") : secret "image-registry-tls" not found
Jul 26 15:18:49.422656 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.422576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:49.479560 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.479514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:49.957701 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:49.957664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:50.007858 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:50.007826    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:50.076973 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:50.076924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:50.134007 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:50.133974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:53.366397 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:53.366351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:18:53.366857 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:53.366406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:18:53.366857 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:53.366512    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:18:53.366857 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:53.366515    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:18:53.366857 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:53.366532    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d84d78f65-sc6lv: secret "image-registry-tls" not found
Jul 26 15:18:53.366857 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:53.366580    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls podName:b42dc95f-9578-4d2f-a323-978105b51494 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:01.366560121 +0000 UTC m=+50.728059917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls") pod "dns-default-6pjm8" (UID: "b42dc95f-9578-4d2f-a323-978105b51494") : secret "dns-default-metrics-tls" not found
Jul 26 15:18:53.366857 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:53.366595    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls podName:999aa0bb-7734-4c71-a974-4dc7bf645ef7 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:01.366588786 +0000 UTC m=+50.728088568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls") pod "image-registry-6d84d78f65-sc6lv" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7") : secret "image-registry-tls" not found
Jul 26 15:18:53.924742 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:53.924709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:54.024623 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.024592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:54.840186 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.840129    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kg2g6" podStartSLOduration=7.721414512 podStartE2EDuration="9.840111075s" totalImagesPullingTime="2.118696563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:49.298584241 +0000 UTC m=+38.660084046" watchObservedRunningTime="2026-07-26 15:18:54.840111075 +0000 UTC m=+44.201610857"
Jul 26 15:18:54.840590 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.840581    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pkm75"]
Jul 26 15:18:54.866774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.866745    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pkm75"]
Jul 26 15:18:54.866942 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.866869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:54.869608 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.869584    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 26 15:18:54.869759 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.869726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 26 15:18:54.870989 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.870968    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 26 15:18:54.871070 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.870969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-flhls\""
Jul 26 15:18:54.871070 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.871012    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 26 15:18:54.872501 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.872477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:54.975907 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.975867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:54.975907 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.975905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7bxv\" (UniqueName: \"kubernetes.io/projected/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-api-access-c7bxv\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:54.976107 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.975979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/545cbb6e-eb78-4fce-9532-9a6c2be953b0-data-volume\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:54.976107 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.976018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/545cbb6e-eb78-4fce-9532-9a6c2be953b0-crio-socket\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:54.976107 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:54.976063    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077465 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/545cbb6e-eb78-4fce-9532-9a6c2be953b0-crio-socket\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077659 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077659 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077659 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.077588    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:18:55.077659 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7bxv\" (UniqueName: \"kubernetes.io/projected/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-api-access-c7bxv\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077659 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/545cbb6e-eb78-4fce-9532-9a6c2be953b0-data-volume\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077837 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.077669    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:55.577648322 +0000 UTC m=+44.939148105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : configmap "kube-rbac-proxy" not found
Jul 26 15:18:55.077837 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077683    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/545cbb6e-eb78-4fce-9532-9a6c2be953b0-crio-socket\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.077837 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.077746    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:55.077837 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.077806    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:55.577788638 +0000 UTC m=+44.939288439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:55.078029 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.077963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/545cbb6e-eb78-4fce-9532-9a6c2be953b0-data-volume\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.088214 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.088187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7bxv\" (UniqueName: \"kubernetes.io/projected/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-api-access-c7bxv\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.335767 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.335730    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:55.385997 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.385922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:55.581565 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.581531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.581788 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.581607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:55.581788 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.581672    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:18:55.581788 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.581717    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:55.581788 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.581762    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:56.581739309 +0000 UTC m=+45.943239108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : configmap "kube-rbac-proxy" not found
Jul 26 15:18:55.581788 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:55.581780    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:56.581771318 +0000 UTC m=+45.943271103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:55.719958 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.719865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:55.819987 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.819954    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:55.872708 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:55.872675    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:56.043109 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.043072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:56.092746 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.092720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:56.434049 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.433976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzqx7_3161f551-cb17-41b1-af1d-6a103b2f303d/dns-node-resolver/0.log"
Jul 26 15:18:56.590044 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.590002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:56.590209 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.590125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:56.590209 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:56.590141    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:18:56.590209 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:56.590208    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:58.590188229 +0000 UTC m=+47.951688030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : configmap "kube-rbac-proxy" not found
Jul 26 15:18:56.590313 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:56.590256    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:56.590313 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:56.590302    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:18:58.590289746 +0000 UTC m=+47.951789545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:56.705869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.705781    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"]
Jul 26 15:18:56.739815 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.739770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:56.740404 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.740389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"]
Jul 26 15:18:56.740482 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.740472    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"
Jul 26 15:18:56.743019 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.742985    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2r79n\""
Jul 26 15:18:56.743019 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.742987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 26 15:18:56.743261 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.742996    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 26 15:18:56.794616 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.794595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:56.893051 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.893010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5sw\" (UniqueName: \"kubernetes.io/projected/db22fd46-0a4a-4f62-aedb-add75aa332c7-kube-api-access-xv5sw\") pod \"migrator-6865c9967-phqcp\" (UID: \"db22fd46-0a4a-4f62-aedb-add75aa332c7\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"
Jul 26 15:18:56.993597 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:56.993514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5sw\" (UniqueName: \"kubernetes.io/projected/db22fd46-0a4a-4f62-aedb-add75aa332c7-kube-api-access-xv5sw\") pod \"migrator-6865c9967-phqcp\" (UID: \"db22fd46-0a4a-4f62-aedb-add75aa332c7\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"
Jul 26 15:18:57.002115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.002093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5sw\" (UniqueName: \"kubernetes.io/projected/db22fd46-0a4a-4f62-aedb-add75aa332c7-kube-api-access-xv5sw\") pod \"migrator-6865c9967-phqcp\" (UID: \"db22fd46-0a4a-4f62-aedb-add75aa332c7\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"
Jul 26 15:18:57.049339 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.049298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"
Jul 26 15:18:57.201014 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.200987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp"]
Jul 26 15:18:57.203818 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:57.203792    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb22fd46_0a4a_4f62_aedb_add75aa332c7.slice/crio-0f20e5c2b3ebda09939c7f9c2605a8d7bb29f9ed2dec4cad6324f5e1a8cbb2d2 WatchSource:0}: Error finding container 0f20e5c2b3ebda09939c7f9c2605a8d7bb29f9ed2dec4cad6324f5e1a8cbb2d2: Status 404 returned error can't find the container with id 0f20e5c2b3ebda09939c7f9c2605a8d7bb29f9ed2dec4cad6324f5e1a8cbb2d2
Jul 26 15:18:57.302487 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.302448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp" event={"ID":"db22fd46-0a4a-4f62-aedb-add75aa332c7","Type":"ContainerStarted","Data":"0f20e5c2b3ebda09939c7f9c2605a8d7bb29f9ed2dec4cad6324f5e1a8cbb2d2"}
Jul 26 15:18:57.635390 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.635311    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgw6g_eb958b2d-6ce7-4d68-9fc4-c02f2dce305c/node-ca/0.log"
Jul 26 15:18:57.644495 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.644464    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9pfgd"]
Jul 26 15:18:57.677114 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.677082    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:57.677958 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.677920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9pfgd"]
Jul 26 15:18:57.678046 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.678022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.680597 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.680577    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 26 15:18:57.681844 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.681822    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 26 15:18:57.681988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.681822    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 26 15:18:57.681988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.681825    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-27h28\""
Jul 26 15:18:57.681988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.681854    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 26 15:18:57.697865 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.697838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8fg\" (UniqueName: \"kubernetes.io/projected/4b9a6c99-3bdb-441f-a044-20efed567d1c-kube-api-access-fm8fg\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.697995 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.697889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b9a6c99-3bdb-441f-a044-20efed567d1c-signing-key\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.698051 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.698016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b9a6c99-3bdb-441f-a044-20efed567d1c-signing-cabundle\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.737255 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.737220    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log" limit=1024
Jul 26 15:18:57.798951 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.798901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8fg\" (UniqueName: \"kubernetes.io/projected/4b9a6c99-3bdb-441f-a044-20efed567d1c-kube-api-access-fm8fg\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.799146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.798997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b9a6c99-3bdb-441f-a044-20efed567d1c-signing-key\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.799146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.799080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b9a6c99-3bdb-441f-a044-20efed567d1c-signing-cabundle\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.799767 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.799740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b9a6c99-3bdb-441f-a044-20efed567d1c-signing-cabundle\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.803398 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.803372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b9a6c99-3bdb-441f-a044-20efed567d1c-signing-key\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.807453 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.807419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8fg\" (UniqueName: \"kubernetes.io/projected/4b9a6c99-3bdb-441f-a044-20efed567d1c-kube-api-access-fm8fg\") pod \"service-ca-658d7b7c78-9pfgd\" (UID: \"4b9a6c99-3bdb-441f-a044-20efed567d1c\") " pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:57.987502 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:57.987421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd"
Jul 26 15:18:58.139344 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:58.139313    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9pfgd"]
Jul 26 15:18:58.142778 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:18:58.142751    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9a6c99_3bdb_441f_a044_20efed567d1c.slice/crio-ef3d8e5c9209d1db73923242f16c3f430181caeeb34d3379796a4ebf208ff814 WatchSource:0}: Error finding container ef3d8e5c9209d1db73923242f16c3f430181caeeb34d3379796a4ebf208ff814: Status 404 returned error can't find the container with id ef3d8e5c9209d1db73923242f16c3f430181caeeb34d3379796a4ebf208ff814
Jul 26 15:18:58.235502 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:58.235475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kg2g6_40df5a6f-5aa3-415a-84d1-4a06df657748/serve-healthcheck-canary/0.log"
Jul 26 15:18:58.306117 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:58.306077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd" event={"ID":"4b9a6c99-3bdb-441f-a044-20efed567d1c","Type":"ContainerStarted","Data":"ef3d8e5c9209d1db73923242f16c3f430181caeeb34d3379796a4ebf208ff814"}
Jul 26 15:18:58.604763 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:58.604657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:58.604945 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:58.604769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:18:58.604945 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:58.604850    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:58.604945 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:58.604892    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:18:58.604945 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:58.604944    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:02.6049121 +0000 UTC m=+51.966411901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:18:58.605083 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:18:58.604969    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:02.604952811 +0000 UTC m=+51.966452596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : configmap "kube-rbac-proxy" not found
Jul 26 15:18:59.311436 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:59.311398    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp" event={"ID":"db22fd46-0a4a-4f62-aedb-add75aa332c7","Type":"ContainerStarted","Data":"864932689c360408c72838ac6501386f9dee646ec6846ce7cbe5954f48cdee30"}
Jul 26 15:18:59.311888 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:59.311463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp" event={"ID":"db22fd46-0a4a-4f62-aedb-add75aa332c7","Type":"ContainerStarted","Data":"b6c09406d2c104b684263e9a9b08dbdf03a463aa83b66ee342802237e22bcb0d"}
Jul 26 15:18:59.329301 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:18:59.329244    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-phqcp" podStartSLOduration=1.76217975 podStartE2EDuration="3.329226525s" totalImagesPullingTime="1.567046775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:59.328072141 +0000 UTC m=+48.689571946" watchObservedRunningTime="2026-07-26 15:18:59.329226525 +0000 UTC m=+48.690726329"
Jul 26 15:19:01.318007 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:01.317967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd" event={"ID":"4b9a6c99-3bdb-441f-a044-20efed567d1c","Type":"ContainerStarted","Data":"f565a422efe9f4c8d72151d4072caa9b1a234ffff8874b39cbe8fc9e9b5a6a99"}
Jul 26 15:19:01.335632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:01.335579    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-9pfgd" podStartSLOduration=1.939872978 podStartE2EDuration="4.335558779s" totalImagesPullingTime="2.395685801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:01.334217668 +0000 UTC m=+50.695717472" watchObservedRunningTime="2026-07-26 15:19:01.335558779 +0000 UTC m=+50.697058586"
Jul 26 15:19:01.429922 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:01.429885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:19:01.430124 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:01.430010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:01.430124 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:01.430055    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:19:01.430124 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:01.430098    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:19:01.430124 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:01.430109    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d84d78f65-sc6lv: secret "image-registry-tls" not found
Jul 26 15:19:01.430325 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:01.430131    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls podName:b42dc95f-9578-4d2f-a323-978105b51494 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:17.430111807 +0000 UTC m=+66.791611593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls") pod "dns-default-6pjm8" (UID: "b42dc95f-9578-4d2f-a323-978105b51494") : secret "dns-default-metrics-tls" not found
Jul 26 15:19:01.430325 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:01.430150    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls podName:999aa0bb-7734-4c71-a974-4dc7bf645ef7 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:17.430139317 +0000 UTC m=+66.791639099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls") pod "image-registry-6d84d78f65-sc6lv" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7") : secret "image-registry-tls" not found
Jul 26 15:19:02.640364 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:02.640322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:02.640769 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:02.640401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:02.640769 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:02.640450    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:19:02.640769 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:02.640505    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:19:02.640769 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:02.640517    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:10.640501358 +0000 UTC m=+60.002001140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : configmap "kube-rbac-proxy" not found
Jul 26 15:19:02.640769 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:02.640546    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:10.640533994 +0000 UTC m=+60.002033776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:19:10.706248 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:10.706212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:10.706792 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:10.706285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:10.706792 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:10.706386    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:19:10.706792 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:10.706454    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls podName:545cbb6e-eb78-4fce-9532-9a6c2be953b0 nodeName:}" failed. No retries permitted until 2026-07-26 15:19:26.706437989 +0000 UTC m=+76.067937771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pkm75" (UID: "545cbb6e-eb78-4fce-9532-9a6c2be953b0") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:19:10.706792 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:10.706745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/545cbb6e-eb78-4fce-9532-9a6c2be953b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:11.808891 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:11.808860    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rzcm5"
Jul 26 15:19:16.856277 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.856226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:19:16.856277 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.856281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:19:16.859683 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.859659    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:19:16.859740 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.859684    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:19:16.869304 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.869265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fd9c967-865a-487c-bacd-26c2ce1c9052-original-pull-secret\") pod \"global-pull-secret-syncer-hg694\" (UID: \"1fd9c967-865a-487c-bacd-26c2ce1c9052\") " pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:19:16.869427 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.869386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:19:16.879862 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.879833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcbnq\" (UniqueName: \"kubernetes.io/projected/03a83db4-202b-4764-adee-f9870cefa1fd-kube-api-access-pcbnq\") pod \"network-check-target-dqsgj\" (UID: \"03a83db4-202b-4764-adee-f9870cefa1fd\") " pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:19:16.957320 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.957284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:19:16.960115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.960092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:19:16.970750 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:16.970723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5de0024-336f-4175-9c20-7d8957818f89-metrics-certs\") pod \"network-metrics-daemon-nx9dd\" (UID: \"f5de0024-336f-4175-9c20-7d8957818f89\") " pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:19:17.010662 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.010632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bcjwm\""
Jul 26 15:19:17.018836 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.018815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:19:17.111424 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.111348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hg694"
Jul 26 15:19:17.119534 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.119503    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xwws\""
Jul 26 15:19:17.127156 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.127126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx9dd"
Jul 26 15:19:17.145420 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.145356    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqsgj"]
Jul 26 15:19:17.248142 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.248107    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hg694"]
Jul 26 15:19:17.251808 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:17.251782    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd9c967_865a_487c_bacd_26c2ce1c9052.slice/crio-55caa488bc57159110eb7c74bd6b9c84d5700d041093efba504fe04d47bf2362 WatchSource:0}: Error finding container 55caa488bc57159110eb7c74bd6b9c84d5700d041093efba504fe04d47bf2362: Status 404 returned error can't find the container with id 55caa488bc57159110eb7c74bd6b9c84d5700d041093efba504fe04d47bf2362
Jul 26 15:19:17.264057 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.264034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nx9dd"]
Jul 26 15:19:17.268007 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:17.267965    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5de0024_336f_4175_9c20_7d8957818f89.slice/crio-632c31ed6ac9e495ff68dfc4c44639732469af34db34fa149290990495e55ee3 WatchSource:0}: Error finding container 632c31ed6ac9e495ff68dfc4c44639732469af34db34fa149290990495e55ee3: Status 404 returned error can't find the container with id 632c31ed6ac9e495ff68dfc4c44639732469af34db34fa149290990495e55ee3
Jul 26 15:19:17.359224 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.359183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqsgj" event={"ID":"03a83db4-202b-4764-adee-f9870cefa1fd","Type":"ContainerStarted","Data":"de0238037fb9b0d7e8cbed400b97c7cb38027473f65a8dbcd847890a272beed0"}
Jul 26 15:19:17.360432 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.360402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nx9dd" event={"ID":"f5de0024-336f-4175-9c20-7d8957818f89","Type":"ContainerStarted","Data":"632c31ed6ac9e495ff68dfc4c44639732469af34db34fa149290990495e55ee3"}
Jul 26 15:19:17.361461 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.361402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hg694" event={"ID":"1fd9c967-865a-487c-bacd-26c2ce1c9052","Type":"ContainerStarted","Data":"55caa488bc57159110eb7c74bd6b9c84d5700d041093efba504fe04d47bf2362"}
Jul 26 15:19:17.460665 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.460623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:17.460665 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.460671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:19:17.463277 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.463251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dc95f-9578-4d2f-a323-978105b51494-metrics-tls\") pod \"dns-default-6pjm8\" (UID: \"b42dc95f-9578-4d2f-a323-978105b51494\") " pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:19:17.463391 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.463294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"image-registry-6d84d78f65-sc6lv\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") " pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:17.672415 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.672319    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l6h6k\""
Jul 26 15:19:17.677888 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.677859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:17.692833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.692805    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4hft8\""
Jul 26 15:19:17.699609 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.699584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:19:17.859365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.858636    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d84d78f65-sc6lv"]
Jul 26 15:19:17.864573 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:17.864539    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999aa0bb_7734_4c71_a974_4dc7bf645ef7.slice/crio-03a996860f02a895c0809426c03a0b7189cae7caabe5cbcb40aefe3853e188ae WatchSource:0}: Error finding container 03a996860f02a895c0809426c03a0b7189cae7caabe5cbcb40aefe3853e188ae: Status 404 returned error can't find the container with id 03a996860f02a895c0809426c03a0b7189cae7caabe5cbcb40aefe3853e188ae
Jul 26 15:19:17.877064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:17.877041    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pjm8"]
Jul 26 15:19:17.885717 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:17.885680    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42dc95f_9578_4d2f_a323_978105b51494.slice/crio-1329bb5591f07f876f0ee380d208be44c1474edff5a3cdb196c4b5a0ab80963f WatchSource:0}: Error finding container 1329bb5591f07f876f0ee380d208be44c1474edff5a3cdb196c4b5a0ab80963f: Status 404 returned error can't find the container with id 1329bb5591f07f876f0ee380d208be44c1474edff5a3cdb196c4b5a0ab80963f
Jul 26 15:19:18.367263 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:18.367224    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv" event={"ID":"999aa0bb-7734-4c71-a974-4dc7bf645ef7","Type":"ContainerStarted","Data":"62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f"}
Jul 26 15:19:18.367437 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:18.367289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv" event={"ID":"999aa0bb-7734-4c71-a974-4dc7bf645ef7","Type":"ContainerStarted","Data":"03a996860f02a895c0809426c03a0b7189cae7caabe5cbcb40aefe3853e188ae"}
Jul 26 15:19:18.367437 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:18.367330    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:18.369087 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:18.369012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pjm8" event={"ID":"b42dc95f-9578-4d2f-a323-978105b51494","Type":"ContainerStarted","Data":"1329bb5591f07f876f0ee380d208be44c1474edff5a3cdb196c4b5a0ab80963f"}
Jul 26 15:19:18.393282 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:18.391018    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv" podStartSLOduration=63.390993767 podStartE2EDuration="1m3.390993767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:18.386676406 +0000 UTC m=+67.748176210" watchObservedRunningTime="2026-07-26 15:19:18.390993767 +0000 UTC m=+67.752493571"
Jul 26 15:19:19.379541 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.379414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nx9dd" event={"ID":"f5de0024-336f-4175-9c20-7d8957818f89","Type":"ContainerStarted","Data":"b50fbd44b63c3e65063e04f0370ef4dba60858a2d2c7b9d7d872c1dca258a483"}
Jul 26 15:19:19.379541 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.379463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nx9dd" event={"ID":"f5de0024-336f-4175-9c20-7d8957818f89","Type":"ContainerStarted","Data":"2ae4bf6a107a92c8739a849ab9bc9eb6a3010357067f3cdbf0c242df1d3a0422"}
Jul 26 15:19:19.400325 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.398770    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nx9dd" podStartSLOduration=66.857026224 podStartE2EDuration="1m8.398746599s" totalImagesPullingTime="1.541720375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:19.397163178 +0000 UTC m=+68.758662981" watchObservedRunningTime="2026-07-26 15:19:19.398746599 +0000 UTC m=+68.760246404"
Jul 26 15:19:19.473690 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.473644    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"]
Jul 26 15:19:19.485548 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.485515    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"]
Jul 26 15:19:19.485726 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.485674    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.489699 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.489585    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 26 15:19:19.494476 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.494442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 26 15:19:19.495127 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.494747    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 26 15:19:19.495127 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.494902    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 26 15:19:19.495583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.495400    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n2fjm\""
Jul 26 15:19:19.513204 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.509572    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d84d78f65-sc6lv"]
Jul 26 15:19:19.513204 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.509639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"]
Jul 26 15:19:19.513204 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.509662    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"]
Jul 26 15:19:19.513204 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.509744    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.513867 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.513727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 26 15:19:19.515384 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.515357    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 26 15:19:19.515550 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.515532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 26 15:19:19.515615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.515595    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 26 15:19:19.575889 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.575754    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-db455859b-f57xh"]
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-ca\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntxc\" (UniqueName: \"kubernetes.io/projected/0f01e6be-70f6-401a-ad8c-f75f40c726f8-kube-api-access-vntxc\") pod \"managed-serviceaccount-addon-agent-7567784d-78mzd\" (UID: \"0f01e6be-70f6-401a-ad8c-f75f40c726f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578544    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967v5\" (UniqueName: \"kubernetes.io/projected/e9e7d48c-71ed-443f-8823-016917692c4a-kube-api-access-967v5\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f01e6be-70f6-401a-ad8c-f75f40c726f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7567784d-78mzd\" (UID: \"0f01e6be-70f6-401a-ad8c-f75f40c726f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e7d48c-71ed-443f-8823-016917692c4a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.578774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.578662    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-hub\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.593749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.593696    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-db455859b-f57xh"]
Jul 26 15:19:19.593910 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.593834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.679336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxxwt\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-kube-api-access-cxxwt\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-hub\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c87c346-f88a-4e60-a787-7bb46d0a6679-ca-trust-extracted\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-bound-sa-token\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-registry-tls\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c87c346-f88a-4e60-a787-7bb46d0a6679-installation-pull-secrets\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-ca\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.679568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c87c346-f88a-4e60-a787-7bb46d0a6679-registry-certificates\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vntxc\" (UniqueName: \"kubernetes.io/projected/0f01e6be-70f6-401a-ad8c-f75f40c726f8-kube-api-access-vntxc\") pod \"managed-serviceaccount-addon-agent-7567784d-78mzd\" (UID: \"0f01e6be-70f6-401a-ad8c-f75f40c726f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c87c346-f88a-4e60-a787-7bb46d0a6679-image-registry-private-configuration\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c87c346-f88a-4e60-a787-7bb46d0a6679-trusted-ca\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967v5\" (UniqueName: \"kubernetes.io/projected/e9e7d48c-71ed-443f-8823-016917692c4a-kube-api-access-967v5\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f01e6be-70f6-401a-ad8c-f75f40c726f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7567784d-78mzd\" (UID: \"0f01e6be-70f6-401a-ad8c-f75f40c726f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.679895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.679743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e7d48c-71ed-443f-8823-016917692c4a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.684152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.683990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e7d48c-71ed-443f-8823-016917692c4a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.688998 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.684630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-ca\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.688998 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.684775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-hub\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.688998 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.685081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.690457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.690366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0f01e6be-70f6-401a-ad8c-f75f40c726f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7567784d-78mzd\" (UID: \"0f01e6be-70f6-401a-ad8c-f75f40c726f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.691842 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.691817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntxc\" (UniqueName: \"kubernetes.io/projected/0f01e6be-70f6-401a-ad8c-f75f40c726f8-kube-api-access-vntxc\") pod \"managed-serviceaccount-addon-agent-7567784d-78mzd\" (UID: \"0f01e6be-70f6-401a-ad8c-f75f40c726f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.694098 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.694075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967v5\" (UniqueName: \"kubernetes.io/projected/e9e7d48c-71ed-443f-8823-016917692c4a-kube-api-access-967v5\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.694265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.694241    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e7d48c-71ed-443f-8823-016917692c4a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bdf45dc69-8t99x\" (UID: \"e9e7d48c-71ed-443f-8823-016917692c4a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.780768 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxxwt\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-kube-api-access-cxxwt\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c87c346-f88a-4e60-a787-7bb46d0a6679-ca-trust-extracted\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-bound-sa-token\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-registry-tls\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c87c346-f88a-4e60-a787-7bb46d0a6679-installation-pull-secrets\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c87c346-f88a-4e60-a787-7bb46d0a6679-registry-certificates\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.780983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c87c346-f88a-4e60-a787-7bb46d0a6679-image-registry-private-configuration\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.781133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c87c346-f88a-4e60-a787-7bb46d0a6679-trusted-ca\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.781358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.781236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c87c346-f88a-4e60-a787-7bb46d0a6679-ca-trust-extracted\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.782527 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.782446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c87c346-f88a-4e60-a787-7bb46d0a6679-registry-certificates\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.782638 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.782619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c87c346-f88a-4e60-a787-7bb46d0a6679-trusted-ca\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.784054 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.784029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-registry-tls\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.784947 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.784904    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c87c346-f88a-4e60-a787-7bb46d0a6679-installation-pull-secrets\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.785433 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.785411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c87c346-f88a-4e60-a787-7bb46d0a6679-image-registry-private-configuration\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.792762 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.792741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxxwt\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-kube-api-access-cxxwt\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.792859 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.792788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c87c346-f88a-4e60-a787-7bb46d0a6679-bound-sa-token\") pod \"image-registry-db455859b-f57xh\" (UID: \"3c87c346-f88a-4e60-a787-7bb46d0a6679\") " pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:19.812037 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.812008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"
Jul 26 15:19:19.826219 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.826187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"
Jul 26 15:19:19.915577 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:19.915356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:22.899000 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:22.898867    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x"]
Jul 26 15:19:22.905499 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:22.905301    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9e7d48c_71ed_443f_8823_016917692c4a.slice/crio-db7defbb7f11e985cd25f29b8a7a5bb6b5b3def906ab7468de834f1752bb319d WatchSource:0}: Error finding container db7defbb7f11e985cd25f29b8a7a5bb6b5b3def906ab7468de834f1752bb319d: Status 404 returned error can't find the container with id db7defbb7f11e985cd25f29b8a7a5bb6b5b3def906ab7468de834f1752bb319d
Jul 26 15:19:22.923779 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:22.923738    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd"]
Jul 26 15:19:22.927480 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:22.927453    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-db455859b-f57xh"]
Jul 26 15:19:22.929987 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:22.929958    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f01e6be_70f6_401a_ad8c_f75f40c726f8.slice/crio-989aa7e301e91fb187a126e1462b97efdc96f43677ce883d3b4e03c165edd9c5 WatchSource:0}: Error finding container 989aa7e301e91fb187a126e1462b97efdc96f43677ce883d3b4e03c165edd9c5: Status 404 returned error can't find the container with id 989aa7e301e91fb187a126e1462b97efdc96f43677ce883d3b4e03c165edd9c5
Jul 26 15:19:22.930791 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:22.930765    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c87c346_f88a_4e60_a787_7bb46d0a6679.slice/crio-d31fc21d4528e9273ccaaf7a577f6d820d9d77eaa291843b4c94f1cbbfe03bed WatchSource:0}: Error finding container d31fc21d4528e9273ccaaf7a577f6d820d9d77eaa291843b4c94f1cbbfe03bed: Status 404 returned error can't find the container with id d31fc21d4528e9273ccaaf7a577f6d820d9d77eaa291843b4c94f1cbbfe03bed
Jul 26 15:19:23.393635 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.393600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db455859b-f57xh" event={"ID":"3c87c346-f88a-4e60-a787-7bb46d0a6679","Type":"ContainerStarted","Data":"7dcd290b88b08c78a25821b8696a29b55408c67914a179d7e955cff015c08189"}
Jul 26 15:19:23.393835 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.393651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-db455859b-f57xh" event={"ID":"3c87c346-f88a-4e60-a787-7bb46d0a6679","Type":"ContainerStarted","Data":"d31fc21d4528e9273ccaaf7a577f6d820d9d77eaa291843b4c94f1cbbfe03bed"}
Jul 26 15:19:23.393835 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.393695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:23.395210 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.395187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hg694" event={"ID":"1fd9c967-865a-487c-bacd-26c2ce1c9052","Type":"ContainerStarted","Data":"5ccbd7c7ec66564a1bcdbdd6011c02ad4aa99acf0f6c55430b24e735b0d70f03"}
Jul 26 15:19:23.396989 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.396957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pjm8" event={"ID":"b42dc95f-9578-4d2f-a323-978105b51494","Type":"ContainerStarted","Data":"83c64479174dedf21b8646866420ec934c2a40bf96f2be1a850a7cf43c17d65e"}
Jul 26 15:19:23.397095 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.397019    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pjm8" event={"ID":"b42dc95f-9578-4d2f-a323-978105b51494","Type":"ContainerStarted","Data":"a4893970f517ee4c845df2e822aa96fe75528c0985aa577e758f0bc63b8062db"}
Jul 26 15:19:23.397095 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.397055    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:19:23.398382 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.398364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqsgj" event={"ID":"03a83db4-202b-4764-adee-f9870cefa1fd","Type":"ContainerStarted","Data":"113c05abf3b0a1b54b4364a93e864d583aa934a4b302ee4b7261535e20fcd3a9"}
Jul 26 15:19:23.398493 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.398456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:19:23.399448 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.399429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x" event={"ID":"e9e7d48c-71ed-443f-8823-016917692c4a","Type":"ContainerStarted","Data":"db7defbb7f11e985cd25f29b8a7a5bb6b5b3def906ab7468de834f1752bb319d"}
Jul 26 15:19:23.400450 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.400433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd" event={"ID":"0f01e6be-70f6-401a-ad8c-f75f40c726f8","Type":"ContainerStarted","Data":"989aa7e301e91fb187a126e1462b97efdc96f43677ce883d3b4e03c165edd9c5"}
Jul 26 15:19:23.413806 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.413761    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-db455859b-f57xh" podStartSLOduration=4.413748057 podStartE2EDuration="4.413748057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:23.412095087 +0000 UTC m=+72.773594891" watchObservedRunningTime="2026-07-26 15:19:23.413748057 +0000 UTC m=+72.775247860"
Jul 26 15:19:23.425486 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.425437    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hg694" podStartSLOduration=66.981636646 podStartE2EDuration="1m12.425422023s" totalImagesPullingTime="5.443785377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:23.425017572 +0000 UTC m=+72.786517378" watchObservedRunningTime="2026-07-26 15:19:23.425422023 +0000 UTC m=+72.786921826"
Jul 26 15:19:23.441722 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.441675    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqsgj" podStartSLOduration=66.899593245 podStartE2EDuration="1m12.4416592s" totalImagesPullingTime="5.542065955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:23.441103536 +0000 UTC m=+72.802603351" watchObservedRunningTime="2026-07-26 15:19:23.4416592 +0000 UTC m=+72.803159057"
Jul 26 15:19:23.457479 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:23.457433    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6pjm8" podStartSLOduration=33.644714528 podStartE2EDuration="38.457417956s" totalImagesPullingTime="4.812703428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:23.456535846 +0000 UTC m=+72.818035655" watchObservedRunningTime="2026-07-26 15:19:23.457417956 +0000 UTC m=+72.818917807"
Jul 26 15:19:26.747303 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:26.747255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:26.750084 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:26.750056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/545cbb6e-eb78-4fce-9532-9a6c2be953b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkm75\" (UID: \"545cbb6e-eb78-4fce-9532-9a6c2be953b0\") " pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:26.978270 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:26.978243    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-flhls\""
Jul 26 15:19:26.986513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:26.986483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pkm75"
Jul 26 15:19:27.120321 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.120296    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pkm75"]
Jul 26 15:19:27.122525 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:27.122499    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545cbb6e_eb78_4fce_9532_9a6c2be953b0.slice/crio-eae4355bc09b8c8dec80723479b59bc62b9073ac68771a1d4e2d45d568a285a4 WatchSource:0}: Error finding container eae4355bc09b8c8dec80723479b59bc62b9073ac68771a1d4e2d45d568a285a4: Status 404 returned error can't find the container with id eae4355bc09b8c8dec80723479b59bc62b9073ac68771a1d4e2d45d568a285a4
Jul 26 15:19:27.418107 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.418014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkm75" event={"ID":"545cbb6e-eb78-4fce-9532-9a6c2be953b0","Type":"ContainerStarted","Data":"eae4355bc09b8c8dec80723479b59bc62b9073ac68771a1d4e2d45d568a285a4"}
Jul 26 15:19:27.420039 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.420016    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x" event={"ID":"e9e7d48c-71ed-443f-8823-016917692c4a","Type":"ContainerStarted","Data":"2ac4709321b78620d5f584889a79d5f6a2b8194cfa4fc609f10e048b3e3fe83f"}
Jul 26 15:19:27.420124 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.420052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x" event={"ID":"e9e7d48c-71ed-443f-8823-016917692c4a","Type":"ContainerStarted","Data":"d462790ac5e873b6c4f162e8eefbeec5abed26b4ff02e5581455c781623e5c30"}
Jul 26 15:19:27.420124 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.420069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x" event={"ID":"e9e7d48c-71ed-443f-8823-016917692c4a","Type":"ContainerStarted","Data":"9670c518bc5d7d55df3f8cbfffe4b1a12f7cc8228b78d12788e1c83f4459613a"}
Jul 26 15:19:27.421487 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.421459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd" event={"ID":"0f01e6be-70f6-401a-ad8c-f75f40c726f8","Type":"ContainerStarted","Data":"145ef8b81cab29d3c81f41847d67348cbc4333e89fa99d797a297c8bb76cc4dc"}
Jul 26 15:19:27.455813 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.455758    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdf45dc69-8t99x" podStartSLOduration=4.519763898 podStartE2EDuration="8.45574163s" totalImagesPullingTime="3.935977732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:27.437982888 +0000 UTC m=+76.799482684" watchObservedRunningTime="2026-07-26 15:19:27.45574163 +0000 UTC m=+76.817241412"
Jul 26 15:19:27.456031 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:27.456009    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7567784d-78mzd" podStartSLOduration=4.555816989 podStartE2EDuration="8.456004862s" totalImagesPullingTime="3.900187873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:27.455085946 +0000 UTC m=+76.816585750" watchObservedRunningTime="2026-07-26 15:19:27.456004862 +0000 UTC m=+76.817504666"
Jul 26 15:19:32.443909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:32.443818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkm75" event={"ID":"545cbb6e-eb78-4fce-9532-9a6c2be953b0","Type":"ContainerStarted","Data":"f4de315991968550e8a98581cbaca1233c8870c8531a644e752f4923b0088803"}
Jul 26 15:19:33.407831 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:33.407796    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6pjm8"
Jul 26 15:19:36.462268 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.462228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkm75" event={"ID":"545cbb6e-eb78-4fce-9532-9a6c2be953b0","Type":"ContainerStarted","Data":"ec8a1c4a36f06ef800ca3a0de62911ab06692c60b5853c7df609ddb4c22f05b3"}
Jul 26 15:19:36.729166 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.728204    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-58l9l"]
Jul 26 15:19:36.732123 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.732058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.734896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.734869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 26 15:19:36.735340 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.735318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7sx6d\""
Jul 26 15:19:36.735644 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.735624    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 26 15:19:36.736272 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.736251    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 26 15:19:36.737563 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.736528    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 26 15:19:36.737563 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.736720    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 26 15:19:36.737563 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.736988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 26 15:19:36.835256 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-tls\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835256 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96kxm\" (UniqueName: \"kubernetes.io/projected/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-kube-api-access-96kxm\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835256 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-textfile\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835256 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-wtmp\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-root\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-metrics-client-ca\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-sys\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.835588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.835474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936445 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-root\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-metrics-client-ca\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-sys\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-root\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-tls\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96kxm\" (UniqueName: \"kubernetes.io/projected/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-kube-api-access-96kxm\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-sys\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.936615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-textfile\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.937042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-wtmp\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.937042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.936660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.937684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.937207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-metrics-client-ca\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.937684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.937343    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-wtmp\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.937684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.937471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-textfile\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.937684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.937637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.940195 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.939547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.940315 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.940198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-node-exporter-tls\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:36.946283 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:36.946259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96kxm\" (UniqueName: \"kubernetes.io/projected/b3f01a00-2040-45e7-a3df-f7e665fcfbb2-kube-api-access-96kxm\") pod \"node-exporter-58l9l\" (UID: \"b3f01a00-2040-45e7-a3df-f7e665fcfbb2\") " pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:37.045216 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:37.045183    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-58l9l"
Jul 26 15:19:37.059479 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:19:37.059452    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f01a00_2040_45e7_a3df_f7e665fcfbb2.slice/crio-b80ddb460d009a693147b95ccebef9cf377eb76a25f266da5681cbb54c32513d WatchSource:0}: Error finding container b80ddb460d009a693147b95ccebef9cf377eb76a25f266da5681cbb54c32513d: Status 404 returned error can't find the container with id b80ddb460d009a693147b95ccebef9cf377eb76a25f266da5681cbb54c32513d
Jul 26 15:19:37.467785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:37.467695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58l9l" event={"ID":"b3f01a00-2040-45e7-a3df-f7e665fcfbb2","Type":"ContainerStarted","Data":"b80ddb460d009a693147b95ccebef9cf377eb76a25f266da5681cbb54c32513d"}
Jul 26 15:19:40.388850 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:40.388822    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:40.481222 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:40.481186    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkm75" event={"ID":"545cbb6e-eb78-4fce-9532-9a6c2be953b0","Type":"ContainerStarted","Data":"beae503d1b8f8b1613970ef66c03206174b582ea1206ae9c636ce531bf9d1bc9"}
Jul 26 15:19:40.482808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:40.482782    2561 generic.go:356] "Generic (PLEG): container finished" podID="b3f01a00-2040-45e7-a3df-f7e665fcfbb2" containerID="23cf6922392486977f415bea473492568ac12c97bbb1aaff0aa1a20e66c16a26" exitCode=0
Jul 26 15:19:40.482960 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:40.482822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58l9l" event={"ID":"b3f01a00-2040-45e7-a3df-f7e665fcfbb2","Type":"ContainerDied","Data":"23cf6922392486977f415bea473492568ac12c97bbb1aaff0aa1a20e66c16a26"}
Jul 26 15:19:40.500707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:40.500663    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pkm75" podStartSLOduration=34.173464888 podStartE2EDuration="46.500647122s" totalImagesPullingTime="12.327182234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:18:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:40.499588197 +0000 UTC m=+89.861088002" watchObservedRunningTime="2026-07-26 15:19:40.500647122 +0000 UTC m=+89.862146926"
Jul 26 15:19:41.489281 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:41.489241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58l9l" event={"ID":"b3f01a00-2040-45e7-a3df-f7e665fcfbb2","Type":"ContainerStarted","Data":"0ee4d0960e605db19bf24b1c7acdc5c76fcd8e6a2204bc55132c1dfe185a797d"}
Jul 26 15:19:41.489681 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:41.489308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58l9l" event={"ID":"b3f01a00-2040-45e7-a3df-f7e665fcfbb2","Type":"ContainerStarted","Data":"2a813dd16158db4fbf2268c5de222ca3e3b17354ed8d7030ca428c001d1919b3"}
Jul 26 15:19:41.511092 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:41.511041    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-58l9l" podStartSLOduration=2.937133547 podStartE2EDuration="5.511022799s" totalImagesPullingTime="2.501092074s" totalInitContainerRuntime="72.797178ms" isStatefulPod=true podCreationTimestamp="2026-07-26 15:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:19:41.510677923 +0000 UTC m=+90.872177731" watchObservedRunningTime="2026-07-26 15:19:41.511022799 +0000 UTC m=+90.872522605"
Jul 26 15:19:44.410094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:44.410060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-db455859b-f57xh"
Jul 26 15:19:45.403527 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.403483    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv" podUID="999aa0bb-7734-4c71-a974-4dc7bf645ef7" containerName="registry" containerID="cri-o://62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f" gracePeriod=30
Jul 26 15:19:45.636833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.636807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:45.710632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710543    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-image-registry-private-configuration\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.710632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-bound-sa-token\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.710632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710615    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.710632 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710633    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqp6s\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-kube-api-access-wqp6s\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.710986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-trusted-ca\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.710986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710717    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/999aa0bb-7734-4c71-a974-4dc7bf645ef7-ca-trust-extracted\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.710986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.710754    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-certificates\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.711209 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.711178    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:19:45.711279 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.711259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:19:45.713249 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.713218    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-kube-api-access-wqp6s" (OuterVolumeSpecName: "kube-api-access-wqp6s") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "kube-api-access-wqp6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:19:45.713377 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.713283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:19:45.713377 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.713310    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:19:45.713377 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.713369    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:19:45.719329 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.719301    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/999aa0bb-7734-4c71-a974-4dc7bf645ef7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:19:45.811593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811544    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-installation-pull-secrets\") pod \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\" (UID: \"999aa0bb-7734-4c71-a974-4dc7bf645ef7\") "
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811694    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-certificates\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811706    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-image-registry-private-configuration\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811715    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-bound-sa-token\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811724    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811731    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqp6s\" (UniqueName: \"kubernetes.io/projected/999aa0bb-7734-4c71-a974-4dc7bf645ef7-kube-api-access-wqp6s\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811740    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/999aa0bb-7734-4c71-a974-4dc7bf645ef7-trusted-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.811749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.811748    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/999aa0bb-7734-4c71-a974-4dc7bf645ef7-ca-trust-extracted\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:45.813758 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.813733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "999aa0bb-7734-4c71-a974-4dc7bf645ef7" (UID: "999aa0bb-7734-4c71-a974-4dc7bf645ef7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:19:45.912120 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:45.912088    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/999aa0bb-7734-4c71-a974-4dc7bf645ef7-installation-pull-secrets\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:19:46.508414 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.508381    2561 generic.go:356] "Generic (PLEG): container finished" podID="999aa0bb-7734-4c71-a974-4dc7bf645ef7" containerID="62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f" exitCode=0
Jul 26 15:19:46.508575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.508428    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv"
Jul 26 15:19:46.508575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.508468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv" event={"ID":"999aa0bb-7734-4c71-a974-4dc7bf645ef7","Type":"ContainerDied","Data":"62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f"}
Jul 26 15:19:46.508575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.508525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d84d78f65-sc6lv" event={"ID":"999aa0bb-7734-4c71-a974-4dc7bf645ef7","Type":"ContainerDied","Data":"03a996860f02a895c0809426c03a0b7189cae7caabe5cbcb40aefe3853e188ae"}
Jul 26 15:19:46.508575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.508568    2561 scope.go:117] "RemoveContainer" containerID="62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f"
Jul 26 15:19:46.517512 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.517493    2561 scope.go:117] "RemoveContainer" containerID="62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f"
Jul 26 15:19:46.517817 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:19:46.517797    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f\": container with ID starting with 62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f not found: ID does not exist" containerID="62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f"
Jul 26 15:19:46.517866 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.517828    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f"} err="failed to get container status \"62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f\": rpc error: code = NotFound desc = could not find container \"62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f\": container with ID starting with 62e6f43514a91fb0f3afeb2f88b7a3abf275881e1e19e655c50bc0fd7c601d4f not found: ID does not exist"
Jul 26 15:19:46.528773 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.528748    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d84d78f65-sc6lv"]
Jul 26 15:19:46.532752 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:46.532728    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d84d78f65-sc6lv"]
Jul 26 15:19:47.104779 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:47.104743    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="999aa0bb-7734-4c71-a974-4dc7bf645ef7" path="/var/lib/kubelet/pods/999aa0bb-7734-4c71-a974-4dc7bf645ef7/volumes"
Jul 26 15:19:54.408338 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:19:54.408305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqsgj"
Jul 26 15:22:58.142336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.142297    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"]
Jul 26 15:22:58.142776 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.142530    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999aa0bb-7734-4c71-a974-4dc7bf645ef7" containerName="registry"
Jul 26 15:22:58.142776 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.142540    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="999aa0bb-7734-4c71-a974-4dc7bf645ef7" containerName="registry"
Jul 26 15:22:58.142776 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.142593    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="999aa0bb-7734-4c71-a974-4dc7bf645ef7" containerName="registry"
Jul 26 15:22:58.145500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.145484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.148291 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.148265    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 26 15:22:58.148415 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.148265    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 26 15:22:58.149483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.149465    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j48qz\""
Jul 26 15:22:58.153661 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.153639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"]
Jul 26 15:22:58.269718 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.269686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.269896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.269769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtpw8\" (UniqueName: \"kubernetes.io/projected/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-kube-api-access-mtpw8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.269896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.269797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.370999 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.370961    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.371146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.371021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtpw8\" (UniqueName: \"kubernetes.io/projected/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-kube-api-access-mtpw8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.371188 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.371139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.371418 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.371400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.371454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.371433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.379495 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.379451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtpw8\" (UniqueName: \"kubernetes.io/projected/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-kube-api-access-mtpw8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.455475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.455395    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:22:58.585482 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:58.585436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"]
Jul 26 15:22:58.588065 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:22:58.588038    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4a4fc9_4e50_4f85_85ed_a76729c01d60.slice/crio-cb30d77c5223a117e002ebfa28a9395bda06ab78ca149300040a16f3e55907ea WatchSource:0}: Error finding container cb30d77c5223a117e002ebfa28a9395bda06ab78ca149300040a16f3e55907ea: Status 404 returned error can't find the container with id cb30d77c5223a117e002ebfa28a9395bda06ab78ca149300040a16f3e55907ea
Jul 26 15:22:59.144849 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:22:59.144810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp" event={"ID":"6f4a4fc9-4e50-4f85-85ed-a76729c01d60","Type":"ContainerStarted","Data":"cb30d77c5223a117e002ebfa28a9395bda06ab78ca149300040a16f3e55907ea"}
Jul 26 15:23:05.167583 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:05.167539    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerID="43a06c6248f16cd8c1313496b4613cde02187633b4bcb1fffa8ee153bb229685" exitCode=0
Jul 26 15:23:05.167986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:05.167635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp" event={"ID":"6f4a4fc9-4e50-4f85-85ed-a76729c01d60","Type":"ContainerDied","Data":"43a06c6248f16cd8c1313496b4613cde02187633b4bcb1fffa8ee153bb229685"}
Jul 26 15:23:08.180352 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:08.180315    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerID="a7eeb3be64d86a5b91e58fc68160322d69d7eba757efd6af3c8533000533bb6d" exitCode=0
Jul 26 15:23:08.180742 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:08.180378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp" event={"ID":"6f4a4fc9-4e50-4f85-85ed-a76729c01d60","Type":"ContainerDied","Data":"a7eeb3be64d86a5b91e58fc68160322d69d7eba757efd6af3c8533000533bb6d"}
Jul 26 15:23:11.044953 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:11.044897    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 26 15:23:15.208513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:15.208477    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerID="8d09c2b5da26028a072523b7a35599c185704e12e4cc151986a39062cf94c562" exitCode=0
Jul 26 15:23:15.208959 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:15.208529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp" event={"ID":"6f4a4fc9-4e50-4f85-85ed-a76729c01d60","Type":"ContainerDied","Data":"8d09c2b5da26028a072523b7a35599c185704e12e4cc151986a39062cf94c562"}
Jul 26 15:23:16.332805 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.332781    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:23:16.514827 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.514794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-bundle\") pod \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") "
Jul 26 15:23:16.515025 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.514842    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtpw8\" (UniqueName: \"kubernetes.io/projected/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-kube-api-access-mtpw8\") pod \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") "
Jul 26 15:23:16.515025 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.514867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-util\") pod \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\" (UID: \"6f4a4fc9-4e50-4f85-85ed-a76729c01d60\") "
Jul 26 15:23:16.515479 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.515451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-bundle" (OuterVolumeSpecName: "bundle") pod "6f4a4fc9-4e50-4f85-85ed-a76729c01d60" (UID: "6f4a4fc9-4e50-4f85-85ed-a76729c01d60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:23:16.517143 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.517115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-kube-api-access-mtpw8" (OuterVolumeSpecName: "kube-api-access-mtpw8") pod "6f4a4fc9-4e50-4f85-85ed-a76729c01d60" (UID: "6f4a4fc9-4e50-4f85-85ed-a76729c01d60"). InnerVolumeSpecName "kube-api-access-mtpw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:23:16.519173 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.519144    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-util" (OuterVolumeSpecName: "util") pod "6f4a4fc9-4e50-4f85-85ed-a76729c01d60" (UID: "6f4a4fc9-4e50-4f85-85ed-a76729c01d60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:23:16.616094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.616047    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:16.616094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.616087    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtpw8\" (UniqueName: \"kubernetes.io/projected/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-kube-api-access-mtpw8\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:16.616094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:16.616100    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f4a4fc9-4e50-4f85-85ed-a76729c01d60-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:17.217072 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:17.217041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp" event={"ID":"6f4a4fc9-4e50-4f85-85ed-a76729c01d60","Type":"ContainerDied","Data":"cb30d77c5223a117e002ebfa28a9395bda06ab78ca149300040a16f3e55907ea"}
Jul 26 15:23:17.217245 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:17.217088    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb30d77c5223a117e002ebfa28a9395bda06ab78ca149300040a16f3e55907ea"
Jul 26 15:23:17.217245 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:17.217051    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbfjp"
Jul 26 15:23:20.927979 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.927945    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"]
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928198    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="pull"
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928210    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="pull"
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928216    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="extract"
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928222    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="extract"
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928235    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="util"
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928242    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="util"
Jul 26 15:23:20.928381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.928281    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4a4fc9-4e50-4f85-85ed-a76729c01d60" containerName="extract"
Jul 26 15:23:20.949692 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.949664    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:20.952237 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.952210    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"]
Jul 26 15:23:20.953132 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.953115    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 26 15:23:20.953278 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.953117    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fgmkw\""
Jul 26 15:23:20.953366 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:20.953353    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:23:21.043227 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.043193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwfjd\" (UniqueName: \"kubernetes.io/projected/7e055fe7-67ec-406d-94d4-4f39d6256eb5-kube-api-access-pwfjd\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl7kt\" (UID: \"7e055fe7-67ec-406d-94d4-4f39d6256eb5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.043395 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.043254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e055fe7-67ec-406d-94d4-4f39d6256eb5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl7kt\" (UID: \"7e055fe7-67ec-406d-94d4-4f39d6256eb5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.144218 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.144180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e055fe7-67ec-406d-94d4-4f39d6256eb5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl7kt\" (UID: \"7e055fe7-67ec-406d-94d4-4f39d6256eb5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.144445 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.144421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwfjd\" (UniqueName: \"kubernetes.io/projected/7e055fe7-67ec-406d-94d4-4f39d6256eb5-kube-api-access-pwfjd\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl7kt\" (UID: \"7e055fe7-67ec-406d-94d4-4f39d6256eb5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.144596 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.144579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e055fe7-67ec-406d-94d4-4f39d6256eb5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl7kt\" (UID: \"7e055fe7-67ec-406d-94d4-4f39d6256eb5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.153843 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.153817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwfjd\" (UniqueName: \"kubernetes.io/projected/7e055fe7-67ec-406d-94d4-4f39d6256eb5-kube-api-access-pwfjd\") pod \"cert-manager-operator-controller-manager-55c444bf86-sl7kt\" (UID: \"7e055fe7-67ec-406d-94d4-4f39d6256eb5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.259823 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.259789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"
Jul 26 15:23:21.421542 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.421515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt"]
Jul 26 15:23:21.424221 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:23:21.424196    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e055fe7_67ec_406d_94d4_4f39d6256eb5.slice/crio-a50c40fc1789a5aaf61a73e713c3ab606585b4f8b4ac40f82d9010c460980c6f WatchSource:0}: Error finding container a50c40fc1789a5aaf61a73e713c3ab606585b4f8b4ac40f82d9010c460980c6f: Status 404 returned error can't find the container with id a50c40fc1789a5aaf61a73e713c3ab606585b4f8b4ac40f82d9010c460980c6f
Jul 26 15:23:21.426917 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:21.426897    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:23:22.236663 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:22.236627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt" event={"ID":"7e055fe7-67ec-406d-94d4-4f39d6256eb5","Type":"ContainerStarted","Data":"a50c40fc1789a5aaf61a73e713c3ab606585b4f8b4ac40f82d9010c460980c6f"}
Jul 26 15:23:24.244701 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:24.244659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt" event={"ID":"7e055fe7-67ec-406d-94d4-4f39d6256eb5","Type":"ContainerStarted","Data":"6c22427392233684afe344f00b618fe3b9f3d80ebb383b1bf6ce083cf0d3fe3d"}
Jul 26 15:23:24.265884 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:24.265824    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sl7kt" podStartSLOduration=2.001421972 podStartE2EDuration="4.265807762s" totalImagesPullingTime="2.26438579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:23:24.26322447 +0000 UTC m=+313.624724277" watchObservedRunningTime="2026-07-26 15:23:24.265807762 +0000 UTC m=+313.627307566"
Jul 26 15:23:25.351514 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.351479    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"]
Jul 26 15:23:25.372645 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.372618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"]
Jul 26 15:23:25.372811 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.372726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.375499 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.375443    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j48qz\""
Jul 26 15:23:25.375499 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.375481    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 26 15:23:25.375708 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.375500    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 26 15:23:25.471556 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.471522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.471556 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.471561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.471770 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.471630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wz5\" (UniqueName: \"kubernetes.io/projected/6f26b8c9-9dda-4902-929f-b42d6ca654ae-kube-api-access-56wz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.572059 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.572017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wz5\" (UniqueName: \"kubernetes.io/projected/6f26b8c9-9dda-4902-929f-b42d6ca654ae-kube-api-access-56wz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.572231 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.572088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.572231 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.572110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.572450 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.572431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.572510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.572493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.587094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.587067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wz5\" (UniqueName: \"kubernetes.io/projected/6f26b8c9-9dda-4902-929f-b42d6ca654ae-kube-api-access-56wz5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.682047 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.681949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:25.835163 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:25.835059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"]
Jul 26 15:23:25.837634 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:23:25.837598    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f26b8c9_9dda_4902_929f_b42d6ca654ae.slice/crio-6045279c6abd0e7c97a4d84c2930f7911702e99136ac5ccf924394359ff4f359 WatchSource:0}: Error finding container 6045279c6abd0e7c97a4d84c2930f7911702e99136ac5ccf924394359ff4f359: Status 404 returned error can't find the container with id 6045279c6abd0e7c97a4d84c2930f7911702e99136ac5ccf924394359ff4f359
Jul 26 15:23:26.253848 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:26.253814    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerID="ac9df01a9758bc5c4c54c11bea60f8d96d6f26a513007a7ba4f5cbb6e2f2cce3" exitCode=0
Jul 26 15:23:26.254067 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:26.253913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6" event={"ID":"6f26b8c9-9dda-4902-929f-b42d6ca654ae","Type":"ContainerDied","Data":"ac9df01a9758bc5c4c54c11bea60f8d96d6f26a513007a7ba4f5cbb6e2f2cce3"}
Jul 26 15:23:26.254067 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:26.253981    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6" event={"ID":"6f26b8c9-9dda-4902-929f-b42d6ca654ae","Type":"ContainerStarted","Data":"6045279c6abd0e7c97a4d84c2930f7911702e99136ac5ccf924394359ff4f359"}
Jul 26 15:23:29.269076 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:29.269041    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerID="cc6dd3ae8f0baf61f75b4da131a3ae9a3971800d928a9287e03b90978ce669d9" exitCode=0
Jul 26 15:23:29.269448 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:29.269121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6" event={"ID":"6f26b8c9-9dda-4902-929f-b42d6ca654ae","Type":"ContainerDied","Data":"cc6dd3ae8f0baf61f75b4da131a3ae9a3971800d928a9287e03b90978ce669d9"}
Jul 26 15:23:30.275298 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:30.275268    2561 generic.go:356] "Generic (PLEG): container finished" podID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerID="53453fc6d4ba8e4fcfc44114667ab7127e61eb8d042882f2c68128b7648f1359" exitCode=0
Jul 26 15:23:30.275680 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:30.275312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6" event={"ID":"6f26b8c9-9dda-4902-929f-b42d6ca654ae","Type":"ContainerDied","Data":"53453fc6d4ba8e4fcfc44114667ab7127e61eb8d042882f2c68128b7648f1359"}
Jul 26 15:23:31.395300 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.395280    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:31.410318 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.410290    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-bundle\") pod \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") "
Jul 26 15:23:31.410416 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.410353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-util\") pod \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") "
Jul 26 15:23:31.410489 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.410417    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56wz5\" (UniqueName: \"kubernetes.io/projected/6f26b8c9-9dda-4902-929f-b42d6ca654ae-kube-api-access-56wz5\") pod \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\" (UID: \"6f26b8c9-9dda-4902-929f-b42d6ca654ae\") "
Jul 26 15:23:31.410716 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.410691    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-bundle" (OuterVolumeSpecName: "bundle") pod "6f26b8c9-9dda-4902-929f-b42d6ca654ae" (UID: "6f26b8c9-9dda-4902-929f-b42d6ca654ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:23:31.412462 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.412438    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f26b8c9-9dda-4902-929f-b42d6ca654ae-kube-api-access-56wz5" (OuterVolumeSpecName: "kube-api-access-56wz5") pod "6f26b8c9-9dda-4902-929f-b42d6ca654ae" (UID: "6f26b8c9-9dda-4902-929f-b42d6ca654ae"). InnerVolumeSpecName "kube-api-access-56wz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:23:31.416167 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.416137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-util" (OuterVolumeSpecName: "util") pod "6f26b8c9-9dda-4902-929f-b42d6ca654ae" (UID: "6f26b8c9-9dda-4902-929f-b42d6ca654ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:23:31.511259 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.511222    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:31.511259 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.511254    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56wz5\" (UniqueName: \"kubernetes.io/projected/6f26b8c9-9dda-4902-929f-b42d6ca654ae-kube-api-access-56wz5\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:31.511259 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:31.511266    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f26b8c9-9dda-4902-929f-b42d6ca654ae-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:32.285011 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:32.284977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6" event={"ID":"6f26b8c9-9dda-4902-929f-b42d6ca654ae","Type":"ContainerDied","Data":"6045279c6abd0e7c97a4d84c2930f7911702e99136ac5ccf924394359ff4f359"}
Jul 26 15:23:32.285011 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:32.285000    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqf5n6"
Jul 26 15:23:32.285291 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:32.285023    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6045279c6abd0e7c97a4d84c2930f7911702e99136ac5ccf924394359ff4f359"
Jul 26 15:23:45.838149 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838112    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"]
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838372    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="pull"
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838383    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="pull"
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838396    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="util"
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838414    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="util"
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838427    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="extract"
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838432    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="extract"
Jul 26 15:23:45.838529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.838487    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f26b8c9-9dda-4902-929f-b42d6ca654ae" containerName="extract"
Jul 26 15:23:45.841356 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.841337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:45.844180 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.844157    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 26 15:23:45.845296 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.845263    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j48qz\""
Jul 26 15:23:45.845296 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.845281    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 26 15:23:45.849316 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.849294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"]
Jul 26 15:23:45.908202 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.908152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:45.908202 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.908205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqxzb\" (UniqueName: \"kubernetes.io/projected/3170cc9a-f53a-4614-bc13-fddaafdd1e08-kube-api-access-lqxzb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:45.908425 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:45.908283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.008968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.008897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.009133 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.008986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqxzb\" (UniqueName: \"kubernetes.io/projected/3170cc9a-f53a-4614-bc13-fddaafdd1e08-kube-api-access-lqxzb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.009133 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.009012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.009292 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.009273    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.009325 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.009303    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.017362 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.017330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqxzb\" (UniqueName: \"kubernetes.io/projected/3170cc9a-f53a-4614-bc13-fddaafdd1e08-kube-api-access-lqxzb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.151761 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.151669    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:46.283197 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.283078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"]
Jul 26 15:23:46.285785 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:23:46.285762    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3170cc9a_f53a_4614_bc13_fddaafdd1e08.slice/crio-c05f153facc19675ff530ed7c7627db311fe6a6c89cc02624f595c99a86a98f2 WatchSource:0}: Error finding container c05f153facc19675ff530ed7c7627db311fe6a6c89cc02624f595c99a86a98f2: Status 404 returned error can't find the container with id c05f153facc19675ff530ed7c7627db311fe6a6c89cc02624f595c99a86a98f2
Jul 26 15:23:46.338839 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:46.338814    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd" event={"ID":"3170cc9a-f53a-4614-bc13-fddaafdd1e08","Type":"ContainerStarted","Data":"c05f153facc19675ff530ed7c7627db311fe6a6c89cc02624f595c99a86a98f2"}
Jul 26 15:23:47.343803 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:47.343704    2561 generic.go:356] "Generic (PLEG): container finished" podID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerID="aa7ec1d9f0e1e482258eee5e9a54b532ec28aa1ac3c6f1263aa4bfebed987049" exitCode=0
Jul 26 15:23:47.344279 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:47.343798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd" event={"ID":"3170cc9a-f53a-4614-bc13-fddaafdd1e08","Type":"ContainerDied","Data":"aa7ec1d9f0e1e482258eee5e9a54b532ec28aa1ac3c6f1263aa4bfebed987049"}
Jul 26 15:23:48.349143 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:48.349098    2561 generic.go:356] "Generic (PLEG): container finished" podID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerID="67c76473f9ccdb1f9540184e85587b9e40da060d1073e2a1dd421d6b07bd7b2f" exitCode=0
Jul 26 15:23:48.349529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:48.349190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd" event={"ID":"3170cc9a-f53a-4614-bc13-fddaafdd1e08","Type":"ContainerDied","Data":"67c76473f9ccdb1f9540184e85587b9e40da060d1073e2a1dd421d6b07bd7b2f"}
Jul 26 15:23:49.355266 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:49.355237    2561 generic.go:356] "Generic (PLEG): container finished" podID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerID="b95f83adb1d3332b11ae101ecdf423649e1cd451427389d0446b1a1891c7fcb1" exitCode=0
Jul 26 15:23:49.355663 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:49.355284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd" event={"ID":"3170cc9a-f53a-4614-bc13-fddaafdd1e08","Type":"ContainerDied","Data":"b95f83adb1d3332b11ae101ecdf423649e1cd451427389d0446b1a1891c7fcb1"}
Jul 26 15:23:50.488684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.488652    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:50.545563 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.545522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqxzb\" (UniqueName: \"kubernetes.io/projected/3170cc9a-f53a-4614-bc13-fddaafdd1e08-kube-api-access-lqxzb\") pod \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") "
Jul 26 15:23:50.545563 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.545573    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-bundle\") pod \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") "
Jul 26 15:23:50.545775 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.545612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-util\") pod \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\" (UID: \"3170cc9a-f53a-4614-bc13-fddaafdd1e08\") "
Jul 26 15:23:50.546539 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.546491    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-bundle" (OuterVolumeSpecName: "bundle") pod "3170cc9a-f53a-4614-bc13-fddaafdd1e08" (UID: "3170cc9a-f53a-4614-bc13-fddaafdd1e08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:23:50.547846 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.547810    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3170cc9a-f53a-4614-bc13-fddaafdd1e08-kube-api-access-lqxzb" (OuterVolumeSpecName: "kube-api-access-lqxzb") pod "3170cc9a-f53a-4614-bc13-fddaafdd1e08" (UID: "3170cc9a-f53a-4614-bc13-fddaafdd1e08"). InnerVolumeSpecName "kube-api-access-lqxzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:23:50.551463 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.551438    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-util" (OuterVolumeSpecName: "util") pod "3170cc9a-f53a-4614-bc13-fddaafdd1e08" (UID: "3170cc9a-f53a-4614-bc13-fddaafdd1e08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:23:50.646389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.646291    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqxzb\" (UniqueName: \"kubernetes.io/projected/3170cc9a-f53a-4614-bc13-fddaafdd1e08-kube-api-access-lqxzb\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:50.646389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.646336    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:50.646389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:50.646346    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3170cc9a-f53a-4614-bc13-fddaafdd1e08-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:23:51.365460 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:51.365384    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd"
Jul 26 15:23:51.365606 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:51.365386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6zpwd" event={"ID":"3170cc9a-f53a-4614-bc13-fddaafdd1e08","Type":"ContainerDied","Data":"c05f153facc19675ff530ed7c7627db311fe6a6c89cc02624f595c99a86a98f2"}
Jul 26 15:23:51.365606 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:51.365498    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c05f153facc19675ff530ed7c7627db311fe6a6c89cc02624f595c99a86a98f2"
Jul 26 15:23:57.755017 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.754977    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"]
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755300    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="util"
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755313    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="util"
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755323    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="extract"
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755332    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="extract"
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755352    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="pull"
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755358    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="pull"
Jul 26 15:23:57.755454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.755402    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3170cc9a-f53a-4614-bc13-fddaafdd1e08" containerName="extract"
Jul 26 15:23:57.760958 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.760907    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.763538 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.763503    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2r5n\""
Jul 26 15:23:57.763662 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.763544    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 26 15:23:57.763662 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.763600    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 26 15:23:57.763803 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.763788    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 26 15:23:57.763959 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.763922    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 26 15:23:57.778125 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.778099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"]
Jul 26 15:23:57.801159 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.801128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-tmp\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.801159 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.801163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.801375 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.801194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-868jg\" (UniqueName: \"kubernetes.io/projected/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-kube-api-access-868jg\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.801375 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.801215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-manifests\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.801375 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.801258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.902261 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.902227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.902443 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.902274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-868jg\" (UniqueName: \"kubernetes.io/projected/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-kube-api-access-868jg\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.902443 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.902293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-manifests\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.902443 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.902316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.902443 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.902361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-tmp\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.902824 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.902794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-manifests\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.904743 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.904724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-tmp\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.904976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.904960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.905115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.905096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:57.915278 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:57.915254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-868jg\" (UniqueName: \"kubernetes.io/projected/cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd-kube-api-access-868jg\") pod \"opendatahub-operator-controller-manager-79d786d858-qd2fl\" (UID: \"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd\") " pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:58.071103 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:58.071017    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:23:58.212119 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:58.212044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"]
Jul 26 15:23:58.214708 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:23:58.214676    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe07d6c_5fb0_4258_a8fe_4eda8ab4c5bd.slice/crio-876e62b4b1710236625f5dbf7d2086bd258ca0fcca90d36e6c29c7880fc31d2d WatchSource:0}: Error finding container 876e62b4b1710236625f5dbf7d2086bd258ca0fcca90d36e6c29c7880fc31d2d: Status 404 returned error can't find the container with id 876e62b4b1710236625f5dbf7d2086bd258ca0fcca90d36e6c29c7880fc31d2d
Jul 26 15:23:58.394358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:23:58.394271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl" event={"ID":"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd","Type":"ContainerStarted","Data":"876e62b4b1710236625f5dbf7d2086bd258ca0fcca90d36e6c29c7880fc31d2d"}
Jul 26 15:24:01.409365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:01.409331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl" event={"ID":"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd","Type":"ContainerStarted","Data":"c47bf751f8b11f48592493a0d40782ccc3fb29bd6e02aaaf4dbf8cedc58d0a1a"}
Jul 26 15:24:03.418344 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:03.418310    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd" containerID="c47bf751f8b11f48592493a0d40782ccc3fb29bd6e02aaaf4dbf8cedc58d0a1a" exitCode=0
Jul 26 15:24:03.418794 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:03.418385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl" event={"ID":"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd","Type":"ContainerDied","Data":"c47bf751f8b11f48592493a0d40782ccc3fb29bd6e02aaaf4dbf8cedc58d0a1a"}
Jul 26 15:24:04.423846 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:04.423812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl" event={"ID":"cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd","Type":"ContainerStarted","Data":"23b0ef99e2e74c570cd90cf09608f82aee08d8d54dae2162d3e001a30d29e092"}
Jul 26 15:24:04.424358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:04.424072    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:24:04.445674 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:04.445630    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl" podStartSLOduration=2.912798843 podStartE2EDuration="7.445611451s" totalImagesPullingTime="3.443181915s" totalInitContainerRuntime="1.089630693s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:23:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:04.444086181 +0000 UTC m=+353.805585987" watchObservedRunningTime="2026-07-26 15:24:04.445611451 +0000 UTC m=+353.807111255"
Jul 26 15:24:15.429342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:15.429311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79d786d858-qd2fl"
Jul 26 15:24:17.808825 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.808788    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wrhz6"]
Jul 26 15:24:17.817110 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.817086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:17.819796 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.819770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 26 15:24:17.819952 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.819844    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-28tl5\""
Jul 26 15:24:17.828223 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.828200    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wrhz6"]
Jul 26 15:24:17.961922 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.961882    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvv7v\" (UniqueName: \"kubernetes.io/projected/789931d7-a736-4c27-af1b-efb84411eb5e-kube-api-access-wvv7v\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:17.961922 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:17.961918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789931d7-a736-4c27-af1b-efb84411eb5e-cert\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.063223 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.063133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvv7v\" (UniqueName: \"kubernetes.io/projected/789931d7-a736-4c27-af1b-efb84411eb5e-kube-api-access-wvv7v\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.063223 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.063168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789931d7-a736-4c27-af1b-efb84411eb5e-cert\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.063433 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:24:18.063264    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 26 15:24:18.063433 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:24:18.063328    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/789931d7-a736-4c27-af1b-efb84411eb5e-cert podName:789931d7-a736-4c27-af1b-efb84411eb5e nodeName:}" failed. No retries permitted until 2026-07-26 15:24:18.563310899 +0000 UTC m=+367.924810685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/789931d7-a736-4c27-af1b-efb84411eb5e-cert") pod "odh-model-controller-7998c67dc4-wrhz6" (UID: "789931d7-a736-4c27-af1b-efb84411eb5e") : secret "odh-model-controller-webhook-cert" not found
Jul 26 15:24:18.079704 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.079666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvv7v\" (UniqueName: \"kubernetes.io/projected/789931d7-a736-4c27-af1b-efb84411eb5e-kube-api-access-wvv7v\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.244221 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.244189    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vkzmx"]
Jul 26 15:24:18.247889 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.247864    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.250399 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.250374    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 26 15:24:18.257495 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.257470    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vkzmx"]
Jul 26 15:24:18.366696 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.366612    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/383812c7-37de-4736-8798-6bada7a044aa-tls-certs\") pod \"model-serving-api-54d89bd5fc-vkzmx\" (UID: \"383812c7-37de-4736-8798-6bada7a044aa\") " pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.366696 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.366672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tcc\" (UniqueName: \"kubernetes.io/projected/383812c7-37de-4736-8798-6bada7a044aa-kube-api-access-p9tcc\") pod \"model-serving-api-54d89bd5fc-vkzmx\" (UID: \"383812c7-37de-4736-8798-6bada7a044aa\") " pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.467119 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.467086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tcc\" (UniqueName: \"kubernetes.io/projected/383812c7-37de-4736-8798-6bada7a044aa-kube-api-access-p9tcc\") pod \"model-serving-api-54d89bd5fc-vkzmx\" (UID: \"383812c7-37de-4736-8798-6bada7a044aa\") " pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.467297 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.467203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/383812c7-37de-4736-8798-6bada7a044aa-tls-certs\") pod \"model-serving-api-54d89bd5fc-vkzmx\" (UID: \"383812c7-37de-4736-8798-6bada7a044aa\") " pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.469855 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.469824    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/383812c7-37de-4736-8798-6bada7a044aa-tls-certs\") pod \"model-serving-api-54d89bd5fc-vkzmx\" (UID: \"383812c7-37de-4736-8798-6bada7a044aa\") " pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.477753 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.477727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tcc\" (UniqueName: \"kubernetes.io/projected/383812c7-37de-4736-8798-6bada7a044aa-kube-api-access-p9tcc\") pod \"model-serving-api-54d89bd5fc-vkzmx\" (UID: \"383812c7-37de-4736-8798-6bada7a044aa\") " pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.562872 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.562830    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:18.568330 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.568309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789931d7-a736-4c27-af1b-efb84411eb5e-cert\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.570831 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.570807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/789931d7-a736-4c27-af1b-efb84411eb5e-cert\") pod \"odh-model-controller-7998c67dc4-wrhz6\" (UID: \"789931d7-a736-4c27-af1b-efb84411eb5e\") " pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.698434 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.698409    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vkzmx"]
Jul 26 15:24:18.700882 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:18.700859    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383812c7_37de_4736_8798_6bada7a044aa.slice/crio-5df308e33566e9fc1952f69e1c88b6d9d4a09b6e8ec60d9db307626016563b12 WatchSource:0}: Error finding container 5df308e33566e9fc1952f69e1c88b6d9d4a09b6e8ec60d9db307626016563b12: Status 404 returned error can't find the container with id 5df308e33566e9fc1952f69e1c88b6d9d4a09b6e8ec60d9db307626016563b12
Jul 26 15:24:18.726638 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.726600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:18.870055 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:18.870031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wrhz6"]
Jul 26 15:24:18.872198 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:18.872175    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789931d7_a736_4c27_af1b_efb84411eb5e.slice/crio-f98c7ffa4055921907848c31f6d9d42742137b40d95ac55f3f1454bd018e6dbe WatchSource:0}: Error finding container f98c7ffa4055921907848c31f6d9d42742137b40d95ac55f3f1454bd018e6dbe: Status 404 returned error can't find the container with id f98c7ffa4055921907848c31f6d9d42742137b40d95ac55f3f1454bd018e6dbe
Jul 26 15:24:19.485909 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:19.485867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx" event={"ID":"383812c7-37de-4736-8798-6bada7a044aa","Type":"ContainerStarted","Data":"5df308e33566e9fc1952f69e1c88b6d9d4a09b6e8ec60d9db307626016563b12"}
Jul 26 15:24:19.487356 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:19.487324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6" event={"ID":"789931d7-a736-4c27-af1b-efb84411eb5e","Type":"ContainerStarted","Data":"f98c7ffa4055921907848c31f6d9d42742137b40d95ac55f3f1454bd018e6dbe"}
Jul 26 15:24:20.631356 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.631316    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"]
Jul 26 15:24:20.634798 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.634774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.637727 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.637701    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 26 15:24:20.637845 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.637737    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 26 15:24:20.637845 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.637743    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 26 15:24:20.638831 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.638814    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fmsct\""
Jul 26 15:24:20.638949 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.638817    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 26 15:24:20.642692 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.642532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"]
Jul 26 15:24:20.788181 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.788102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/106ad561-9ff6-4cb6-90e0-efe29e446a38-tmp\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.788352 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.788178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106ad561-9ff6-4cb6-90e0-efe29e446a38-tls-certs\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.788352 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.788229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fvxx\" (UniqueName: \"kubernetes.io/projected/106ad561-9ff6-4cb6-90e0-efe29e446a38-kube-api-access-5fvxx\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.889590 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.889549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106ad561-9ff6-4cb6-90e0-efe29e446a38-tls-certs\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.889776 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.889613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fvxx\" (UniqueName: \"kubernetes.io/projected/106ad561-9ff6-4cb6-90e0-efe29e446a38-kube-api-access-5fvxx\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.889776 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.889659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/106ad561-9ff6-4cb6-90e0-efe29e446a38-tmp\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.892457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.892434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/106ad561-9ff6-4cb6-90e0-efe29e446a38-tmp\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.892570 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.892537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/106ad561-9ff6-4cb6-90e0-efe29e446a38-tls-certs\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.898630 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.898603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fvxx\" (UniqueName: \"kubernetes.io/projected/106ad561-9ff6-4cb6-90e0-efe29e446a38-kube-api-access-5fvxx\") pod \"kube-auth-proxy-6dc54b99bb-mgnn5\" (UID: \"106ad561-9ff6-4cb6-90e0-efe29e446a38\") " pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:20.946604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:20.946567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"
Jul 26 15:24:21.498468 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.498426    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx" event={"ID":"383812c7-37de-4736-8798-6bada7a044aa","Type":"ContainerStarted","Data":"7ff52b20c0f50a8f98c8bbce58e5e217c75923cff613a569bfd5a4f58292fcea"}
Jul 26 15:24:21.498704 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.498581    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:21.521149 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.521100    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx" podStartSLOduration=1.7194305 podStartE2EDuration="3.521080114s" totalImagesPullingTime="1.801649614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:21.518322467 +0000 UTC m=+370.879822271" watchObservedRunningTime="2026-07-26 15:24:21.521080114 +0000 UTC m=+370.882579919"
Jul 26 15:24:21.726810 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.726772    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"]
Jul 26 15:24:21.730403 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.730377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.733024 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.732965    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 26 15:24:21.733024 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.732983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 26 15:24:21.733024 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.732965    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 26 15:24:21.733253 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.733002    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 26 15:24:21.733253 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.733002    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-krrjx\""
Jul 26 15:24:21.740792 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.740758    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"]
Jul 26 15:24:21.796805 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.796719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.796805 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.796751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ltgz\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-kube-api-access-4ltgz\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.796805 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.796792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/432ac587-8590-432d-9df9-a178ee039065-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.797122 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.796819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.797122 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.796910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/432ac587-8590-432d-9df9-a178ee039065-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.797122 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.796974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.797122 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.797009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897408 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/432ac587-8590-432d-9df9-a178ee039065-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897408 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ltgz\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-kube-api-access-4ltgz\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/432ac587-8590-432d-9df9-a178ee039065-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.897648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.897595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.898320 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.898296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/432ac587-8590-432d-9df9-a178ee039065-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.899970 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.899913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.900557 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.900537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.900816 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.900796    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/432ac587-8590-432d-9df9-a178ee039065-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.901532 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.901507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.913942 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.913861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ltgz\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-kube-api-access-4ltgz\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.915013 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.914916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-k2vf7\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:21.997106 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:21.997081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5"]
Jul 26 15:24:21.999196 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:21.999169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106ad561_9ff6_4cb6_90e0_efe29e446a38.slice/crio-98f2b25296e53d8cf694f6ee06676ff00190806594fb2f686c61bcdafded7c72 WatchSource:0}: Error finding container 98f2b25296e53d8cf694f6ee06676ff00190806594fb2f686c61bcdafded7c72: Status 404 returned error can't find the container with id 98f2b25296e53d8cf694f6ee06676ff00190806594fb2f686c61bcdafded7c72
Jul 26 15:24:22.042780 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.042753    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:22.177622 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.177583    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"]
Jul 26 15:24:22.180742 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:22.180709    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432ac587_8590_432d_9df9_a178ee039065.slice/crio-e7a8e25c9dcf30eb94f1731a15633dfe4951f4b9fc66d6328cc1e1d180aeddba WatchSource:0}: Error finding container e7a8e25c9dcf30eb94f1731a15633dfe4951f4b9fc66d6328cc1e1d180aeddba: Status 404 returned error can't find the container with id e7a8e25c9dcf30eb94f1731a15633dfe4951f4b9fc66d6328cc1e1d180aeddba
Jul 26 15:24:22.505893 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.505857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6" event={"ID":"789931d7-a736-4c27-af1b-efb84411eb5e","Type":"ContainerStarted","Data":"f65ac289115402507657076c90cbc2e1bd0880a30da70a4ba5ffb04b6d539be9"}
Jul 26 15:24:22.506101 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.506025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:22.507306 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.507272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5" event={"ID":"106ad561-9ff6-4cb6-90e0-efe29e446a38","Type":"ContainerStarted","Data":"98f2b25296e53d8cf694f6ee06676ff00190806594fb2f686c61bcdafded7c72"}
Jul 26 15:24:22.508778 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.508755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7" event={"ID":"432ac587-8590-432d-9df9-a178ee039065","Type":"ContainerStarted","Data":"e7a8e25c9dcf30eb94f1731a15633dfe4951f4b9fc66d6328cc1e1d180aeddba"}
Jul 26 15:24:22.524496 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:22.524440    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6" podStartSLOduration=2.479223834 podStartE2EDuration="5.524421361s" totalImagesPullingTime="3.045197527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:22.521815369 +0000 UTC m=+371.883315173" watchObservedRunningTime="2026-07-26 15:24:22.524421361 +0000 UTC m=+371.885921166"
Jul 26 15:24:25.023017 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.022984    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:24:25.023286 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.023046    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:24:25.525330 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.525298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5" event={"ID":"106ad561-9ff6-4cb6-90e0-efe29e446a38","Type":"ContainerStarted","Data":"1bdb3904237028433951ca37518b45cb8681bc3138cfb1bb13813ffcc9312d8e"}
Jul 26 15:24:25.527090 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.527058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7" event={"ID":"432ac587-8590-432d-9df9-a178ee039065","Type":"ContainerStarted","Data":"5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17"}
Jul 26 15:24:25.527598 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.527578    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:25.562081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.562021    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6dc54b99bb-mgnn5" podStartSLOduration=2.542878248 podStartE2EDuration="5.56200043s" totalImagesPullingTime="3.019122182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:25.557707009 +0000 UTC m=+374.919206813" watchObservedRunningTime="2026-07-26 15:24:25.56200043 +0000 UTC m=+374.923500236"
Jul 26 15:24:25.611329 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:25.611270    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7" podStartSLOduration=1.7719611830000002 podStartE2EDuration="4.611249487s" totalImagesPullingTime="2.839288304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:25.60885593 +0000 UTC m=+374.970355743" watchObservedRunningTime="2026-07-26 15:24:25.611249487 +0000 UTC m=+374.972749290"
Jul 26 15:24:26.496497 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.496458    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"]
Jul 26 15:24:26.500175 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.500148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.503126 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.503091    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9f7mn\""
Jul 26 15:24:26.515225 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.515200    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"]
Jul 26 15:24:26.532698 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.532673    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:26.639423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639608 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639608 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdxtd\" (UniqueName: \"kubernetes.io/projected/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-kube-api-access-gdxtd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639608 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639949 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.639949 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.639863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdxtd\" (UniqueName: \"kubernetes.io/projected/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-kube-api-access-gdxtd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.740833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.740755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.741151 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.741011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.741151 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.741054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.741247 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.741159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.741247 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.741169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.741247 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.741194    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.741605 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.741583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.743483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.743460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.743791 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.743767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.756737 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.756668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.756893 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.756867    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdxtd\" (UniqueName: \"kubernetes.io/projected/defc65fa-1763-4d63-9e3c-9fdd44fa7bc3-kube-api-access-gdxtd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b\" (UID: \"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.811676 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.811649    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:26.956597 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:26.956564    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"]
Jul 26 15:24:26.960143 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:26.960118    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefc65fa_1763_4d63_9e3c_9fdd44fa7bc3.slice/crio-56a018ec71e1602270caa9211844a5740d2af37ef9ab3e82f70d109f02abfd1e WatchSource:0}: Error finding container 56a018ec71e1602270caa9211844a5740d2af37ef9ab3e82f70d109f02abfd1e: Status 404 returned error can't find the container with id 56a018ec71e1602270caa9211844a5740d2af37ef9ab3e82f70d109f02abfd1e
Jul 26 15:24:27.547915 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:27.547869    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b" event={"ID":"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3","Type":"ContainerStarted","Data":"56a018ec71e1602270caa9211844a5740d2af37ef9ab3e82f70d109f02abfd1e"}
Jul 26 15:24:28.393761 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.393202    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"]
Jul 26 15:24:28.397645 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.397612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.401211 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.401182    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8v8p7\""
Jul 26 15:24:28.401782 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.401715    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 26 15:24:28.404994 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.404972    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"]
Jul 26 15:24:28.408408 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.408385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.411191 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.410986    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 26 15:24:28.411191 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.411007    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rnqjr\""
Jul 26 15:24:28.416669 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.416646    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"]
Jul 26 15:24:28.420713 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.420490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"]
Jul 26 15:24:28.557263 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.557226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5flw\" (UniqueName: \"kubernetes.io/projected/0d53616a-41be-49cf-9663-e5a4f0eca739-kube-api-access-g5flw\") pod \"llmisvc-controller-manager-777c6bd7d5-cm45j\" (UID: \"0d53616a-41be-49cf-9663-e5a4f0eca739\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.557737 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.557282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9fc\" (UniqueName: \"kubernetes.io/projected/05fe37b2-5c3c-414b-9d73-ddee8a68ee28-kube-api-access-mx9fc\") pod \"kserve-controller-manager-d6f4b65b8-qb5kh\" (UID: \"05fe37b2-5c3c-414b-9d73-ddee8a68ee28\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.557737 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.557362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05fe37b2-5c3c-414b-9d73-ddee8a68ee28-cert\") pod \"kserve-controller-manager-d6f4b65b8-qb5kh\" (UID: \"05fe37b2-5c3c-414b-9d73-ddee8a68ee28\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.557737 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.557416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d53616a-41be-49cf-9663-e5a4f0eca739-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm45j\" (UID: \"0d53616a-41be-49cf-9663-e5a4f0eca739\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.658575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.658474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5flw\" (UniqueName: \"kubernetes.io/projected/0d53616a-41be-49cf-9663-e5a4f0eca739-kube-api-access-g5flw\") pod \"llmisvc-controller-manager-777c6bd7d5-cm45j\" (UID: \"0d53616a-41be-49cf-9663-e5a4f0eca739\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.658575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.658557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9fc\" (UniqueName: \"kubernetes.io/projected/05fe37b2-5c3c-414b-9d73-ddee8a68ee28-kube-api-access-mx9fc\") pod \"kserve-controller-manager-d6f4b65b8-qb5kh\" (UID: \"05fe37b2-5c3c-414b-9d73-ddee8a68ee28\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.658824 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.658796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05fe37b2-5c3c-414b-9d73-ddee8a68ee28-cert\") pod \"kserve-controller-manager-d6f4b65b8-qb5kh\" (UID: \"05fe37b2-5c3c-414b-9d73-ddee8a68ee28\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.658911 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.658836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d53616a-41be-49cf-9663-e5a4f0eca739-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm45j\" (UID: \"0d53616a-41be-49cf-9663-e5a4f0eca739\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.661984 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.661962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d53616a-41be-49cf-9663-e5a4f0eca739-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cm45j\" (UID: \"0d53616a-41be-49cf-9663-e5a4f0eca739\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.662104 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.662030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05fe37b2-5c3c-414b-9d73-ddee8a68ee28-cert\") pod \"kserve-controller-manager-d6f4b65b8-qb5kh\" (UID: \"05fe37b2-5c3c-414b-9d73-ddee8a68ee28\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.673022 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.672986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5flw\" (UniqueName: \"kubernetes.io/projected/0d53616a-41be-49cf-9663-e5a4f0eca739-kube-api-access-g5flw\") pod \"llmisvc-controller-manager-777c6bd7d5-cm45j\" (UID: \"0d53616a-41be-49cf-9663-e5a4f0eca739\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:28.681804 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.681781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9fc\" (UniqueName: \"kubernetes.io/projected/05fe37b2-5c3c-414b-9d73-ddee8a68ee28-kube-api-access-mx9fc\") pod \"kserve-controller-manager-d6f4b65b8-qb5kh\" (UID: \"05fe37b2-5c3c-414b-9d73-ddee8a68ee28\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.711494 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.711450    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:28.725475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:28.725450    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:29.515543 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.515510    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"]
Jul 26 15:24:29.568144 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.568103    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7" podUID="432ac587-8590-432d-9df9-a178ee039065" containerName="discovery" containerID="cri-o://5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17" gracePeriod=30
Jul 26 15:24:29.702203 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.702133    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:24:29.702349 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.702238    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:24:29.702349 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.702277    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:24:29.792732 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.792704    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"]
Jul 26 15:24:29.796413 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:29.796378    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fe37b2_5c3c_414b_9d73_ddee8a68ee28.slice/crio-cb024f43d67e2f757bfb3c11ca471fb0f4dbba6266cd4e3aec81c7420975fe20 WatchSource:0}: Error finding container cb024f43d67e2f757bfb3c11ca471fb0f4dbba6266cd4e3aec81c7420975fe20: Status 404 returned error can't find the container with id cb024f43d67e2f757bfb3c11ca471fb0f4dbba6266cd4e3aec81c7420975fe20
Jul 26 15:24:29.852366 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.852341    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:29.969800 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.969755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-csr-dns-cert\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.969818    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-istio-token\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.969852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ltgz\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-kube-api-access-4ltgz\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.969884    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-cacerts\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.969962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/432ac587-8590-432d-9df9-a178ee039065-istio-csr-ca-configmap\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.969992    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/432ac587-8590-432d-9df9-a178ee039065-local-certs\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970081 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.970040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-kubeconfig\") pod \"432ac587-8590-432d-9df9-a178ee039065\" (UID: \"432ac587-8590-432d-9df9-a178ee039065\") "
Jul 26 15:24:29.970615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.970584    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/432ac587-8590-432d-9df9-a178ee039065-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:24:29.972896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.972862    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-kube-api-access-4ltgz" (OuterVolumeSpecName: "kube-api-access-4ltgz") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "kube-api-access-4ltgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:24:29.973023 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.972890    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-istio-token" (OuterVolumeSpecName: "istio-token") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:24:29.973023 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.972972    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:24:29.973131 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.973073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-cacerts" (OuterVolumeSpecName: "cacerts") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:24:29.973203 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.973180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:24:29.973380 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:29.973363    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432ac587-8590-432d-9df9-a178ee039065-local-certs" (OuterVolumeSpecName: "local-certs") pod "432ac587-8590-432d-9df9-a178ee039065" (UID: "432ac587-8590-432d-9df9-a178ee039065"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:24:30.008065 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.008040    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"]
Jul 26 15:24:30.010389 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:24:30.010351    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d53616a_41be_49cf_9663_e5a4f0eca739.slice/crio-3dcd779e8505549726bae2860150dbb7561cea8a91424d4db0c03839eb3a720a WatchSource:0}: Error finding container 3dcd779e8505549726bae2860150dbb7561cea8a91424d4db0c03839eb3a720a: Status 404 returned error can't find the container with id 3dcd779e8505549726bae2860150dbb7561cea8a91424d4db0c03839eb3a720a
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070622    2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-kubeconfig\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070647    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-istio-csr-dns-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070656    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-istio-token\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070667    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ltgz\" (UniqueName: \"kubernetes.io/projected/432ac587-8590-432d-9df9-a178ee039065-kube-api-access-4ltgz\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070677    2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/432ac587-8590-432d-9df9-a178ee039065-cacerts\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070685    2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/432ac587-8590-432d-9df9-a178ee039065-istio-csr-ca-configmap\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.070705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.070693    2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/432ac587-8590-432d-9df9-a178ee039065-local-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:24:30.574550 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.574510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh" event={"ID":"05fe37b2-5c3c-414b-9d73-ddee8a68ee28","Type":"ContainerStarted","Data":"cb024f43d67e2f757bfb3c11ca471fb0f4dbba6266cd4e3aec81c7420975fe20"}
Jul 26 15:24:30.576101 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.576069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j" event={"ID":"0d53616a-41be-49cf-9663-e5a4f0eca739","Type":"ContainerStarted","Data":"3dcd779e8505549726bae2860150dbb7561cea8a91424d4db0c03839eb3a720a"}
Jul 26 15:24:30.578116 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.578093    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"
Jul 26 15:24:30.578222 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.578126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7" event={"ID":"432ac587-8590-432d-9df9-a178ee039065","Type":"ContainerDied","Data":"5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17"}
Jul 26 15:24:30.578222 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.578185    2561 scope.go:117] "RemoveContainer" containerID="5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17"
Jul 26 15:24:30.579613 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.578029    2561 generic.go:356] "Generic (PLEG): container finished" podID="432ac587-8590-432d-9df9-a178ee039065" containerID="5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17" exitCode=0
Jul 26 15:24:30.579733 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.579695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7" event={"ID":"432ac587-8590-432d-9df9-a178ee039065","Type":"ContainerDied","Data":"e7a8e25c9dcf30eb94f1731a15633dfe4951f4b9fc66d6328cc1e1d180aeddba"}
Jul 26 15:24:30.582882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.582811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b" event={"ID":"defc65fa-1763-4d63-9e3c-9fdd44fa7bc3","Type":"ContainerStarted","Data":"2c9d5154c04dde7e980bda9a15f4ab645e3e94dd08f18d2e775aa332bf6cd4f2"}
Jul 26 15:24:30.591529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.591504    2561 scope.go:117] "RemoveContainer" containerID="5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17"
Jul 26 15:24:30.591879 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:24:30.591835    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17\": container with ID starting with 5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17 not found: ID does not exist" containerID="5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17"
Jul 26 15:24:30.591981 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.591892    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17"} err="failed to get container status \"5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17\": rpc error: code = NotFound desc = could not find container \"5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17\": container with ID starting with 5ebcdee9b1e91e6be3168125341f990e13ad3ec15ccbb8dd72d443a12d7cfe17 not found: ID does not exist"
Jul 26 15:24:30.608356 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.608284    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b" podStartSLOduration=1.869051315 podStartE2EDuration="4.608261178s" totalImagesPullingTime="2.739209863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:30.607431694 +0000 UTC m=+379.968931498" watchObservedRunningTime="2026-07-26 15:24:30.608261178 +0000 UTC m=+379.969760983"
Jul 26 15:24:30.626032 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.625984    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"]
Jul 26 15:24:30.627991 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.627961    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k2vf7"]
Jul 26 15:24:30.812500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.812418    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:30.818780 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:30.818745    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:31.105257 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:31.105228    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432ac587-8590-432d-9df9-a178ee039065" path="/var/lib/kubelet/pods/432ac587-8590-432d-9df9-a178ee039065/volumes"
Jul 26 15:24:31.588943 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:31.588901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:31.590265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:31.590239    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b"
Jul 26 15:24:32.514623 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:32.514591    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vkzmx"
Jul 26 15:24:33.516767 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:33.516739    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wrhz6"
Jul 26 15:24:33.599415 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:33.599378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh" event={"ID":"05fe37b2-5c3c-414b-9d73-ddee8a68ee28","Type":"ContainerStarted","Data":"e003849bfd9a090000080a21e70d81f5311b290d717fe8791569544e34e5bbf5"}
Jul 26 15:24:33.614283 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:33.614205    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh" podStartSLOduration=3.009380087 podStartE2EDuration="5.614186956s" totalImagesPullingTime="2.604806869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:33.613840657 +0000 UTC m=+382.975340475" watchObservedRunningTime="2026-07-26 15:24:33.614186956 +0000 UTC m=+382.975686760"
Jul 26 15:24:34.605702 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:34.605666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j" event={"ID":"0d53616a-41be-49cf-9663-e5a4f0eca739","Type":"ContainerStarted","Data":"24b0eaded6bfc4b54ea7f5ac162b99bb4cb7b907c0328939a889904482ed1e70"}
Jul 26 15:24:34.606147 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:34.605751    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:24:34.606147 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:34.605876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:24:34.622604 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:24:34.622551    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j" podStartSLOduration=3.125575119 podStartE2EDuration="6.62253524s" totalImagesPullingTime="3.496960121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:24:34.622049429 +0000 UTC m=+383.983549227" watchObservedRunningTime="2026-07-26 15:24:34.62253524 +0000 UTC m=+383.984035043"
Jul 26 15:25:05.612320 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:05.612290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cm45j"
Jul 26 15:25:05.615163 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:05.615139    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qb5kh"
Jul 26 15:25:18.711880 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.711845    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t5tk5"]
Jul 26 15:25:18.712299 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.712170    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432ac587-8590-432d-9df9-a178ee039065" containerName="discovery"
Jul 26 15:25:18.712299 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.712185    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="432ac587-8590-432d-9df9-a178ee039065" containerName="discovery"
Jul 26 15:25:18.712299 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.712284    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="432ac587-8590-432d-9df9-a178ee039065" containerName="discovery"
Jul 26 15:25:18.715901 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.715877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:18.718635 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.718442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-kpvkm\""
Jul 26 15:25:18.718635 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.718554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 26 15:25:18.718635 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.718609    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 26 15:25:18.724510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.724487    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t5tk5"]
Jul 26 15:25:18.760625 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.760589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xmjn\" (UniqueName: \"kubernetes.io/projected/7717316f-017d-4127-90d5-da5c178fe1af-kube-api-access-9xmjn\") pod \"kuadrant-operator-catalog-t5tk5\" (UID: \"7717316f-017d-4127-90d5-da5c178fe1af\") " pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:18.862126 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.862083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xmjn\" (UniqueName: \"kubernetes.io/projected/7717316f-017d-4127-90d5-da5c178fe1af-kube-api-access-9xmjn\") pod \"kuadrant-operator-catalog-t5tk5\" (UID: \"7717316f-017d-4127-90d5-da5c178fe1af\") " pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:18.870821 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:18.870783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xmjn\" (UniqueName: \"kubernetes.io/projected/7717316f-017d-4127-90d5-da5c178fe1af-kube-api-access-9xmjn\") pod \"kuadrant-operator-catalog-t5tk5\" (UID: \"7717316f-017d-4127-90d5-da5c178fe1af\") " pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:19.027520 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.027480    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:19.093798 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.093731    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t5tk5"]
Jul 26 15:25:19.169835 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.169809    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t5tk5"]
Jul 26 15:25:19.171855 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:19.171827    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7717316f_017d_4127_90d5_da5c178fe1af.slice/crio-adf0bc4b37d2b1052aa2480474d3bffdbe90ba21bffc31da2847538db4c029c7 WatchSource:0}: Error finding container adf0bc4b37d2b1052aa2480474d3bffdbe90ba21bffc31da2847538db4c029c7: Status 404 returned error can't find the container with id adf0bc4b37d2b1052aa2480474d3bffdbe90ba21bffc31da2847538db4c029c7
Jul 26 15:25:19.297696 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.297617    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kjdz5"]
Jul 26 15:25:19.300641 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.300623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:19.309677 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.309641    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kjdz5"]
Jul 26 15:25:19.367218 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.367175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvv7b\" (UniqueName: \"kubernetes.io/projected/c0b898cb-99ff-41d8-968e-b44e81b0aad1-kube-api-access-xvv7b\") pod \"kuadrant-operator-catalog-kjdz5\" (UID: \"c0b898cb-99ff-41d8-968e-b44e81b0aad1\") " pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:19.468601 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.468565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvv7b\" (UniqueName: \"kubernetes.io/projected/c0b898cb-99ff-41d8-968e-b44e81b0aad1-kube-api-access-xvv7b\") pod \"kuadrant-operator-catalog-kjdz5\" (UID: \"c0b898cb-99ff-41d8-968e-b44e81b0aad1\") " pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:19.477422 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.477393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvv7b\" (UniqueName: \"kubernetes.io/projected/c0b898cb-99ff-41d8-968e-b44e81b0aad1-kube-api-access-xvv7b\") pod \"kuadrant-operator-catalog-kjdz5\" (UID: \"c0b898cb-99ff-41d8-968e-b44e81b0aad1\") " pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:19.616187 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.616105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:19.807064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.804815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5" event={"ID":"7717316f-017d-4127-90d5-da5c178fe1af","Type":"ContainerStarted","Data":"adf0bc4b37d2b1052aa2480474d3bffdbe90ba21bffc31da2847538db4c029c7"}
Jul 26 15:25:19.841854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:19.841824    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kjdz5"]
Jul 26 15:25:19.896628 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:19.896556    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b898cb_99ff_41d8_968e_b44e81b0aad1.slice/crio-5f7466427a8da2bc9e6e0e61ac52cf3aab6d3595e2b3563f9795473867e40f21 WatchSource:0}: Error finding container 5f7466427a8da2bc9e6e0e61ac52cf3aab6d3595e2b3563f9795473867e40f21: Status 404 returned error can't find the container with id 5f7466427a8da2bc9e6e0e61ac52cf3aab6d3595e2b3563f9795473867e40f21
Jul 26 15:25:20.813844 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:20.813797    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5" event={"ID":"c0b898cb-99ff-41d8-968e-b44e81b0aad1","Type":"ContainerStarted","Data":"5f7466427a8da2bc9e6e0e61ac52cf3aab6d3595e2b3563f9795473867e40f21"}
Jul 26 15:25:21.819997 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:21.819922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5" event={"ID":"c0b898cb-99ff-41d8-968e-b44e81b0aad1","Type":"ContainerStarted","Data":"a374757069a2b902d8ca037bb8d84ff907cb94b66498a6bc27b18d0afc04f29f"}
Jul 26 15:25:21.821458 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:21.821432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5" event={"ID":"7717316f-017d-4127-90d5-da5c178fe1af","Type":"ContainerStarted","Data":"c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c"}
Jul 26 15:25:21.821594 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:21.821488    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5" podUID="7717316f-017d-4127-90d5-da5c178fe1af" containerName="registry-server" containerID="cri-o://c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c" gracePeriod=2
Jul 26 15:25:21.838798 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:21.838747    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5" podStartSLOduration=1.724876922 podStartE2EDuration="2.838729202s" totalImagesPullingTime="1.11385228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:25:21.837375296 +0000 UTC m=+431.198875102" watchObservedRunningTime="2026-07-26 15:25:21.838729202 +0000 UTC m=+431.200228997"
Jul 26 15:25:21.853730 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:21.853676    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5" podStartSLOduration=2.015825117 podStartE2EDuration="3.853661619s" totalImagesPullingTime="1.837836502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:25:21.852218337 +0000 UTC m=+431.213718141" watchObservedRunningTime="2026-07-26 15:25:21.853661619 +0000 UTC m=+431.215161423"
Jul 26 15:25:22.065674 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.065648    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:22.191214 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.191132    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xmjn\" (UniqueName: \"kubernetes.io/projected/7717316f-017d-4127-90d5-da5c178fe1af-kube-api-access-9xmjn\") pod \"7717316f-017d-4127-90d5-da5c178fe1af\" (UID: \"7717316f-017d-4127-90d5-da5c178fe1af\") "
Jul 26 15:25:22.193543 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.193507    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7717316f-017d-4127-90d5-da5c178fe1af-kube-api-access-9xmjn" (OuterVolumeSpecName: "kube-api-access-9xmjn") pod "7717316f-017d-4127-90d5-da5c178fe1af" (UID: "7717316f-017d-4127-90d5-da5c178fe1af"). InnerVolumeSpecName "kube-api-access-9xmjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:25:22.292149 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.292109    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xmjn\" (UniqueName: \"kubernetes.io/projected/7717316f-017d-4127-90d5-da5c178fe1af-kube-api-access-9xmjn\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:22.827033 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.827001    2561 generic.go:356] "Generic (PLEG): container finished" podID="7717316f-017d-4127-90d5-da5c178fe1af" containerID="c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c" exitCode=0
Jul 26 15:25:22.827536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.827045    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5"
Jul 26 15:25:22.827536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.827098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5" event={"ID":"7717316f-017d-4127-90d5-da5c178fe1af","Type":"ContainerDied","Data":"c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c"}
Jul 26 15:25:22.827536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.827164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t5tk5" event={"ID":"7717316f-017d-4127-90d5-da5c178fe1af","Type":"ContainerDied","Data":"adf0bc4b37d2b1052aa2480474d3bffdbe90ba21bffc31da2847538db4c029c7"}
Jul 26 15:25:22.827536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.827199    2561 scope.go:117] "RemoveContainer" containerID="c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c"
Jul 26 15:25:22.837095 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.837074    2561 scope.go:117] "RemoveContainer" containerID="c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c"
Jul 26 15:25:22.837382 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:25:22.837354    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c\": container with ID starting with c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c not found: ID does not exist" containerID="c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c"
Jul 26 15:25:22.837434 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.837392    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c"} err="failed to get container status \"c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c\": rpc error: code = NotFound desc = could not find container \"c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c\": container with ID starting with c82059b4afce39768ee9e5b3720d8c1d2cb6e3ba97b9657e6e27fdda720a253c not found: ID does not exist"
Jul 26 15:25:22.848076 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.848054    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t5tk5"]
Jul 26 15:25:22.852486 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:22.852465    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t5tk5"]
Jul 26 15:25:23.103565 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:23.103486    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7717316f-017d-4127-90d5-da5c178fe1af" path="/var/lib/kubelet/pods/7717316f-017d-4127-90d5-da5c178fe1af/volumes"
Jul 26 15:25:29.616619 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:29.616583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:29.617047 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:29.616647    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:29.638570 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:29.638525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:29.881041 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:29.880970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kjdz5"
Jul 26 15:25:34.328078 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.328038    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"]
Jul 26 15:25:34.328465 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.328359    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7717316f-017d-4127-90d5-da5c178fe1af" containerName="registry-server"
Jul 26 15:25:34.328465 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.328370    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7717316f-017d-4127-90d5-da5c178fe1af" containerName="registry-server"
Jul 26 15:25:34.328465 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.328422    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7717316f-017d-4127-90d5-da5c178fe1af" containerName="registry-server"
Jul 26 15:25:34.331591 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.331572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.334108 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.334082    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d546b\""
Jul 26 15:25:34.340438 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.340413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"]
Jul 26 15:25:34.382791 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.382756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.382791 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.382798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.383048 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.382886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6qv\" (UniqueName: \"kubernetes.io/projected/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-kube-api-access-7d6qv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.484164 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.484125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.484164 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.484167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.484385 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.484217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6qv\" (UniqueName: \"kubernetes.io/projected/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-kube-api-access-7d6qv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.484550 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.484520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.484588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.484545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.492691 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.492651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6qv\" (UniqueName: \"kubernetes.io/projected/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-kube-api-access-7d6qv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.641416 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.641317    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:34.788000 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.787955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"]
Jul 26 15:25:34.789745 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:34.789709    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ea645c_3d3a_4676_b2bf_fb0b1ba82dbf.slice/crio-5fcd8ee28c276d4a9e547a33454fde8ff0c96fc26b025a12c6b582eb83304fa8 WatchSource:0}: Error finding container 5fcd8ee28c276d4a9e547a33454fde8ff0c96fc26b025a12c6b582eb83304fa8: Status 404 returned error can't find the container with id 5fcd8ee28c276d4a9e547a33454fde8ff0c96fc26b025a12c6b582eb83304fa8
Jul 26 15:25:34.882976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.882909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c" event={"ID":"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf","Type":"ContainerStarted","Data":"e10cd7239ed8617022ff2a7bb390c7df00bc2a4f404d74651ece77461a956bda"}
Jul 26 15:25:34.883142 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:34.883000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c" event={"ID":"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf","Type":"ContainerStarted","Data":"5fcd8ee28c276d4a9e547a33454fde8ff0c96fc26b025a12c6b582eb83304fa8"}
Jul 26 15:25:35.130329 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.130298    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"]
Jul 26 15:25:35.133676 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.133658    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.142617 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.142581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"]
Jul 26 15:25:35.190500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.190401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.190500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.190451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mqd\" (UniqueName: \"kubernetes.io/projected/d33db239-2d88-4203-90bc-bf347e3a7286-kube-api-access-87mqd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.190500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.190477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.291232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.291191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.291423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.291256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mqd\" (UniqueName: \"kubernetes.io/projected/d33db239-2d88-4203-90bc-bf347e3a7286-kube-api-access-87mqd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.291423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.291294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.291571 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.291551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.291697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.291678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.299278 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.299253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mqd\" (UniqueName: \"kubernetes.io/projected/d33db239-2d88-4203-90bc-bf347e3a7286-kube-api-access-87mqd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.443594 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.443515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:35.576772 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.576745    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"]
Jul 26 15:25:35.578276 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:35.578251    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33db239_2d88_4203_90bc_bf347e3a7286.slice/crio-fdeb6ee139e9c36a0c928614f7af186511e0673790e4a08d256ff0f18e0f7bd2 WatchSource:0}: Error finding container fdeb6ee139e9c36a0c928614f7af186511e0673790e4a08d256ff0f18e0f7bd2: Status 404 returned error can't find the container with id fdeb6ee139e9c36a0c928614f7af186511e0673790e4a08d256ff0f18e0f7bd2
Jul 26 15:25:35.732160 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.732085    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"]
Jul 26 15:25:35.735521 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.735506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.743756 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.743734    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"]
Jul 26 15:25:35.795510 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.795466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhkcz\" (UniqueName: \"kubernetes.io/projected/5c8b9ca6-5a35-407e-afc5-3346fafe9495-kube-api-access-zhkcz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.795701 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.795530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.795701 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.795570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.889319 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.889284    2561 generic.go:356] "Generic (PLEG): container finished" podID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerID="e10cd7239ed8617022ff2a7bb390c7df00bc2a4f404d74651ece77461a956bda" exitCode=0
Jul 26 15:25:35.889469 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.889371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c" event={"ID":"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf","Type":"ContainerDied","Data":"e10cd7239ed8617022ff2a7bb390c7df00bc2a4f404d74651ece77461a956bda"}
Jul 26 15:25:35.891014 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.890993    2561 generic.go:356] "Generic (PLEG): container finished" podID="d33db239-2d88-4203-90bc-bf347e3a7286" containerID="b0df572da4f00b0ce3546155b83040539876bb51ba5ec6b19702e4b2e535a2a1" exitCode=0
Jul 26 15:25:35.891128 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.891050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v" event={"ID":"d33db239-2d88-4203-90bc-bf347e3a7286","Type":"ContainerDied","Data":"b0df572da4f00b0ce3546155b83040539876bb51ba5ec6b19702e4b2e535a2a1"}
Jul 26 15:25:35.891128 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.891102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v" event={"ID":"d33db239-2d88-4203-90bc-bf347e3a7286","Type":"ContainerStarted","Data":"fdeb6ee139e9c36a0c928614f7af186511e0673790e4a08d256ff0f18e0f7bd2"}
Jul 26 15:25:35.896327 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.896306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.896427 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.896339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.896427 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.896405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhkcz\" (UniqueName: \"kubernetes.io/projected/5c8b9ca6-5a35-407e-afc5-3346fafe9495-kube-api-access-zhkcz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.896747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.896726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.896747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.896745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:35.904018 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:35.903993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhkcz\" (UniqueName: \"kubernetes.io/projected/5c8b9ca6-5a35-407e-afc5-3346fafe9495-kube-api-access-zhkcz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:36.044890 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.044855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:36.127675 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.127269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"]
Jul 26 15:25:36.132522 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.132492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.140037 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.140009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"]
Jul 26 15:25:36.183318 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.183295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"]
Jul 26 15:25:36.185193 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:36.185165    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8b9ca6_5a35_407e_afc5_3346fafe9495.slice/crio-d647c3aa9e9cab36007f1ae28fb66e4006949a48d1338be602c9af4235a17507 WatchSource:0}: Error finding container d647c3aa9e9cab36007f1ae28fb66e4006949a48d1338be602c9af4235a17507: Status 404 returned error can't find the container with id d647c3aa9e9cab36007f1ae28fb66e4006949a48d1338be602c9af4235a17507
Jul 26 15:25:36.199651 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.199620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.199745 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.199714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.199807 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.199746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnsmk\" (UniqueName: \"kubernetes.io/projected/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-kube-api-access-mnsmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.300719 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.300636    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.300719 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.300686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnsmk\" (UniqueName: \"kubernetes.io/projected/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-kube-api-access-mnsmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.300719 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.300716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.301033 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.301016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.301078 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.301063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.309684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.309655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnsmk\" (UniqueName: \"kubernetes.io/projected/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-kube-api-access-mnsmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.446692 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.446428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:36.598986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.598960    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"]
Jul 26 15:25:36.664835 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:36.664798    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590a23f7_6fac_4b89_a6b7_3ff87ee98e84.slice/crio-a3e999601bfac1a5ee04c5d21ef6590021f83462d01ec4c760acab68ec6017c2 WatchSource:0}: Error finding container a3e999601bfac1a5ee04c5d21ef6590021f83462d01ec4c760acab68ec6017c2: Status 404 returned error can't find the container with id a3e999601bfac1a5ee04c5d21ef6590021f83462d01ec4c760acab68ec6017c2
Jul 26 15:25:36.897859 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.897821    2561 generic.go:356] "Generic (PLEG): container finished" podID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerID="e5909bfae63681c5f999adebfc599f01ed9fc5710f7718f90502e837d95b9b7b" exitCode=0
Jul 26 15:25:36.898063 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.897876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58" event={"ID":"5c8b9ca6-5a35-407e-afc5-3346fafe9495","Type":"ContainerDied","Data":"e5909bfae63681c5f999adebfc599f01ed9fc5710f7718f90502e837d95b9b7b"}
Jul 26 15:25:36.898063 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.897947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58" event={"ID":"5c8b9ca6-5a35-407e-afc5-3346fafe9495","Type":"ContainerStarted","Data":"d647c3aa9e9cab36007f1ae28fb66e4006949a48d1338be602c9af4235a17507"}
Jul 26 15:25:36.899991 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.899963    2561 generic.go:356] "Generic (PLEG): container finished" podID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerID="6cef2d48bb7b11152146a36d0e611c3b5ae7bf9863f21af1e4e928e2f3424554" exitCode=0
Jul 26 15:25:36.900101 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.900058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c" event={"ID":"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf","Type":"ContainerDied","Data":"6cef2d48bb7b11152146a36d0e611c3b5ae7bf9863f21af1e4e928e2f3424554"}
Jul 26 15:25:36.902050 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.901983    2561 generic.go:356] "Generic (PLEG): container finished" podID="d33db239-2d88-4203-90bc-bf347e3a7286" containerID="44b489c432b7d75d33cf8f1bef2ba8e56798cd4b58f6f84329ca36b290e0b172" exitCode=0
Jul 26 15:25:36.902167 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.902067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v" event={"ID":"d33db239-2d88-4203-90bc-bf347e3a7286","Type":"ContainerDied","Data":"44b489c432b7d75d33cf8f1bef2ba8e56798cd4b58f6f84329ca36b290e0b172"}
Jul 26 15:25:36.903612 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.903593    2561 generic.go:356] "Generic (PLEG): container finished" podID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerID="65d26debb9cb837292752a7106c81e3490a071c0412da2a923014f125d0dd8ab" exitCode=0
Jul 26 15:25:36.903706 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.903632    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv" event={"ID":"590a23f7-6fac-4b89-a6b7-3ff87ee98e84","Type":"ContainerDied","Data":"65d26debb9cb837292752a7106c81e3490a071c0412da2a923014f125d0dd8ab"}
Jul 26 15:25:36.903706 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:36.903665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv" event={"ID":"590a23f7-6fac-4b89-a6b7-3ff87ee98e84","Type":"ContainerStarted","Data":"a3e999601bfac1a5ee04c5d21ef6590021f83462d01ec4c760acab68ec6017c2"}
Jul 26 15:25:37.910453 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.910420    2561 generic.go:356] "Generic (PLEG): container finished" podID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerID="4fbbb8b3dbe0f036ef89f7f05b07ae4d069792af7d40688d0a9d9176e4ae1ef4" exitCode=0
Jul 26 15:25:37.910889 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.910503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c" event={"ID":"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf","Type":"ContainerDied","Data":"4fbbb8b3dbe0f036ef89f7f05b07ae4d069792af7d40688d0a9d9176e4ae1ef4"}
Jul 26 15:25:37.912606 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.912584    2561 generic.go:356] "Generic (PLEG): container finished" podID="d33db239-2d88-4203-90bc-bf347e3a7286" containerID="8b4b97d687a10ed63e95d473dd548b0a5f87dbf1cd3bcc0a80b0443bd423082a" exitCode=0
Jul 26 15:25:37.912741 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.912648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v" event={"ID":"d33db239-2d88-4203-90bc-bf347e3a7286","Type":"ContainerDied","Data":"8b4b97d687a10ed63e95d473dd548b0a5f87dbf1cd3bcc0a80b0443bd423082a"}
Jul 26 15:25:37.914684 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.914662    2561 generic.go:356] "Generic (PLEG): container finished" podID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerID="2a09554fde4fdf0d8c6ac57988fa6cbd709927680ffb52e943c759463a1c3d7f" exitCode=0
Jul 26 15:25:37.914819 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.914754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv" event={"ID":"590a23f7-6fac-4b89-a6b7-3ff87ee98e84","Type":"ContainerDied","Data":"2a09554fde4fdf0d8c6ac57988fa6cbd709927680ffb52e943c759463a1c3d7f"}
Jul 26 15:25:37.916636 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.916618    2561 generic.go:356] "Generic (PLEG): container finished" podID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerID="8aa97330d09729514293b7b80b16d57ecc3ab9871255647d8dc82ead0b86aa1a" exitCode=0
Jul 26 15:25:37.916730 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:37.916663    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58" event={"ID":"5c8b9ca6-5a35-407e-afc5-3346fafe9495","Type":"ContainerDied","Data":"8aa97330d09729514293b7b80b16d57ecc3ab9871255647d8dc82ead0b86aa1a"}
Jul 26 15:25:38.923988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:38.923956    2561 generic.go:356] "Generic (PLEG): container finished" podID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerID="978a72a8d2f4cfa797243e3f1b93faa02a038dbdc785566eab11764faf574064" exitCode=0
Jul 26 15:25:38.924357 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:38.924031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv" event={"ID":"590a23f7-6fac-4b89-a6b7-3ff87ee98e84","Type":"ContainerDied","Data":"978a72a8d2f4cfa797243e3f1b93faa02a038dbdc785566eab11764faf574064"}
Jul 26 15:25:38.926056 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:38.926032    2561 generic.go:356] "Generic (PLEG): container finished" podID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerID="65e3f570ca5dd18a3dc47578cf265130fbcf2820b52277166428dcb44e215f8d" exitCode=0
Jul 26 15:25:38.926187 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:38.926109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58" event={"ID":"5c8b9ca6-5a35-407e-afc5-3346fafe9495","Type":"ContainerDied","Data":"65e3f570ca5dd18a3dc47578cf265130fbcf2820b52277166428dcb44e215f8d"}
Jul 26 15:25:39.058393 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.058366    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:39.083945 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.083906    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:39.124363 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.124330    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d6qv\" (UniqueName: \"kubernetes.io/projected/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-kube-api-access-7d6qv\") pod \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") "
Jul 26 15:25:39.124517 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.124395    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-bundle\") pod \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") "
Jul 26 15:25:39.124517 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.124472    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-util\") pod \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\" (UID: \"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf\") "
Jul 26 15:25:39.124865 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.124843    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-bundle" (OuterVolumeSpecName: "bundle") pod "61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" (UID: "61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:39.126673 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.126650    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-kube-api-access-7d6qv" (OuterVolumeSpecName: "kube-api-access-7d6qv") pod "61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" (UID: "61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf"). InnerVolumeSpecName "kube-api-access-7d6qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:25:39.130062 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.130035    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-util" (OuterVolumeSpecName: "util") pod "61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" (UID: "61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:39.225302 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-util\") pod \"d33db239-2d88-4203-90bc-bf347e3a7286\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") "
Jul 26 15:25:39.225302 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225254    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-bundle\") pod \"d33db239-2d88-4203-90bc-bf347e3a7286\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") "
Jul 26 15:25:39.225491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225328    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87mqd\" (UniqueName: \"kubernetes.io/projected/d33db239-2d88-4203-90bc-bf347e3a7286-kube-api-access-87mqd\") pod \"d33db239-2d88-4203-90bc-bf347e3a7286\" (UID: \"d33db239-2d88-4203-90bc-bf347e3a7286\") "
Jul 26 15:25:39.225491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225466    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:39.225491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225476    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d6qv\" (UniqueName: \"kubernetes.io/projected/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-kube-api-access-7d6qv\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:39.225491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225485    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:39.225872 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.225845    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-bundle" (OuterVolumeSpecName: "bundle") pod "d33db239-2d88-4203-90bc-bf347e3a7286" (UID: "d33db239-2d88-4203-90bc-bf347e3a7286"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:39.227573 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.227551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d33db239-2d88-4203-90bc-bf347e3a7286-kube-api-access-87mqd" (OuterVolumeSpecName: "kube-api-access-87mqd") pod "d33db239-2d88-4203-90bc-bf347e3a7286" (UID: "d33db239-2d88-4203-90bc-bf347e3a7286"). InnerVolumeSpecName "kube-api-access-87mqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:25:39.230709 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.230690    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-util" (OuterVolumeSpecName: "util") pod "d33db239-2d88-4203-90bc-bf347e3a7286" (UID: "d33db239-2d88-4203-90bc-bf347e3a7286"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:39.326534 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.326493    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87mqd\" (UniqueName: \"kubernetes.io/projected/d33db239-2d88-4203-90bc-bf347e3a7286-kube-api-access-87mqd\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:39.326534 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.326526    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:39.326534 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.326544    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33db239-2d88-4203-90bc-bf347e3a7286-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:39.932799 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.932721    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c"
Jul 26 15:25:39.932799 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.932745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c" event={"ID":"61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf","Type":"ContainerDied","Data":"5fcd8ee28c276d4a9e547a33454fde8ff0c96fc26b025a12c6b582eb83304fa8"}
Jul 26 15:25:39.933268 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.932800    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fcd8ee28c276d4a9e547a33454fde8ff0c96fc26b025a12c6b582eb83304fa8"
Jul 26 15:25:39.934733 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.934714    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v"
Jul 26 15:25:39.934831 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.934747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v" event={"ID":"d33db239-2d88-4203-90bc-bf347e3a7286","Type":"ContainerDied","Data":"fdeb6ee139e9c36a0c928614f7af186511e0673790e4a08d256ff0f18e0f7bd2"}
Jul 26 15:25:39.934831 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:39.934789    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdeb6ee139e9c36a0c928614f7af186511e0673790e4a08d256ff0f18e0f7bd2"
Jul 26 15:25:40.064278 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.064255    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:40.097984 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.097958    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:40.132723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.132698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-util\") pod \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") "
Jul 26 15:25:40.132895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.132740    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhkcz\" (UniqueName: \"kubernetes.io/projected/5c8b9ca6-5a35-407e-afc5-3346fafe9495-kube-api-access-zhkcz\") pod \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") "
Jul 26 15:25:40.132895 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.132809    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-bundle\") pod \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\" (UID: \"5c8b9ca6-5a35-407e-afc5-3346fafe9495\") "
Jul 26 15:25:40.133317 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.133283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-bundle" (OuterVolumeSpecName: "bundle") pod "5c8b9ca6-5a35-407e-afc5-3346fafe9495" (UID: "5c8b9ca6-5a35-407e-afc5-3346fafe9495"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:40.135155 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.135132    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c8b9ca6-5a35-407e-afc5-3346fafe9495-kube-api-access-zhkcz" (OuterVolumeSpecName: "kube-api-access-zhkcz") pod "5c8b9ca6-5a35-407e-afc5-3346fafe9495" (UID: "5c8b9ca6-5a35-407e-afc5-3346fafe9495"). InnerVolumeSpecName "kube-api-access-zhkcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:25:40.138176 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.138151    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-util" (OuterVolumeSpecName: "util") pod "5c8b9ca6-5a35-407e-afc5-3346fafe9495" (UID: "5c8b9ca6-5a35-407e-afc5-3346fafe9495"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:40.234172 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-util\") pod \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") "
Jul 26 15:25:40.234172 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234140    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnsmk\" (UniqueName: \"kubernetes.io/projected/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-kube-api-access-mnsmk\") pod \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") "
Jul 26 15:25:40.234342 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-bundle\") pod \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\" (UID: \"590a23f7-6fac-4b89-a6b7-3ff87ee98e84\") "
Jul 26 15:25:40.234392 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234375    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:40.234427 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234399    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhkcz\" (UniqueName: \"kubernetes.io/projected/5c8b9ca6-5a35-407e-afc5-3346fafe9495-kube-api-access-zhkcz\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:40.234427 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234413    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c8b9ca6-5a35-407e-afc5-3346fafe9495-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:40.234839 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.234800    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-bundle" (OuterVolumeSpecName: "bundle") pod "590a23f7-6fac-4b89-a6b7-3ff87ee98e84" (UID: "590a23f7-6fac-4b89-a6b7-3ff87ee98e84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:40.236343 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.236325    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-kube-api-access-mnsmk" (OuterVolumeSpecName: "kube-api-access-mnsmk") pod "590a23f7-6fac-4b89-a6b7-3ff87ee98e84" (UID: "590a23f7-6fac-4b89-a6b7-3ff87ee98e84"). InnerVolumeSpecName "kube-api-access-mnsmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:25:40.239052 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.239017    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-util" (OuterVolumeSpecName: "util") pod "590a23f7-6fac-4b89-a6b7-3ff87ee98e84" (UID: "590a23f7-6fac-4b89-a6b7-3ff87ee98e84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:25:40.334790 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.334751    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-util\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:40.334790 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.334784    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnsmk\" (UniqueName: \"kubernetes.io/projected/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-kube-api-access-mnsmk\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:40.334790 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.334798    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/590a23f7-6fac-4b89-a6b7-3ff87ee98e84-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:25:40.942358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.942268    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58"
Jul 26 15:25:40.942358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.942293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58" event={"ID":"5c8b9ca6-5a35-407e-afc5-3346fafe9495","Type":"ContainerDied","Data":"d647c3aa9e9cab36007f1ae28fb66e4006949a48d1338be602c9af4235a17507"}
Jul 26 15:25:40.942358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.942339    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d647c3aa9e9cab36007f1ae28fb66e4006949a48d1338be602c9af4235a17507"
Jul 26 15:25:40.950242 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.950200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv" event={"ID":"590a23f7-6fac-4b89-a6b7-3ff87ee98e84","Type":"ContainerDied","Data":"a3e999601bfac1a5ee04c5d21ef6590021f83462d01ec4c760acab68ec6017c2"}
Jul 26 15:25:40.950242 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.950230    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv"
Jul 26 15:25:40.950457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:40.950285    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3e999601bfac1a5ee04c5d21ef6590021f83462d01ec4c760acab68ec6017c2"
Jul 26 15:25:43.626170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626130    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"]
Jul 26 15:25:43.626631 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626570    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="extract"
Jul 26 15:25:43.626631 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626587    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="extract"
Jul 26 15:25:43.626631 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626604    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="pull"
Jul 26 15:25:43.626631 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626612    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="pull"
Jul 26 15:25:43.626631 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626622    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="pull"
Jul 26 15:25:43.626631 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626631    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="pull"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626638    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626646    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626657    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626665    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626672    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626679    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626694    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626702    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626717    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="pull"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="pull"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626734    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626752    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626759    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626768    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626775    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="util"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626785    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="pull"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626793    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="pull"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626872    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626886    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c8b9ca6-5a35-407e-afc5-3346fafe9495" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626897    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d33db239-2d88-4203-90bc-bf347e3a7286" containerName="extract"
Jul 26 15:25:43.627064 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.626907    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="590a23f7-6fac-4b89-a6b7-3ff87ee98e84" containerName="extract"
Jul 26 15:25:43.631187 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.631166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:43.634109 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.634085    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 26 15:25:43.634228 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.634208    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gdtv6\""
Jul 26 15:25:43.639734 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.639710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"]
Jul 26 15:25:43.766195 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.766155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzkb9\" (UniqueName: \"kubernetes.io/projected/758bf8aa-0132-4934-8939-c5c04d6d811e-kube-api-access-jzkb9\") pod \"dns-operator-controller-manager-864dd78c4c-kslmm\" (UID: \"758bf8aa-0132-4934-8939-c5c04d6d811e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:43.866575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.866532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzkb9\" (UniqueName: \"kubernetes.io/projected/758bf8aa-0132-4934-8939-c5c04d6d811e-kube-api-access-jzkb9\") pod \"dns-operator-controller-manager-864dd78c4c-kslmm\" (UID: \"758bf8aa-0132-4934-8939-c5c04d6d811e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:43.876979 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.876905    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzkb9\" (UniqueName: \"kubernetes.io/projected/758bf8aa-0132-4934-8939-c5c04d6d811e-kube-api-access-jzkb9\") pod \"dns-operator-controller-manager-864dd78c4c-kslmm\" (UID: \"758bf8aa-0132-4934-8939-c5c04d6d811e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:43.941952 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:43.941901    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:44.081446 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:44.081421    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"]
Jul 26 15:25:44.083423 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:44.083397    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758bf8aa_0132_4934_8939_c5c04d6d811e.slice/crio-13baf335332309005df9343c5aaa25717cd37927561e54207c926a748ba62879 WatchSource:0}: Error finding container 13baf335332309005df9343c5aaa25717cd37927561e54207c926a748ba62879: Status 404 returned error can't find the container with id 13baf335332309005df9343c5aaa25717cd37927561e54207c926a748ba62879
Jul 26 15:25:44.972353 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:44.972315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm" event={"ID":"758bf8aa-0132-4934-8939-c5c04d6d811e","Type":"ContainerStarted","Data":"13baf335332309005df9343c5aaa25717cd37927561e54207c926a748ba62879"}
Jul 26 15:25:45.978567 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:45.978521    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm" event={"ID":"758bf8aa-0132-4934-8939-c5c04d6d811e","Type":"ContainerStarted","Data":"c43ea657e67f42b745beedff58c823eacac5a17b00ba8d87d40e42f8daf8cb99"}
Jul 26 15:25:45.979035 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:45.978605    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:45.996205 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:45.996157    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm" podStartSLOduration=1.2225733380000001 podStartE2EDuration="2.996143021s" totalImagesPullingTime="1.773569683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:25:45.994754032 +0000 UTC m=+455.356253837" watchObservedRunningTime="2026-07-26 15:25:45.996143021 +0000 UTC m=+455.357642827"
Jul 26 15:25:47.472809 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.472768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"]
Jul 26 15:25:47.476229 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.476210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:25:47.479023 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.479004    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7cm42\""
Jul 26 15:25:47.484992 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.484969    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"]
Jul 26 15:25:47.598336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.598302    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sshfj\" (UniqueName: \"kubernetes.io/projected/9286f6d6-4e26-4c0c-aaa5-466084926576-kube-api-access-sshfj\") pod \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" (UID: \"9286f6d6-4e26-4c0c-aaa5-466084926576\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:25:47.699194 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.699145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sshfj\" (UniqueName: \"kubernetes.io/projected/9286f6d6-4e26-4c0c-aaa5-466084926576-kube-api-access-sshfj\") pod \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" (UID: \"9286f6d6-4e26-4c0c-aaa5-466084926576\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:25:47.708185 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.708156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sshfj\" (UniqueName: \"kubernetes.io/projected/9286f6d6-4e26-4c0c-aaa5-466084926576-kube-api-access-sshfj\") pod \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" (UID: \"9286f6d6-4e26-4c0c-aaa5-466084926576\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:25:47.787085 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.787046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:25:47.924271 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.924248    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"]
Jul 26 15:25:47.926074 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:47.926034    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9286f6d6_4e26_4c0c_aaa5_466084926576.slice/crio-f891c5632e249ba784663d8c7ce4fcf9d69e547778ba96fe744810a1d51ee928 WatchSource:0}: Error finding container f891c5632e249ba784663d8c7ce4fcf9d69e547778ba96fe744810a1d51ee928: Status 404 returned error can't find the container with id f891c5632e249ba784663d8c7ce4fcf9d69e547778ba96fe744810a1d51ee928
Jul 26 15:25:47.988752 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:47.988719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv" event={"ID":"9286f6d6-4e26-4c0c-aaa5-466084926576","Type":"ContainerStarted","Data":"f891c5632e249ba784663d8c7ce4fcf9d69e547778ba96fe744810a1d51ee928"}
Jul 26 15:25:50.002061 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:50.002019    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv" event={"ID":"9286f6d6-4e26-4c0c-aaa5-466084926576","Type":"ContainerStarted","Data":"95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b"}
Jul 26 15:25:50.002528 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:50.002148    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:25:50.017405 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:50.017330    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv" podStartSLOduration=1.340317485 podStartE2EDuration="3.017311387s" totalImagesPullingTime="1.676993902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:25:50.017247165 +0000 UTC m=+459.378746971" watchObservedRunningTime="2026-07-26 15:25:50.017311387 +0000 UTC m=+459.378811193"
Jul 26 15:25:51.592862 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.592827    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"]
Jul 26 15:25:51.596236 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.596220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:25:51.601582 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.601561    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-csmsv\""
Jul 26 15:25:51.609777 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.609722    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"]
Jul 26 15:25:51.732131 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.732091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsqt7\" (UniqueName: \"kubernetes.io/projected/a0d630dc-04b6-4f15-bfa8-f4ebbed14cce-kube-api-access-xsqt7\") pod \"authorino-operator-75cc8d5cb7-jzc74\" (UID: \"a0d630dc-04b6-4f15-bfa8-f4ebbed14cce\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:25:51.833145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.833111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsqt7\" (UniqueName: \"kubernetes.io/projected/a0d630dc-04b6-4f15-bfa8-f4ebbed14cce-kube-api-access-xsqt7\") pod \"authorino-operator-75cc8d5cb7-jzc74\" (UID: \"a0d630dc-04b6-4f15-bfa8-f4ebbed14cce\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:25:51.842549 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.842517    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsqt7\" (UniqueName: \"kubernetes.io/projected/a0d630dc-04b6-4f15-bfa8-f4ebbed14cce-kube-api-access-xsqt7\") pod \"authorino-operator-75cc8d5cb7-jzc74\" (UID: \"a0d630dc-04b6-4f15-bfa8-f4ebbed14cce\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:25:51.905562 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:51.905471    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:25:52.038793 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:52.038772    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"]
Jul 26 15:25:52.040731 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:52.040704    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d630dc_04b6_4f15_bfa8_f4ebbed14cce.slice/crio-ca3a9a5913daf20f00474a9c9d2b4fb1c59d146dbc980131d33ffc42f60a809b WatchSource:0}: Error finding container ca3a9a5913daf20f00474a9c9d2b4fb1c59d146dbc980131d33ffc42f60a809b: Status 404 returned error can't find the container with id ca3a9a5913daf20f00474a9c9d2b4fb1c59d146dbc980131d33ffc42f60a809b
Jul 26 15:25:53.026676 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:53.026633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74" event={"ID":"a0d630dc-04b6-4f15-bfa8-f4ebbed14cce","Type":"ContainerStarted","Data":"ca3a9a5913daf20f00474a9c9d2b4fb1c59d146dbc980131d33ffc42f60a809b"}
Jul 26 15:25:55.037511 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:55.037469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74" event={"ID":"a0d630dc-04b6-4f15-bfa8-f4ebbed14cce","Type":"ContainerStarted","Data":"afd6af50faab6186dce1ac0b98d8b389a3f0c55f17ceeb6d3ade819addb410ca"}
Jul 26 15:25:55.037967 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:55.037537    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:25:55.055919 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:55.055865    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74" podStartSLOduration=1.749887593 podStartE2EDuration="4.055848584s" totalImagesPullingTime="2.305960991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:25:55.054354831 +0000 UTC m=+464.415854638" watchObservedRunningTime="2026-07-26 15:25:55.055848584 +0000 UTC m=+464.417348387"
Jul 26 15:25:56.171850 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.171813    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"]
Jul 26 15:25:56.175456 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.175427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.178053 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.178025    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hwfpn\""
Jul 26 15:25:56.185661 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.185637    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"]
Jul 26 15:25:56.269714 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.269669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whhnk\" (UniqueName: \"kubernetes.io/projected/d68add26-5d4e-436c-a4f4-4bf8e0086590-kube-api-access-whhnk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.269888 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.269733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68add26-5d4e-436c-a4f4-4bf8e0086590-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.371155 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.371119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whhnk\" (UniqueName: \"kubernetes.io/projected/d68add26-5d4e-436c-a4f4-4bf8e0086590-kube-api-access-whhnk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.371315 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.371168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68add26-5d4e-436c-a4f4-4bf8e0086590-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.371550 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.371534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68add26-5d4e-436c-a4f4-4bf8e0086590-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.380219 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.380197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whhnk\" (UniqueName: \"kubernetes.io/projected/d68add26-5d4e-436c-a4f4-4bf8e0086590-kube-api-access-whhnk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.487100 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.487018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:25:56.624413 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.624387    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"]
Jul 26 15:25:56.627613 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:25:56.627590    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68add26_5d4e_436c_a4f4_4bf8e0086590.slice/crio-386dd7155dfad416b4a123d73b4e060eaa825df0a7c19f80d327681305ee1177 WatchSource:0}: Error finding container 386dd7155dfad416b4a123d73b4e060eaa825df0a7c19f80d327681305ee1177: Status 404 returned error can't find the container with id 386dd7155dfad416b4a123d73b4e060eaa825df0a7c19f80d327681305ee1177
Jul 26 15:25:56.985085 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:56.985055    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kslmm"
Jul 26 15:25:57.048026 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:25:57.047992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf" event={"ID":"d68add26-5d4e-436c-a4f4-4bf8e0086590","Type":"ContainerStarted","Data":"386dd7155dfad416b4a123d73b4e060eaa825df0a7c19f80d327681305ee1177"}
Jul 26 15:26:01.009882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:01.009848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:03.081940 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:03.081903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf" event={"ID":"d68add26-5d4e-436c-a4f4-4bf8e0086590","Type":"ContainerStarted","Data":"00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422"}
Jul 26 15:26:03.082306 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:03.082055    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:03.101839 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:03.101782    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf" podStartSLOduration=0.752180826 podStartE2EDuration="7.101765572s" totalImagesPullingTime="6.349584746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:26:03.099755471 +0000 UTC m=+472.461255277" watchObservedRunningTime="2026-07-26 15:26:03.101765572 +0000 UTC m=+472.463265454"
Jul 26 15:26:06.045115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:06.045085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jzc74"
Jul 26 15:26:14.090387 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:14.090351    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:15.797344 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.797295    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"]
Jul 26 15:26:15.797772 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.797495    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" containerName="manager" containerID="cri-o://00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422" gracePeriod=2
Jul 26 15:26:15.807867 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.807837    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"]
Jul 26 15:26:15.815565 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.815515    2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d68add26-5d4e-436c-a4f4-4bf8e0086590\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-68zvf\": pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:15.820821 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.820795    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"]
Jul 26 15:26:15.821285 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.821265    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" containerName="manager"
Jul 26 15:26:15.821285 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.821286    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" containerName="manager"
Jul 26 15:26:15.821421 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.821374    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" containerName="manager"
Jul 26 15:26:15.824643 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.824625    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"]
Jul 26 15:26:15.824752 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.824735    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:15.824836 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.824816    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" containerName="manager" containerID="cri-o://95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b" gracePeriod=2
Jul 26 15:26:15.827426 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.827361    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:15.836619 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.836585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a24bd56-a228-4d10-b1fb-e78514e47897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4dwv\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:15.836812 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.836646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wb27\" (UniqueName: \"kubernetes.io/projected/0a24bd56-a228-4d10-b1fb-e78514e47897-kube-api-access-5wb27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4dwv\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:15.840323 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.840270    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"]
Jul 26 15:26:15.842546 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.842506    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"]
Jul 26 15:26:15.857037 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.857000    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"]
Jul 26 15:26:15.857563 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.857545    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" containerName="manager"
Jul 26 15:26:15.857612 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.857568    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" containerName="manager"
Jul 26 15:26:15.857651 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.857644    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" containerName="manager"
Jul 26 15:26:15.859187 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.859149    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:15.861077 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.861054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:15.861339 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.861313    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:15.864334 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.864293    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:15.869872 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.869846    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"]
Jul 26 15:26:15.881538 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.881493    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:15.883603 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:15.883574    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:15.937390 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.937359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbvjf\" (UniqueName: \"kubernetes.io/projected/cb1c08c0-126e-463b-a6f5-4915c078577d-kube-api-access-xbvjf\") pod \"limitador-operator-controller-manager-859d7b78bd-d2l65\" (UID: \"cb1c08c0-126e-463b-a6f5-4915c078577d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:15.937540 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.937425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a24bd56-a228-4d10-b1fb-e78514e47897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4dwv\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:15.937540 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.937474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wb27\" (UniqueName: \"kubernetes.io/projected/0a24bd56-a228-4d10-b1fb-e78514e47897-kube-api-access-5wb27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4dwv\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:15.937903 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.937869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a24bd56-a228-4d10-b1fb-e78514e47897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4dwv\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:15.945967 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:15.945815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wb27\" (UniqueName: \"kubernetes.io/projected/0a24bd56-a228-4d10-b1fb-e78514e47897-kube-api-access-5wb27\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4dwv\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:16.038467 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.038431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbvjf\" (UniqueName: \"kubernetes.io/projected/cb1c08c0-126e-463b-a6f5-4915c078577d-kube-api-access-xbvjf\") pod \"limitador-operator-controller-manager-859d7b78bd-d2l65\" (UID: \"cb1c08c0-126e-463b-a6f5-4915c078577d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:16.047127 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.047099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbvjf\" (UniqueName: \"kubernetes.io/projected/cb1c08c0-126e-463b-a6f5-4915c078577d-kube-api-access-xbvjf\") pod \"limitador-operator-controller-manager-859d7b78bd-d2l65\" (UID: \"cb1c08c0-126e-463b-a6f5-4915c078577d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:16.067568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.067529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.069941 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.069902    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.070094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.070077    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.072175 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.072147    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.074146 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.074120    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.076162 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.076142    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.139680 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.139641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sshfj\" (UniqueName: \"kubernetes.io/projected/9286f6d6-4e26-4c0c-aaa5-466084926576-kube-api-access-sshfj\") pod \"9286f6d6-4e26-4c0c-aaa5-466084926576\" (UID: \"9286f6d6-4e26-4c0c-aaa5-466084926576\") "
Jul 26 15:26:16.139860 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.139744    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whhnk\" (UniqueName: \"kubernetes.io/projected/d68add26-5d4e-436c-a4f4-4bf8e0086590-kube-api-access-whhnk\") pod \"d68add26-5d4e-436c-a4f4-4bf8e0086590\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") "
Jul 26 15:26:16.139860 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.139767    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68add26-5d4e-436c-a4f4-4bf8e0086590-extensions-socket-volume\") pod \"d68add26-5d4e-436c-a4f4-4bf8e0086590\" (UID: \"d68add26-5d4e-436c-a4f4-4bf8e0086590\") "
Jul 26 15:26:16.140279 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.140252    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68add26-5d4e-436c-a4f4-4bf8e0086590-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d68add26-5d4e-436c-a4f4-4bf8e0086590" (UID: "d68add26-5d4e-436c-a4f4-4bf8e0086590"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:26:16.141945 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.141909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9286f6d6-4e26-4c0c-aaa5-466084926576-kube-api-access-sshfj" (OuterVolumeSpecName: "kube-api-access-sshfj") pod "9286f6d6-4e26-4c0c-aaa5-466084926576" (UID: "9286f6d6-4e26-4c0c-aaa5-466084926576"). InnerVolumeSpecName "kube-api-access-sshfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:26:16.142033 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.141993    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68add26-5d4e-436c-a4f4-4bf8e0086590-kube-api-access-whhnk" (OuterVolumeSpecName: "kube-api-access-whhnk") pod "d68add26-5d4e-436c-a4f4-4bf8e0086590" (UID: "d68add26-5d4e-436c-a4f4-4bf8e0086590"). InnerVolumeSpecName "kube-api-access-whhnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:26:16.152111 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.152082    2561 generic.go:356] "Generic (PLEG): container finished" podID="9286f6d6-4e26-4c0c-aaa5-466084926576" containerID="95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b" exitCode=0
Jul 26 15:26:16.152283 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.152197    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.152283 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.152243    2561 scope.go:117] "RemoveContainer" containerID="95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b"
Jul 26 15:26:16.153695 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.153669    2561 generic.go:356] "Generic (PLEG): container finished" podID="d68add26-5d4e-436c-a4f4-4bf8e0086590" containerID="00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422" exitCode=0
Jul 26 15:26:16.153798 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.153710    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.154885 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.154856    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.157581 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.157550    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.159921 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.159891    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.161867 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.161849    2561 scope.go:117] "RemoveContainer" containerID="95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b"
Jul 26 15:26:16.162150 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.162127    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.162254 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.162211    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b\": container with ID starting with 95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b not found: ID does not exist" containerID="95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b"
Jul 26 15:26:16.162254 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.162239    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b"} err="failed to get container status \"95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b\": rpc error: code = NotFound desc = could not find container \"95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b\": container with ID starting with 95759cba962c283f7a264c307524e795aeaeade56dc8fae0995af1496cae328b not found: ID does not exist"
Jul 26 15:26:16.162340 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.162256    2561 scope.go:117] "RemoveContainer" containerID="00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422"
Jul 26 15:26:16.166120 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.166096    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.168098 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.168072    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.170213 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.170184    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68zvf\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68zvf"
Jul 26 15:26:16.171101 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.171083    2561 scope.go:117] "RemoveContainer" containerID="00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422"
Jul 26 15:26:16.171436 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.171418    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422\": container with ID starting with 00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422 not found: ID does not exist" containerID="00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422"
Jul 26 15:26:16.171480 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.171446    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422"} err="failed to get container status \"00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422\": rpc error: code = NotFound desc = could not find container \"00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422\": container with ID starting with 00a9a171abec2e287fa43b4929d11620754c0b2c36501e0b95fffe0f25f60422 not found: ID does not exist"
Jul 26 15:26:16.172178 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:16.172159    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j4vtv\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j4vtv"
Jul 26 15:26:16.241120 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.241086    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whhnk\" (UniqueName: \"kubernetes.io/projected/d68add26-5d4e-436c-a4f4-4bf8e0086590-kube-api-access-whhnk\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:26:16.241120 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.241115    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d68add26-5d4e-436c-a4f4-4bf8e0086590-extensions-socket-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:26:16.241120 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.241124    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sshfj\" (UniqueName: \"kubernetes.io/projected/9286f6d6-4e26-4c0c-aaa5-466084926576-kube-api-access-sshfj\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:26:16.246004 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.245988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:16.260292 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.260271    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:16.425879 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.425839    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"]
Jul 26 15:26:16.429032 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:26:16.428989    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a24bd56_a228_4d10_b1fb_e78514e47897.slice/crio-bee60bc3b491e2ad6207207dcfb39dcbceac5665022f86ce9d538291ce661e9c WatchSource:0}: Error finding container bee60bc3b491e2ad6207207dcfb39dcbceac5665022f86ce9d538291ce661e9c: Status 404 returned error can't find the container with id bee60bc3b491e2ad6207207dcfb39dcbceac5665022f86ce9d538291ce661e9c
Jul 26 15:26:16.440977 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:16.440952    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"]
Jul 26 15:26:16.444441 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:26:16.444414    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1c08c0_126e_463b_a6f5_4915c078577d.slice/crio-ef850227548398de34c84bc2c3831ff8365720fcb992c6fce5fe8cf1aec09b60 WatchSource:0}: Error finding container ef850227548398de34c84bc2c3831ff8365720fcb992c6fce5fe8cf1aec09b60: Status 404 returned error can't find the container with id ef850227548398de34c84bc2c3831ff8365720fcb992c6fce5fe8cf1aec09b60
Jul 26 15:26:17.105109 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.105026    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9286f6d6-4e26-4c0c-aaa5-466084926576" path="/var/lib/kubelet/pods/9286f6d6-4e26-4c0c-aaa5-466084926576/volumes"
Jul 26 15:26:17.105476 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.105378    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68add26-5d4e-436c-a4f4-4bf8e0086590" path="/var/lib/kubelet/pods/d68add26-5d4e-436c-a4f4-4bf8e0086590/volumes"
Jul 26 15:26:17.162232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.162197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv" event={"ID":"0a24bd56-a228-4d10-b1fb-e78514e47897","Type":"ContainerStarted","Data":"245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973"}
Jul 26 15:26:17.162419 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.162246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv" event={"ID":"0a24bd56-a228-4d10-b1fb-e78514e47897","Type":"ContainerStarted","Data":"bee60bc3b491e2ad6207207dcfb39dcbceac5665022f86ce9d538291ce661e9c"}
Jul 26 15:26:17.162419 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.162317    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:17.163854 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.163831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65" event={"ID":"cb1c08c0-126e-463b-a6f5-4915c078577d","Type":"ContainerStarted","Data":"271faef1bb3f1a9f2a2ea65f936bebeb199cf8a61b0a5ff418b4e37227c12ed4"}
Jul 26 15:26:17.163916 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.163872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65" event={"ID":"cb1c08c0-126e-463b-a6f5-4915c078577d","Type":"ContainerStarted","Data":"ef850227548398de34c84bc2c3831ff8365720fcb992c6fce5fe8cf1aec09b60"}
Jul 26 15:26:17.163988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.163975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:17.187862 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.187808    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv" podStartSLOduration=2.187791728 podStartE2EDuration="2.187791728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:26:17.185434703 +0000 UTC m=+486.546934507" watchObservedRunningTime="2026-07-26 15:26:17.187791728 +0000 UTC m=+486.549291531"
Jul 26 15:26:17.209020 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:17.208959    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65" podStartSLOduration=2.208941339 podStartE2EDuration="2.208941339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:26:17.207405736 +0000 UTC m=+486.568905553" watchObservedRunningTime="2026-07-26 15:26:17.208941339 +0000 UTC m=+486.570441133"
Jul 26 15:26:28.170286 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:28.170250    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d2l65"
Jul 26 15:26:28.170814 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:28.170318    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:46.636946 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.636900    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"]
Jul 26 15:26:46.637341 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.637139    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv" podUID="0a24bd56-a228-4d10-b1fb-e78514e47897" containerName="manager" containerID="cri-o://245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973" gracePeriod=10
Jul 26 15:26:46.891585 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.891530    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:46.956690 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.956646    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"]
Jul 26 15:26:46.957014 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.956995    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a24bd56-a228-4d10-b1fb-e78514e47897" containerName="manager"
Jul 26 15:26:46.957014 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.957012    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a24bd56-a228-4d10-b1fb-e78514e47897" containerName="manager"
Jul 26 15:26:46.957171 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.957082    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a24bd56-a228-4d10-b1fb-e78514e47897" containerName="manager"
Jul 26 15:26:46.958885 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.958865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:46.991075 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:46.991050    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"]
Jul 26 15:26:47.003862 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.003829    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wb27\" (UniqueName: \"kubernetes.io/projected/0a24bd56-a228-4d10-b1fb-e78514e47897-kube-api-access-5wb27\") pod \"0a24bd56-a228-4d10-b1fb-e78514e47897\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") "
Jul 26 15:26:47.004058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.004002    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a24bd56-a228-4d10-b1fb-e78514e47897-extensions-socket-volume\") pod \"0a24bd56-a228-4d10-b1fb-e78514e47897\" (UID: \"0a24bd56-a228-4d10-b1fb-e78514e47897\") "
Jul 26 15:26:47.004675 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.004646    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a24bd56-a228-4d10-b1fb-e78514e47897-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a24bd56-a228-4d10-b1fb-e78514e47897" (UID: "0a24bd56-a228-4d10-b1fb-e78514e47897"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:26:47.006628 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.006606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a24bd56-a228-4d10-b1fb-e78514e47897-kube-api-access-5wb27" (OuterVolumeSpecName: "kube-api-access-5wb27") pod "0a24bd56-a228-4d10-b1fb-e78514e47897" (UID: "0a24bd56-a228-4d10-b1fb-e78514e47897"). InnerVolumeSpecName "kube-api-access-5wb27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:26:47.104689 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.104657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/568e7959-f016-4239-b816-571afc74a47e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jft7r\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.104856 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.104725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tv5\" (UniqueName: \"kubernetes.io/projected/568e7959-f016-4239-b816-571afc74a47e-kube-api-access-k6tv5\") pod \"kuadrant-operator-controller-manager-86878c769f-jft7r\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.104856 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.104765    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a24bd56-a228-4d10-b1fb-e78514e47897-extensions-socket-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:26:47.104856 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.104775    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wb27\" (UniqueName: \"kubernetes.io/projected/0a24bd56-a228-4d10-b1fb-e78514e47897-kube-api-access-5wb27\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:26:47.205587 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.205482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/568e7959-f016-4239-b816-571afc74a47e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jft7r\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.205587 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.205580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tv5\" (UniqueName: \"kubernetes.io/projected/568e7959-f016-4239-b816-571afc74a47e-kube-api-access-k6tv5\") pod \"kuadrant-operator-controller-manager-86878c769f-jft7r\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.205912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.205889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/568e7959-f016-4239-b816-571afc74a47e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jft7r\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.214480 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.214457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tv5\" (UniqueName: \"kubernetes.io/projected/568e7959-f016-4239-b816-571afc74a47e-kube-api-access-k6tv5\") pod \"kuadrant-operator-controller-manager-86878c769f-jft7r\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.269203 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.269170    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:47.315781 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.315752    2561 generic.go:356] "Generic (PLEG): container finished" podID="0a24bd56-a228-4d10-b1fb-e78514e47897" containerID="245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973" exitCode=0
Jul 26 15:26:47.316002 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.315794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv" event={"ID":"0a24bd56-a228-4d10-b1fb-e78514e47897","Type":"ContainerDied","Data":"245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973"}
Jul 26 15:26:47.316002 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.315816    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"
Jul 26 15:26:47.316002 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.315840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv" event={"ID":"0a24bd56-a228-4d10-b1fb-e78514e47897","Type":"ContainerDied","Data":"bee60bc3b491e2ad6207207dcfb39dcbceac5665022f86ce9d538291ce661e9c"}
Jul 26 15:26:47.316002 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.315862    2561 scope.go:117] "RemoveContainer" containerID="245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973"
Jul 26 15:26:47.327147 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.327120    2561 scope.go:117] "RemoveContainer" containerID="245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973"
Jul 26 15:26:47.327466 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:26:47.327442    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973\": container with ID starting with 245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973 not found: ID does not exist" containerID="245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973"
Jul 26 15:26:47.327548 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.327480    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973"} err="failed to get container status \"245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973\": rpc error: code = NotFound desc = could not find container \"245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973\": container with ID starting with 245f7399d953d7492a36269852b6537c0502cf758394ebdbcd3787b816e50973 not found: ID does not exist"
Jul 26 15:26:47.339484 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.339451    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"]
Jul 26 15:26:47.342905 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.342880    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4dwv"]
Jul 26 15:26:47.415111 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:47.415086    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"]
Jul 26 15:26:47.417231 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:26:47.417210    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568e7959_f016_4239_b816_571afc74a47e.slice/crio-2e98f292a6507b6c8289b4e519028ef89e5dd4ae68549a3e7cb702d923e28e06 WatchSource:0}: Error finding container 2e98f292a6507b6c8289b4e519028ef89e5dd4ae68549a3e7cb702d923e28e06: Status 404 returned error can't find the container with id 2e98f292a6507b6c8289b4e519028ef89e5dd4ae68549a3e7cb702d923e28e06
Jul 26 15:26:48.322415 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:48.322382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r" event={"ID":"568e7959-f016-4239-b816-571afc74a47e","Type":"ContainerStarted","Data":"60a6ebbed88a642da6f859804bec2e3a3688b75492509cbdc0d1992b2cc3f465"}
Jul 26 15:26:48.322875 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:48.322434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r" event={"ID":"568e7959-f016-4239-b816-571afc74a47e","Type":"ContainerStarted","Data":"2e98f292a6507b6c8289b4e519028ef89e5dd4ae68549a3e7cb702d923e28e06"}
Jul 26 15:26:48.322875 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:48.322465    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:26:48.347859 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:48.347800    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r" podStartSLOduration=2.347779439 podStartE2EDuration="2.347779439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:26:48.34544925 +0000 UTC m=+517.706949053" watchObservedRunningTime="2026-07-26 15:26:48.347779439 +0000 UTC m=+517.709279243"
Jul 26 15:26:49.110497 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:49.110464    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a24bd56-a228-4d10-b1fb-e78514e47897" path="/var/lib/kubelet/pods/0a24bd56-a228-4d10-b1fb-e78514e47897/volumes"
Jul 26 15:26:59.331112 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:26:59.331080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:27:02.991857 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:02.991774    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"]
Jul 26 15:27:02.996548 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:02.996457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:02.999578 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:02.999550    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pw6r9\""
Jul 26 15:27:03.006973 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.006945    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"]
Jul 26 15:27:03.140950 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.140903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92fce319-9687-490e-af0f-816c9045893d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141167 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141167 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6h7l\" (UniqueName: \"kubernetes.io/projected/92fce319-9687-490e-af0f-816c9045893d-kube-api-access-g6h7l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141167 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141167 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92fce319-9687-490e-af0f-816c9045893d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141339 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141339 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141339 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92fce319-9687-490e-af0f-816c9045893d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.141339 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.141264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6h7l\" (UniqueName: \"kubernetes.io/projected/92fce319-9687-490e-af0f-816c9045893d-kube-api-access-g6h7l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92fce319-9687-490e-af0f-816c9045893d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92fce319-9687-490e-af0f-816c9045893d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.242894 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.242605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92fce319-9687-490e-af0f-816c9045893d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.243085 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.243060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.243158 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.243139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.243308 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.243287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.243363 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.243295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92fce319-9687-490e-af0f-816c9045893d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.243402 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.243394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.244875 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.244853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92fce319-9687-490e-af0f-816c9045893d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.245304 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.245284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92fce319-9687-490e-af0f-816c9045893d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.254475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.254450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6h7l\" (UniqueName: \"kubernetes.io/projected/92fce319-9687-490e-af0f-816c9045893d-kube-api-access-g6h7l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.255008 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.254988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92fce319-9687-490e-af0f-816c9045893d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-744qj\" (UID: \"92fce319-9687-490e-af0f-816c9045893d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.310301 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.310246    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:03.450343 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.450310    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"]
Jul 26 15:27:03.453309 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:27:03.453284    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fce319_9687_490e_af0f_816c9045893d.slice/crio-cde6ac47a52e6b8994f53ac7558a80bf3a5b3ccf6dfe491c74476233aaca5e7a WatchSource:0}: Error finding container cde6ac47a52e6b8994f53ac7558a80bf3a5b3ccf6dfe491c74476233aaca5e7a: Status 404 returned error can't find the container with id cde6ac47a52e6b8994f53ac7558a80bf3a5b3ccf6dfe491c74476233aaca5e7a
Jul 26 15:27:03.455336 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.455298    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:27:03.455399 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.455374    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:27:03.455434 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:03.455408    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:27:04.406002 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:04.405964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" event={"ID":"92fce319-9687-490e-af0f-816c9045893d","Type":"ContainerStarted","Data":"074f5e8f25e1d36161c0d59b7935718264827cec680fba29ca6433e451bba1e7"}
Jul 26 15:27:04.406467 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:04.406020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" event={"ID":"92fce319-9687-490e-af0f-816c9045893d","Type":"ContainerStarted","Data":"cde6ac47a52e6b8994f53ac7558a80bf3a5b3ccf6dfe491c74476233aaca5e7a"}
Jul 26 15:27:04.428547 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:04.428496    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" podStartSLOduration=2.428476417 podStartE2EDuration="2.428476417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:27:04.427961186 +0000 UTC m=+533.789460993" watchObservedRunningTime="2026-07-26 15:27:04.428476417 +0000 UTC m=+533.789976222"
Jul 26 15:27:05.311293 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:05.311256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:05.316045 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:05.316017    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:05.411696 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:05.411666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:05.412639 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:05.412618    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:27:06.317803 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.317766    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-67ndg"]
Jul 26 15:27:06.321554 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.321519    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:06.324475 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.324454    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-chxxg\""
Jul 26 15:27:06.326194 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.326164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-67ndg"]
Jul 26 15:27:06.467199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.467159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkx5\" (UniqueName: \"kubernetes.io/projected/009d6e28-0e70-4194-b08c-059ad8f6be39-kube-api-access-bjkx5\") pod \"authorino-58cd955675-67ndg\" (UID: \"009d6e28-0e70-4194-b08c-059ad8f6be39\") " pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:06.567898 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.567794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkx5\" (UniqueName: \"kubernetes.io/projected/009d6e28-0e70-4194-b08c-059ad8f6be39-kube-api-access-bjkx5\") pod \"authorino-58cd955675-67ndg\" (UID: \"009d6e28-0e70-4194-b08c-059ad8f6be39\") " pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:06.576113 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.576081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkx5\" (UniqueName: \"kubernetes.io/projected/009d6e28-0e70-4194-b08c-059ad8f6be39-kube-api-access-bjkx5\") pod \"authorino-58cd955675-67ndg\" (UID: \"009d6e28-0e70-4194-b08c-059ad8f6be39\") " pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:06.632430 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.632386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:06.768483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:06.768450    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-67ndg"]
Jul 26 15:27:06.771696 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:27:06.771665    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod009d6e28_0e70_4194_b08c_059ad8f6be39.slice/crio-1e484e6ccbfe0f4b1cdcafc1397f62dfbb0e87c3cb46e544d00d521604500c64 WatchSource:0}: Error finding container 1e484e6ccbfe0f4b1cdcafc1397f62dfbb0e87c3cb46e544d00d521604500c64: Status 404 returned error can't find the container with id 1e484e6ccbfe0f4b1cdcafc1397f62dfbb0e87c3cb46e544d00d521604500c64
Jul 26 15:27:07.427675 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:07.427621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-67ndg" event={"ID":"009d6e28-0e70-4194-b08c-059ad8f6be39","Type":"ContainerStarted","Data":"1e484e6ccbfe0f4b1cdcafc1397f62dfbb0e87c3cb46e544d00d521604500c64"}
Jul 26 15:27:10.447466 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:10.447422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-67ndg" event={"ID":"009d6e28-0e70-4194-b08c-059ad8f6be39","Type":"ContainerStarted","Data":"cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906"}
Jul 26 15:27:10.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:10.461904    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-67ndg" podStartSLOduration=1.531691741 podStartE2EDuration="4.461889572s" totalImagesPullingTime="2.930197831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:27:10.460809964 +0000 UTC m=+539.822309769" watchObservedRunningTime="2026-07-26 15:27:10.461889572 +0000 UTC m=+539.823389375"
Jul 26 15:27:11.801816 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:11.801780    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-67ndg"]
Jul 26 15:27:12.457828 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:12.457784    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-67ndg" podUID="009d6e28-0e70-4194-b08c-059ad8f6be39" containerName="authorino" containerID="cri-o://cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906" gracePeriod=30
Jul 26 15:27:12.711356 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:12.711290    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:12.820894 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:12.820855    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjkx5\" (UniqueName: \"kubernetes.io/projected/009d6e28-0e70-4194-b08c-059ad8f6be39-kube-api-access-bjkx5\") pod \"009d6e28-0e70-4194-b08c-059ad8f6be39\" (UID: \"009d6e28-0e70-4194-b08c-059ad8f6be39\") "
Jul 26 15:27:12.823214 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:12.823190    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009d6e28-0e70-4194-b08c-059ad8f6be39-kube-api-access-bjkx5" (OuterVolumeSpecName: "kube-api-access-bjkx5") pod "009d6e28-0e70-4194-b08c-059ad8f6be39" (UID: "009d6e28-0e70-4194-b08c-059ad8f6be39"). InnerVolumeSpecName "kube-api-access-bjkx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:27:12.921503 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:12.921468    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjkx5\" (UniqueName: \"kubernetes.io/projected/009d6e28-0e70-4194-b08c-059ad8f6be39-kube-api-access-bjkx5\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:27:13.464552 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.464457    2561 generic.go:356] "Generic (PLEG): container finished" podID="009d6e28-0e70-4194-b08c-059ad8f6be39" containerID="cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906" exitCode=0
Jul 26 15:27:13.464552 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.464508    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-67ndg"
Jul 26 15:27:13.464552 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.464536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-67ndg" event={"ID":"009d6e28-0e70-4194-b08c-059ad8f6be39","Type":"ContainerDied","Data":"cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906"}
Jul 26 15:27:13.464833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.464589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-67ndg" event={"ID":"009d6e28-0e70-4194-b08c-059ad8f6be39","Type":"ContainerDied","Data":"1e484e6ccbfe0f4b1cdcafc1397f62dfbb0e87c3cb46e544d00d521604500c64"}
Jul 26 15:27:13.464833 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.464607    2561 scope.go:117] "RemoveContainer" containerID="cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906"
Jul 26 15:27:13.472972 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.472953    2561 scope.go:117] "RemoveContainer" containerID="cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906"
Jul 26 15:27:13.473235 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:27:13.473212    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906\": container with ID starting with cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906 not found: ID does not exist" containerID="cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906"
Jul 26 15:27:13.473286 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.473245    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906"} err="failed to get container status \"cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906\": rpc error: code = NotFound desc = could not find container \"cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906\": container with ID starting with cf8d1ac21666ae6e1dde4c01a36161e7aabf3485e7211bb9d33b0e640b798906 not found: ID does not exist"
Jul 26 15:27:13.481478 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.481455    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-67ndg"]
Jul 26 15:27:13.483453 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:13.483436    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-67ndg"]
Jul 26 15:27:15.104107 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:15.104076    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009d6e28-0e70-4194-b08c-059ad8f6be39" path="/var/lib/kubelet/pods/009d6e28-0e70-4194-b08c-059ad8f6be39/volumes"
Jul 26 15:27:34.419519 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.419489    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6s5t7"]
Jul 26 15:27:34.420042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.419820    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009d6e28-0e70-4194-b08c-059ad8f6be39" containerName="authorino"
Jul 26 15:27:34.420042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.419831    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="009d6e28-0e70-4194-b08c-059ad8f6be39" containerName="authorino"
Jul 26 15:27:34.420042 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.419894    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="009d6e28-0e70-4194-b08c-059ad8f6be39" containerName="authorino"
Jul 26 15:27:34.423513 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.423495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:34.426113 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.426087    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-chxxg\""
Jul 26 15:27:34.431793 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.431769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6s5t7"]
Jul 26 15:27:34.504862 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.504825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56xq\" (UniqueName: \"kubernetes.io/projected/ba097a68-d768-460c-9a44-554a9cab20cb-kube-api-access-p56xq\") pod \"authorino-5d4b67c446-6s5t7\" (UID: \"ba097a68-d768-460c-9a44-554a9cab20cb\") " pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:34.605365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.605329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56xq\" (UniqueName: \"kubernetes.io/projected/ba097a68-d768-460c-9a44-554a9cab20cb-kube-api-access-p56xq\") pod \"authorino-5d4b67c446-6s5t7\" (UID: \"ba097a68-d768-460c-9a44-554a9cab20cb\") " pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:34.613423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.613397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56xq\" (UniqueName: \"kubernetes.io/projected/ba097a68-d768-460c-9a44-554a9cab20cb-kube-api-access-p56xq\") pod \"authorino-5d4b67c446-6s5t7\" (UID: \"ba097a68-d768-460c-9a44-554a9cab20cb\") " pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:34.653213 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.653180    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6s5t7"]
Jul 26 15:27:34.653446 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.653435    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:34.677130 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.677055    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58bf8f5956-jt778"]
Jul 26 15:27:34.680149 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.680124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:34.686658 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.686629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58bf8f5956-jt778"]
Jul 26 15:27:34.706776 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.706727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp24j\" (UniqueName: \"kubernetes.io/projected/ea6e94db-8a91-416e-9515-f28a8f269c6c-kube-api-access-kp24j\") pod \"authorino-58bf8f5956-jt778\" (UID: \"ea6e94db-8a91-416e-9515-f28a8f269c6c\") " pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:34.791867 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.791843    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6s5t7"]
Jul 26 15:27:34.794550 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:27:34.794524    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba097a68_d768_460c_9a44_554a9cab20cb.slice/crio-83f7988fdd14cfd9ba4d0715fb0ea5d77f0df8d06bc28131b68bb2dbb835f9db WatchSource:0}: Error finding container 83f7988fdd14cfd9ba4d0715fb0ea5d77f0df8d06bc28131b68bb2dbb835f9db: Status 404 returned error can't find the container with id 83f7988fdd14cfd9ba4d0715fb0ea5d77f0df8d06bc28131b68bb2dbb835f9db
Jul 26 15:27:34.807887 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.807859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp24j\" (UniqueName: \"kubernetes.io/projected/ea6e94db-8a91-416e-9515-f28a8f269c6c-kube-api-access-kp24j\") pod \"authorino-58bf8f5956-jt778\" (UID: \"ea6e94db-8a91-416e-9515-f28a8f269c6c\") " pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:34.815669 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.815638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp24j\" (UniqueName: \"kubernetes.io/projected/ea6e94db-8a91-416e-9515-f28a8f269c6c-kube-api-access-kp24j\") pod \"authorino-58bf8f5956-jt778\" (UID: \"ea6e94db-8a91-416e-9515-f28a8f269c6c\") " pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:34.860199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.860162    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58bf8f5956-jt778"]
Jul 26 15:27:34.860443 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.860429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:34.887237 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.887205    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8677785964-cb7b4"]
Jul 26 15:27:34.890369 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.890350    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:34.892980 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.892951    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 26 15:27:34.897058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.897034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8677785964-cb7b4"]
Jul 26 15:27:34.996774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:34.996750    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58bf8f5956-jt778"]
Jul 26 15:27:34.998275 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:27:34.998248    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea6e94db_8a91_416e_9515_f28a8f269c6c.slice/crio-d8388fea1811b8ccaf8c8946a7d8fe14dcc46a591e7b95fc02d7ffad3abfe729 WatchSource:0}: Error finding container d8388fea1811b8ccaf8c8946a7d8fe14dcc46a591e7b95fc02d7ffad3abfe729: Status 404 returned error can't find the container with id d8388fea1811b8ccaf8c8946a7d8fe14dcc46a591e7b95fc02d7ffad3abfe729
Jul 26 15:27:35.009984 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.009919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa9bf408-a019-4e87-9502-1a28c124d2bf-tls-cert\") pod \"authorino-8677785964-cb7b4\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") " pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.010082 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.009994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt7rp\" (UniqueName: \"kubernetes.io/projected/aa9bf408-a019-4e87-9502-1a28c124d2bf-kube-api-access-bt7rp\") pod \"authorino-8677785964-cb7b4\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") " pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.111131 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.111099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa9bf408-a019-4e87-9502-1a28c124d2bf-tls-cert\") pod \"authorino-8677785964-cb7b4\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") " pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.111131 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.111131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt7rp\" (UniqueName: \"kubernetes.io/projected/aa9bf408-a019-4e87-9502-1a28c124d2bf-kube-api-access-bt7rp\") pod \"authorino-8677785964-cb7b4\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") " pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.113694 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.113672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa9bf408-a019-4e87-9502-1a28c124d2bf-tls-cert\") pod \"authorino-8677785964-cb7b4\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") " pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.119157 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.119128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt7rp\" (UniqueName: \"kubernetes.io/projected/aa9bf408-a019-4e87-9502-1a28c124d2bf-kube-api-access-bt7rp\") pod \"authorino-8677785964-cb7b4\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") " pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.201456 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.201382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:27:35.356224 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.356196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8677785964-cb7b4"]
Jul 26 15:27:35.357978 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:27:35.357954    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa9bf408_a019_4e87_9502_1a28c124d2bf.slice/crio-9dcaa17b34412f3d8cb2d7584a935fe13495fc321d0fd7ad5e19447ee8610cd5 WatchSource:0}: Error finding container 9dcaa17b34412f3d8cb2d7584a935fe13495fc321d0fd7ad5e19447ee8610cd5: Status 404 returned error can't find the container with id 9dcaa17b34412f3d8cb2d7584a935fe13495fc321d0fd7ad5e19447ee8610cd5
Jul 26 15:27:35.581835 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.581801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6s5t7" event={"ID":"ba097a68-d768-460c-9a44-554a9cab20cb","Type":"ContainerStarted","Data":"1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8"}
Jul 26 15:27:35.582386 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.581849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6s5t7" event={"ID":"ba097a68-d768-460c-9a44-554a9cab20cb","Type":"ContainerStarted","Data":"83f7988fdd14cfd9ba4d0715fb0ea5d77f0df8d06bc28131b68bb2dbb835f9db"}
Jul 26 15:27:35.582386 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.581875    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6s5t7" podUID="ba097a68-d768-460c-9a44-554a9cab20cb" containerName="authorino" containerID="cri-o://1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8" gracePeriod=30
Jul 26 15:27:35.583386 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.583344    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58bf8f5956-jt778" podUID="ea6e94db-8a91-416e-9515-f28a8f269c6c" containerName="authorino" containerID="cri-o://29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3" gracePeriod=30
Jul 26 15:27:35.583491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.583380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58bf8f5956-jt778" event={"ID":"ea6e94db-8a91-416e-9515-f28a8f269c6c","Type":"ContainerStarted","Data":"29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3"}
Jul 26 15:27:35.583491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.583414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58bf8f5956-jt778" event={"ID":"ea6e94db-8a91-416e-9515-f28a8f269c6c","Type":"ContainerStarted","Data":"d8388fea1811b8ccaf8c8946a7d8fe14dcc46a591e7b95fc02d7ffad3abfe729"}
Jul 26 15:27:35.584685 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.584660    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8677785964-cb7b4" event={"ID":"aa9bf408-a019-4e87-9502-1a28c124d2bf","Type":"ContainerStarted","Data":"9dcaa17b34412f3d8cb2d7584a935fe13495fc321d0fd7ad5e19447ee8610cd5"}
Jul 26 15:27:35.596350 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.596309    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6s5t7" podStartSLOduration=1.275835809 podStartE2EDuration="1.596296124s" totalImagesPullingTime="320.460315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:27:35.595379077 +0000 UTC m=+564.956878880" watchObservedRunningTime="2026-07-26 15:27:35.596296124 +0000 UTC m=+564.957795928"
Jul 26 15:27:35.610576 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.610537    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58bf8f5956-jt778" podStartSLOduration=1.289745633 podStartE2EDuration="1.610522312s" totalImagesPullingTime="320.776679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:27:35.608816503 +0000 UTC m=+564.970316308" watchObservedRunningTime="2026-07-26 15:27:35.610522312 +0000 UTC m=+564.972022115"
Jul 26 15:27:35.845557 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.845528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:35.868751 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.868725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:35.918130 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.918098    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p56xq\" (UniqueName: \"kubernetes.io/projected/ba097a68-d768-460c-9a44-554a9cab20cb-kube-api-access-p56xq\") pod \"ba097a68-d768-460c-9a44-554a9cab20cb\" (UID: \"ba097a68-d768-460c-9a44-554a9cab20cb\") "
Jul 26 15:27:35.918130 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.918142    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp24j\" (UniqueName: \"kubernetes.io/projected/ea6e94db-8a91-416e-9515-f28a8f269c6c-kube-api-access-kp24j\") pod \"ea6e94db-8a91-416e-9515-f28a8f269c6c\" (UID: \"ea6e94db-8a91-416e-9515-f28a8f269c6c\") "
Jul 26 15:27:35.920422 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.920393    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba097a68-d768-460c-9a44-554a9cab20cb-kube-api-access-p56xq" (OuterVolumeSpecName: "kube-api-access-p56xq") pod "ba097a68-d768-460c-9a44-554a9cab20cb" (UID: "ba097a68-d768-460c-9a44-554a9cab20cb"). InnerVolumeSpecName "kube-api-access-p56xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:27:35.920522 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:35.920421    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6e94db-8a91-416e-9515-f28a8f269c6c-kube-api-access-kp24j" (OuterVolumeSpecName: "kube-api-access-kp24j") pod "ea6e94db-8a91-416e-9515-f28a8f269c6c" (UID: "ea6e94db-8a91-416e-9515-f28a8f269c6c"). InnerVolumeSpecName "kube-api-access-kp24j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:27:36.019509 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.019466    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p56xq\" (UniqueName: \"kubernetes.io/projected/ba097a68-d768-460c-9a44-554a9cab20cb-kube-api-access-p56xq\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:27:36.019509 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.019501    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp24j\" (UniqueName: \"kubernetes.io/projected/ea6e94db-8a91-416e-9515-f28a8f269c6c-kube-api-access-kp24j\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:27:36.592311 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.592270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8677785964-cb7b4" event={"ID":"aa9bf408-a019-4e87-9502-1a28c124d2bf","Type":"ContainerStarted","Data":"49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be"}
Jul 26 15:27:36.593626 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.593601    2561 generic.go:356] "Generic (PLEG): container finished" podID="ba097a68-d768-460c-9a44-554a9cab20cb" containerID="1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8" exitCode=0
Jul 26 15:27:36.593762 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.593639    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6s5t7"
Jul 26 15:27:36.593762 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.593688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6s5t7" event={"ID":"ba097a68-d768-460c-9a44-554a9cab20cb","Type":"ContainerDied","Data":"1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8"}
Jul 26 15:27:36.593762 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.593730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6s5t7" event={"ID":"ba097a68-d768-460c-9a44-554a9cab20cb","Type":"ContainerDied","Data":"83f7988fdd14cfd9ba4d0715fb0ea5d77f0df8d06bc28131b68bb2dbb835f9db"}
Jul 26 15:27:36.593762 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.593748    2561 scope.go:117] "RemoveContainer" containerID="1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8"
Jul 26 15:27:36.594847 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.594830    2561 generic.go:356] "Generic (PLEG): container finished" podID="ea6e94db-8a91-416e-9515-f28a8f269c6c" containerID="29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3" exitCode=0
Jul 26 15:27:36.594941 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.594871    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58bf8f5956-jt778"
Jul 26 15:27:36.594989 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.594915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58bf8f5956-jt778" event={"ID":"ea6e94db-8a91-416e-9515-f28a8f269c6c","Type":"ContainerDied","Data":"29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3"}
Jul 26 15:27:36.594989 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.594970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58bf8f5956-jt778" event={"ID":"ea6e94db-8a91-416e-9515-f28a8f269c6c","Type":"ContainerDied","Data":"d8388fea1811b8ccaf8c8946a7d8fe14dcc46a591e7b95fc02d7ffad3abfe729"}
Jul 26 15:27:36.603553 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.603532    2561 scope.go:117] "RemoveContainer" containerID="1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8"
Jul 26 15:27:36.603808 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:27:36.603789    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8\": container with ID starting with 1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8 not found: ID does not exist" containerID="1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8"
Jul 26 15:27:36.603883 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.603821    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8"} err="failed to get container status \"1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8\": rpc error: code = NotFound desc = could not find container \"1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8\": container with ID starting with 1c7420f8ce9048c83bf99e8777167d81c1ed610a8e342a3954874494211902a8 not found: ID does not exist"
Jul 26 15:27:36.603883 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.603844    2561 scope.go:117] "RemoveContainer" containerID="29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3"
Jul 26 15:27:36.611680 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.611640    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8677785964-cb7b4" podStartSLOduration=2.280685712 podStartE2EDuration="2.611627455s" totalImagesPullingTime="330.941743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:27:36.609984017 +0000 UTC m=+565.971483821" watchObservedRunningTime="2026-07-26 15:27:36.611627455 +0000 UTC m=+565.973127259"
Jul 26 15:27:36.612680 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.612633    2561 scope.go:117] "RemoveContainer" containerID="29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3"
Jul 26 15:27:36.612944 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:27:36.612910    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3\": container with ID starting with 29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3 not found: ID does not exist" containerID="29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3"
Jul 26 15:27:36.613005 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.612959    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3"} err="failed to get container status \"29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3\": rpc error: code = NotFound desc = could not find container \"29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3\": container with ID starting with 29b812575491067dd57b690ddb277ef6f8e9516961d547bb7afc6c6350bf92d3 not found: ID does not exist"
Jul 26 15:27:36.626458 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.626433    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58bf8f5956-jt778"]
Jul 26 15:27:36.632606 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.632581    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58bf8f5956-jt778"]
Jul 26 15:27:36.654103 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.654055    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6s5t7"]
Jul 26 15:27:36.655265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:36.655243    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6s5t7"]
Jul 26 15:27:37.104616 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:37.104579    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba097a68-d768-460c-9a44-554a9cab20cb" path="/var/lib/kubelet/pods/ba097a68-d768-460c-9a44-554a9cab20cb/volumes"
Jul 26 15:27:37.104904 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:27:37.104891    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea6e94db-8a91-416e-9515-f28a8f269c6c" path="/var/lib/kubelet/pods/ea6e94db-8a91-416e-9515-f28a8f269c6c/volumes"
Jul 26 15:28:24.837353 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:24.837324    2561 generic.go:356] "Generic (PLEG): container finished" podID="92fce319-9687-490e-af0f-816c9045893d" containerID="074f5e8f25e1d36161c0d59b7935718264827cec680fba29ca6433e451bba1e7" exitCode=0
Jul 26 15:28:24.837718 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:24.837391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" event={"ID":"92fce319-9687-490e-af0f-816c9045893d","Type":"ContainerDied","Data":"074f5e8f25e1d36161c0d59b7935718264827cec680fba29ca6433e451bba1e7"}
Jul 26 15:28:24.837792 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:24.837779    2561 scope.go:117] "RemoveContainer" containerID="074f5e8f25e1d36161c0d59b7935718264827cec680fba29ca6433e451bba1e7"
Jul 26 15:28:24.838726 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:24.838699    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:28:24.838810 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:24.838782    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:28:24.838866 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:24.838833    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:28:25.847133 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:25.847096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" event={"ID":"92fce319-9687-490e-af0f-816c9045893d","Type":"ContainerStarted","Data":"1e0211988157f24e19280b6ad274587deb0c4327e28c8198f9c2c616a0c68b55"}
Jul 26 15:28:26.310696 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:26.310662    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:28:26.310884 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:26.310848    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-744qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 26 15:28:26.310955 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:26.310905    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" podUID="92fce319-9687-490e-af0f-816c9045893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 26 15:28:27.311586 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:27.311554    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-744qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 26 15:28:27.312019 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:27.311612    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" podUID="92fce319-9687-490e-af0f-816c9045893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 26 15:28:28.310668 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:28.310625    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-744qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 26 15:28:28.310868 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:28.310708    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" podUID="92fce319-9687-490e-af0f-816c9045893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 26 15:28:29.310810 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:29.310767    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-744qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 26 15:28:29.311217 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:29.310840    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj" podUID="92fce319-9687-490e-af0f-816c9045893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 26 15:28:30.314256 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:30.314226    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:28:30.314725 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:30.314616    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:28:30.315414 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:30.315393    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-744qj"
Jul 26 15:28:37.082332 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082290    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"]
Jul 26 15:28:37.082723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082659    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6e94db-8a91-416e-9515-f28a8f269c6c" containerName="authorino"
Jul 26 15:28:37.082723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082671    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6e94db-8a91-416e-9515-f28a8f269c6c" containerName="authorino"
Jul 26 15:28:37.082723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082685    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba097a68-d768-460c-9a44-554a9cab20cb" containerName="authorino"
Jul 26 15:28:37.082723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082691    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba097a68-d768-460c-9a44-554a9cab20cb" containerName="authorino"
Jul 26 15:28:37.082864 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082751    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba097a68-d768-460c-9a44-554a9cab20cb" containerName="authorino"
Jul 26 15:28:37.082864 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.082760    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6e94db-8a91-416e-9515-f28a8f269c6c" containerName="authorino"
Jul 26 15:28:37.084952 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.084913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.089059 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.089032    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c5r48\""
Jul 26 15:28:37.089059 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.089051    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 26 15:28:37.089236 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.089055    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 26 15:28:37.089236 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.089119    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 26 15:28:37.108152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.108116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"]
Jul 26 15:28:37.138704 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.138666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwpdn\" (UniqueName: \"kubernetes.io/projected/da419925-c238-47af-b720-3f8ecff1a95a-kube-api-access-kwpdn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.138882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.138720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.138882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.138791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.138882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.138841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.139083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.138971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.139083 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.139010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da419925-c238-47af-b720-3f8ecff1a95a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.239695 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.239658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.239695 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.239699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.239920 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.239740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.239920 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.239810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.239920 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.239836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da419925-c238-47af-b720-3f8ecff1a95a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.239920 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.239864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpdn\" (UniqueName: \"kubernetes.io/projected/da419925-c238-47af-b720-3f8ecff1a95a-kube-api-access-kwpdn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.240166 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.240129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.240254 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.240230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.240345 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.240326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.242052 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.242027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da419925-c238-47af-b720-3f8ecff1a95a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.242383 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.242364    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da419925-c238-47af-b720-3f8ecff1a95a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.250152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.250132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpdn\" (UniqueName: \"kubernetes.io/projected/da419925-c238-47af-b720-3f8ecff1a95a-kube-api-access-kwpdn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjwwj\" (UID: \"da419925-c238-47af-b720-3f8ecff1a95a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.398229 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.398141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:37.529172 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.529146    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"]
Jul 26 15:28:37.532098 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:28:37.532055    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda419925_c238_47af_b720_3f8ecff1a95a.slice/crio-f901a791ae74eeff4f71543b63ced9705a4e7d627ae498cc420ec46c12f0b2cc WatchSource:0}: Error finding container f901a791ae74eeff4f71543b63ced9705a4e7d627ae498cc420ec46c12f0b2cc: Status 404 returned error can't find the container with id f901a791ae74eeff4f71543b63ced9705a4e7d627ae498cc420ec46c12f0b2cc
Jul 26 15:28:37.533438 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.533418    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:28:37.916554 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:37.916519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj" event={"ID":"da419925-c238-47af-b720-3f8ecff1a95a","Type":"ContainerStarted","Data":"f901a791ae74eeff4f71543b63ced9705a4e7d627ae498cc420ec46c12f0b2cc"}
Jul 26 15:28:38.924637 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:38.924549    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj" event={"ID":"da419925-c238-47af-b720-3f8ecff1a95a","Type":"ContainerStarted","Data":"7b8b1cdfb996249fba714d59cf1d8bb0eec858ffc5578d399342093e80a85760"}
Jul 26 15:28:38.943858 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:38.943809    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj" podStartSLOduration=0.896737907 podStartE2EDuration="1.943793921s" totalImagesPullingTime="1.047056014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:28:38.940573479 +0000 UTC m=+628.302073281" watchObservedRunningTime="2026-07-26 15:28:38.943793921 +0000 UTC m=+628.305293758"
Jul 26 15:28:47.399017 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:47.398978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:47.399519 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:47.399039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:47.411275 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:47.411249    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:28:47.983417 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:28:47.983380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjwwj"
Jul 26 15:29:00.675907 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.675873    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"]
Jul 26 15:29:00.678648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.678625    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.681534 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.681516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 26 15:29:00.689378 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.689357    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"]
Jul 26 15:29:00.848296 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.848267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.848296 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.848296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.848539 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.848329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.848539 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.848352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfmbg\" (UniqueName: \"kubernetes.io/projected/fc8ee1fd-c70a-4117-8213-14acc6ef9753-kube-api-access-wfmbg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.848539 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.848420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.848539 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.848465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ee1fd-c70a-4117-8213-14acc6ef9753-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.949687 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.949599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.949687 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.949650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfmbg\" (UniqueName: \"kubernetes.io/projected/fc8ee1fd-c70a-4117-8213-14acc6ef9753-kube-api-access-wfmbg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.949687 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.949675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.950000 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.949707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ee1fd-c70a-4117-8213-14acc6ef9753-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.950000 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.949756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.950000 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.949778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.950152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.950105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.950152 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.950128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.950219 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.950180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.952150 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.952125    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ee1fd-c70a-4117-8213-14acc6ef9753-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.952302 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.952285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ee1fd-c70a-4117-8213-14acc6ef9753-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.957702 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.957681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfmbg\" (UniqueName: \"kubernetes.io/projected/fc8ee1fd-c70a-4117-8213-14acc6ef9753-kube-api-access-wfmbg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5nzqr\" (UID: \"fc8ee1fd-c70a-4117-8213-14acc6ef9753\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:00.990906 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:00.990880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:01.131819 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:01.131779    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"]
Jul 26 15:29:01.134303 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:29:01.134276    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8ee1fd_c70a_4117_8213_14acc6ef9753.slice/crio-a414141d37bf65f3ff882f978ca8796d4e457202cff7611c471f3817cc5e3d2d WatchSource:0}: Error finding container a414141d37bf65f3ff882f978ca8796d4e457202cff7611c471f3817cc5e3d2d: Status 404 returned error can't find the container with id a414141d37bf65f3ff882f978ca8796d4e457202cff7611c471f3817cc5e3d2d
Jul 26 15:29:02.046974 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:02.046917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr" event={"ID":"fc8ee1fd-c70a-4117-8213-14acc6ef9753","Type":"ContainerStarted","Data":"b9c2dea62970e47e6275d407cf431faaaa3c8580db3ab38b72ad30cb008afacd"}
Jul 26 15:29:02.047543 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:02.047003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr" event={"ID":"fc8ee1fd-c70a-4117-8213-14acc6ef9753","Type":"ContainerStarted","Data":"a414141d37bf65f3ff882f978ca8796d4e457202cff7611c471f3817cc5e3d2d"}
Jul 26 15:29:02.065165 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:02.065117    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr" podStartSLOduration=1.9010062429999999 podStartE2EDuration="2.06510095s" totalImagesPullingTime="164.094707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:29:02.063284524 +0000 UTC m=+651.424784330" watchObservedRunningTime="2026-07-26 15:29:02.06510095 +0000 UTC m=+651.426600752"
Jul 26 15:29:10.991037 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:10.990997    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:10.991568 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:10.991070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:11.004396 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:11.004365    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:11.104522 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:11.104494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5nzqr"
Jul 26 15:29:41.288780 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.288727    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"]
Jul 26 15:29:41.292898 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.292875    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.295359 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.295336    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 26 15:29:41.302802 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.302771    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"]
Jul 26 15:29:41.381732 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.381689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.381732 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.381737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4902df7-5d80-48dd-a715-8051b507f6f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.381964 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.381852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xqx6\" (UniqueName: \"kubernetes.io/projected/a4902df7-5d80-48dd-a715-8051b507f6f1-kube-api-access-7xqx6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.381964 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.381923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.382057 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.381982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.382057 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.382027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.483387 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.483347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xqx6\" (UniqueName: \"kubernetes.io/projected/a4902df7-5d80-48dd-a715-8051b507f6f1-kube-api-access-7xqx6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.484093 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.484063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.484709 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.484687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.485234 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.485214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.485725 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.485690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.485815 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.485737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4902df7-5d80-48dd-a715-8051b507f6f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.486451 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.485605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.486549 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.486456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.486637 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.484619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.488310 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.488284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4902df7-5d80-48dd-a715-8051b507f6f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.488584 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.488563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4902df7-5d80-48dd-a715-8051b507f6f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.495023 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.494999    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xqx6\" (UniqueName: \"kubernetes.io/projected/a4902df7-5d80-48dd-a715-8051b507f6f1-kube-api-access-7xqx6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d\" (UID: \"a4902df7-5d80-48dd-a715-8051b507f6f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.605543 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.605445    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:41.760387 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:41.760356    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"]
Jul 26 15:29:41.761811 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:29:41.761786    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4902df7_5d80_48dd_a715_8051b507f6f1.slice/crio-d3d4cc1dc4d5d5de5c631dd3f3f1647367ac1be6ccaeed86906969a99bffbc84 WatchSource:0}: Error finding container d3d4cc1dc4d5d5de5c631dd3f3f1647367ac1be6ccaeed86906969a99bffbc84: Status 404 returned error can't find the container with id d3d4cc1dc4d5d5de5c631dd3f3f1647367ac1be6ccaeed86906969a99bffbc84
Jul 26 15:29:42.251429 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:42.251390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d" event={"ID":"a4902df7-5d80-48dd-a715-8051b507f6f1","Type":"ContainerStarted","Data":"c935af4d8d705c0841e5f16b039a52580cbb661cd625df861f998c7d94efd1e1"}
Jul 26 15:29:42.251614 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:42.251436    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d" event={"ID":"a4902df7-5d80-48dd-a715-8051b507f6f1","Type":"ContainerStarted","Data":"d3d4cc1dc4d5d5de5c631dd3f3f1647367ac1be6ccaeed86906969a99bffbc84"}
Jul 26 15:29:42.270238 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:42.270178    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d" podStartSLOduration=1.112197408 podStartE2EDuration="1.270160397s" totalImagesPullingTime="157.962989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:29:42.26797311 +0000 UTC m=+691.629472910" watchObservedRunningTime="2026-07-26 15:29:42.270160397 +0000 UTC m=+691.631660199"
Jul 26 15:29:51.606132 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:51.606093    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:51.606523 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:51.606168    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:51.618013 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:51.617992    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:29:52.323087 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:29:52.323060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d"
Jul 26 15:31:04.638094 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.638061    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84d488899c-vx67n"]
Jul 26 15:31:04.641622 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.641605    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.649449 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.649427    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84d488899c-vx67n"]
Jul 26 15:31:04.724115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.724088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wbq7\" (UniqueName: \"kubernetes.io/projected/dce27635-01c3-4947-aafb-ef630a68538f-kube-api-access-9wbq7\") pod \"authorino-84d488899c-vx67n\" (UID: \"dce27635-01c3-4947-aafb-ef630a68538f\") " pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.724259 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.724147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce27635-01c3-4947-aafb-ef630a68538f-tls-cert\") pod \"authorino-84d488899c-vx67n\" (UID: \"dce27635-01c3-4947-aafb-ef630a68538f\") " pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.824645 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.824608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wbq7\" (UniqueName: \"kubernetes.io/projected/dce27635-01c3-4947-aafb-ef630a68538f-kube-api-access-9wbq7\") pod \"authorino-84d488899c-vx67n\" (UID: \"dce27635-01c3-4947-aafb-ef630a68538f\") " pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.824820 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.824668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce27635-01c3-4947-aafb-ef630a68538f-tls-cert\") pod \"authorino-84d488899c-vx67n\" (UID: \"dce27635-01c3-4947-aafb-ef630a68538f\") " pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.827519 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.827489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dce27635-01c3-4947-aafb-ef630a68538f-tls-cert\") pod \"authorino-84d488899c-vx67n\" (UID: \"dce27635-01c3-4947-aafb-ef630a68538f\") " pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.832729 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.832699    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wbq7\" (UniqueName: \"kubernetes.io/projected/dce27635-01c3-4947-aafb-ef630a68538f-kube-api-access-9wbq7\") pod \"authorino-84d488899c-vx67n\" (UID: \"dce27635-01c3-4947-aafb-ef630a68538f\") " pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:04.951734 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:04.951634    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84d488899c-vx67n"
Jul 26 15:31:05.094103 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:05.094073    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84d488899c-vx67n"]
Jul 26 15:31:05.096279 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:31:05.096251    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddce27635_01c3_4947_aafb_ef630a68538f.slice/crio-b3a0938ed372d70a2ed5fea872c370a44166102423edfc476c1fc12bb09812e7 WatchSource:0}: Error finding container b3a0938ed372d70a2ed5fea872c370a44166102423edfc476c1fc12bb09812e7: Status 404 returned error can't find the container with id b3a0938ed372d70a2ed5fea872c370a44166102423edfc476c1fc12bb09812e7
Jul 26 15:31:05.692259 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:05.692212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84d488899c-vx67n" event={"ID":"dce27635-01c3-4947-aafb-ef630a68538f","Type":"ContainerStarted","Data":"7d672b40aec36a4aad896a9698d868d98395bebb512d82df8b4d3fa4fe953dad"}
Jul 26 15:31:05.692710 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:05.692267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84d488899c-vx67n" event={"ID":"dce27635-01c3-4947-aafb-ef630a68538f","Type":"ContainerStarted","Data":"b3a0938ed372d70a2ed5fea872c370a44166102423edfc476c1fc12bb09812e7"}
Jul 26 15:31:05.709466 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:05.709398    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84d488899c-vx67n" podStartSLOduration=1.313105771 podStartE2EDuration="1.709379637s" totalImagesPullingTime="396.273866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:31:05.707960386 +0000 UTC m=+775.069460190" watchObservedRunningTime="2026-07-26 15:31:05.709379637 +0000 UTC m=+775.070879442"
Jul 26 15:31:05.737265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:05.736807    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8677785964-cb7b4"]
Jul 26 15:31:05.737265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:05.737060    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8677785964-cb7b4" podUID="aa9bf408-a019-4e87-9502-1a28c124d2bf" containerName="authorino" containerID="cri-o://49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be" gracePeriod=30
Jul 26 15:31:06.000422 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.000395    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:31:06.033738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.033655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa9bf408-a019-4e87-9502-1a28c124d2bf-tls-cert\") pod \"aa9bf408-a019-4e87-9502-1a28c124d2bf\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") "
Jul 26 15:31:06.033738 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.033736    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt7rp\" (UniqueName: \"kubernetes.io/projected/aa9bf408-a019-4e87-9502-1a28c124d2bf-kube-api-access-bt7rp\") pod \"aa9bf408-a019-4e87-9502-1a28c124d2bf\" (UID: \"aa9bf408-a019-4e87-9502-1a28c124d2bf\") "
Jul 26 15:31:06.036253 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.036215    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9bf408-a019-4e87-9502-1a28c124d2bf-kube-api-access-bt7rp" (OuterVolumeSpecName: "kube-api-access-bt7rp") pod "aa9bf408-a019-4e87-9502-1a28c124d2bf" (UID: "aa9bf408-a019-4e87-9502-1a28c124d2bf"). InnerVolumeSpecName "kube-api-access-bt7rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:31:06.047386 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.047353    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa9bf408-a019-4e87-9502-1a28c124d2bf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "aa9bf408-a019-4e87-9502-1a28c124d2bf" (UID: "aa9bf408-a019-4e87-9502-1a28c124d2bf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:31:06.135282 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.135245    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa9bf408-a019-4e87-9502-1a28c124d2bf-tls-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:31:06.135282 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.135279    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt7rp\" (UniqueName: \"kubernetes.io/projected/aa9bf408-a019-4e87-9502-1a28c124d2bf-kube-api-access-bt7rp\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:31:06.698914 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.698873    2561 generic.go:356] "Generic (PLEG): container finished" podID="aa9bf408-a019-4e87-9502-1a28c124d2bf" containerID="49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be" exitCode=0
Jul 26 15:31:06.698914 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.698908    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8677785964-cb7b4"
Jul 26 15:31:06.699420 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.698957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8677785964-cb7b4" event={"ID":"aa9bf408-a019-4e87-9502-1a28c124d2bf","Type":"ContainerDied","Data":"49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be"}
Jul 26 15:31:06.699420 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.698998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8677785964-cb7b4" event={"ID":"aa9bf408-a019-4e87-9502-1a28c124d2bf","Type":"ContainerDied","Data":"9dcaa17b34412f3d8cb2d7584a935fe13495fc321d0fd7ad5e19447ee8610cd5"}
Jul 26 15:31:06.699420 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.699017    2561 scope.go:117] "RemoveContainer" containerID="49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be"
Jul 26 15:31:06.708638 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.708621    2561 scope.go:117] "RemoveContainer" containerID="49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be"
Jul 26 15:31:06.708904 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:31:06.708883    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be\": container with ID starting with 49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be not found: ID does not exist" containerID="49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be"
Jul 26 15:31:06.709018 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.708910    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be"} err="failed to get container status \"49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be\": rpc error: code = NotFound desc = could not find container \"49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be\": container with ID starting with 49fd71cc61c43533942e3ded5781252bdd408042472741c0d1c8286fc3b665be not found: ID does not exist"
Jul 26 15:31:06.720990 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.720963    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8677785964-cb7b4"]
Jul 26 15:31:06.728832 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:06.728809    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8677785964-cb7b4"]
Jul 26 15:31:07.105424 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:31:07.105394    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9bf408-a019-4e87-9502-1a28c124d2bf" path="/var/lib/kubelet/pods/aa9bf408-a019-4e87-9502-1a28c124d2bf/volumes"
Jul 26 15:37:54.613566 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:54.613527    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"]
Jul 26 15:37:54.614146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:54.613742    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r" podUID="568e7959-f016-4239-b816-571afc74a47e" containerName="manager" containerID="cri-o://60a6ebbed88a642da6f859804bec2e3a3688b75492509cbdc0d1992b2cc3f465" gracePeriod=10
Jul 26 15:37:57.901599 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:57.901565    2561 generic.go:356] "Generic (PLEG): container finished" podID="568e7959-f016-4239-b816-571afc74a47e" containerID="60a6ebbed88a642da6f859804bec2e3a3688b75492509cbdc0d1992b2cc3f465" exitCode=0
Jul 26 15:37:57.902010 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:57.901640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r" event={"ID":"568e7959-f016-4239-b816-571afc74a47e","Type":"ContainerDied","Data":"60a6ebbed88a642da6f859804bec2e3a3688b75492509cbdc0d1992b2cc3f465"}
Jul 26 15:37:58.066634 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.066610    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:37:58.117642 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.117613    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/568e7959-f016-4239-b816-571afc74a47e-extensions-socket-volume\") pod \"568e7959-f016-4239-b816-571afc74a47e\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") "
Jul 26 15:37:58.117869 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.117735    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6tv5\" (UniqueName: \"kubernetes.io/projected/568e7959-f016-4239-b816-571afc74a47e-kube-api-access-k6tv5\") pod \"568e7959-f016-4239-b816-571afc74a47e\" (UID: \"568e7959-f016-4239-b816-571afc74a47e\") "
Jul 26 15:37:58.117988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.117967    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/568e7959-f016-4239-b816-571afc74a47e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "568e7959-f016-4239-b816-571afc74a47e" (UID: "568e7959-f016-4239-b816-571afc74a47e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:37:58.119920 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.119893    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/568e7959-f016-4239-b816-571afc74a47e-kube-api-access-k6tv5" (OuterVolumeSpecName: "kube-api-access-k6tv5") pod "568e7959-f016-4239-b816-571afc74a47e" (UID: "568e7959-f016-4239-b816-571afc74a47e"). InnerVolumeSpecName "kube-api-access-k6tv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:37:58.219411 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.219311    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/568e7959-f016-4239-b816-571afc74a47e-extensions-socket-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:37:58.219411 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.219355    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6tv5\" (UniqueName: \"kubernetes.io/projected/568e7959-f016-4239-b816-571afc74a47e-kube-api-access-k6tv5\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:37:58.909012 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.908967    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"
Jul 26 15:37:58.909500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.909005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r" event={"ID":"568e7959-f016-4239-b816-571afc74a47e","Type":"ContainerDied","Data":"2e98f292a6507b6c8289b4e519028ef89e5dd4ae68549a3e7cb702d923e28e06"}
Jul 26 15:37:58.909500 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.909083    2561 scope.go:117] "RemoveContainer" containerID="60a6ebbed88a642da6f859804bec2e3a3688b75492509cbdc0d1992b2cc3f465"
Jul 26 15:37:58.931005 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.930981    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"]
Jul 26 15:37:58.935980 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:58.935956    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jft7r"]
Jul 26 15:37:59.105013 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:37:59.104978    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="568e7959-f016-4239-b816-571afc74a47e" path="/var/lib/kubelet/pods/568e7959-f016-4239-b816-571afc74a47e/volumes"
Jul 26 15:38:55.751752 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.751715    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"]
Jul 26 15:38:55.754243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.752076    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9bf408-a019-4e87-9502-1a28c124d2bf" containerName="authorino"
Jul 26 15:38:55.754243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.752105    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9bf408-a019-4e87-9502-1a28c124d2bf" containerName="authorino"
Jul 26 15:38:55.754243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.752115    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="568e7959-f016-4239-b816-571afc74a47e" containerName="manager"
Jul 26 15:38:55.754243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.752120    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="568e7959-f016-4239-b816-571afc74a47e" containerName="manager"
Jul 26 15:38:55.754243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.752175    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="568e7959-f016-4239-b816-571afc74a47e" containerName="manager"
Jul 26 15:38:55.754243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.752185    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9bf408-a019-4e87-9502-1a28c124d2bf" containerName="authorino"
Jul 26 15:38:55.755254 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.755239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:55.757949 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.757918    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hwfpn\""
Jul 26 15:38:55.767372 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.767346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"]
Jul 26 15:38:55.821971 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.821903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9kbt\" (UniqueName: \"kubernetes.io/projected/a7cec265-5555-4a41-84a5-281bf5c49c1d-kube-api-access-g9kbt\") pod \"kuadrant-operator-controller-manager-86878c769f-lhrrc\" (UID: \"a7cec265-5555-4a41-84a5-281bf5c49c1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:55.822141 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.822018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7cec265-5555-4a41-84a5-281bf5c49c1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lhrrc\" (UID: \"a7cec265-5555-4a41-84a5-281bf5c49c1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:55.923483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.923438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9kbt\" (UniqueName: \"kubernetes.io/projected/a7cec265-5555-4a41-84a5-281bf5c49c1d-kube-api-access-g9kbt\") pod \"kuadrant-operator-controller-manager-86878c769f-lhrrc\" (UID: \"a7cec265-5555-4a41-84a5-281bf5c49c1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:55.923669 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.923498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7cec265-5555-4a41-84a5-281bf5c49c1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lhrrc\" (UID: \"a7cec265-5555-4a41-84a5-281bf5c49c1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:55.923902 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.923884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7cec265-5555-4a41-84a5-281bf5c49c1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lhrrc\" (UID: \"a7cec265-5555-4a41-84a5-281bf5c49c1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:55.935357 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:55.935322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9kbt\" (UniqueName: \"kubernetes.io/projected/a7cec265-5555-4a41-84a5-281bf5c49c1d-kube-api-access-g9kbt\") pod \"kuadrant-operator-controller-manager-86878c769f-lhrrc\" (UID: \"a7cec265-5555-4a41-84a5-281bf5c49c1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:56.065114 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:56.065028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:56.205201 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:56.205162    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"]
Jul 26 15:38:56.208262 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:38:56.208233    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cec265_5555_4a41_84a5_281bf5c49c1d.slice/crio-35c102fe5644d053c6bec6c23a9cfa7262114fa5c67f8130ccc3b88094cd729e WatchSource:0}: Error finding container 35c102fe5644d053c6bec6c23a9cfa7262114fa5c67f8130ccc3b88094cd729e: Status 404 returned error can't find the container with id 35c102fe5644d053c6bec6c23a9cfa7262114fa5c67f8130ccc3b88094cd729e
Jul 26 15:38:57.219523 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:57.219485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc" event={"ID":"a7cec265-5555-4a41-84a5-281bf5c49c1d","Type":"ContainerStarted","Data":"2cef6268b00d307f661dad68e1a1ac085a6367248f3aeaa0e4b388a34af914b9"}
Jul 26 15:38:57.219987 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:57.219540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc" event={"ID":"a7cec265-5555-4a41-84a5-281bf5c49c1d","Type":"ContainerStarted","Data":"35c102fe5644d053c6bec6c23a9cfa7262114fa5c67f8130ccc3b88094cd729e"}
Jul 26 15:38:57.219987 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:57.219560    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:38:57.241024 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:38:57.240969    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc" podStartSLOduration=2.240952894 podStartE2EDuration="2.240952894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:38:57.238357213 +0000 UTC m=+1246.599857017" watchObservedRunningTime="2026-07-26 15:38:57.240952894 +0000 UTC m=+1246.602452696"
Jul 26 15:39:08.226968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:39:08.226910    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lhrrc"
Jul 26 15:41:43.786747 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.786713    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"]
Jul 26 15:41:43.790379 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.790355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.793082 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.793055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-54ca8f82-kserve-self-signed-certs\""
Jul 26 15:41:43.805232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.805199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"]
Jul 26 15:41:43.886900 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.886866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tls-certs\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.887115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.886974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-home\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.887115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.887018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4lr\" (UniqueName: \"kubernetes.io/projected/b9e024f4-72be-4483-acf0-63ee9c30c7ec-kube-api-access-zk4lr\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.887115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.887048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tmp-dir\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.887115 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.887095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-model-cache\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.887297 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.887122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-dshm\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988046 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-home\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988239 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4lr\" (UniqueName: \"kubernetes.io/projected/b9e024f4-72be-4483-acf0-63ee9c30c7ec-kube-api-access-zk4lr\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988239 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tmp-dir\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988359 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-model-cache\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988359 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-dshm\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988359 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988317    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tls-certs\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988581 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-home\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988581 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988517    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tmp-dir\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.988671 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.988606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-model-cache\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.990728 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.990700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-dshm\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.990866 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.990851    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tls-certs\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:43.996138 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:43.996113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4lr\" (UniqueName: \"kubernetes.io/projected/b9e024f4-72be-4483-acf0-63ee9c30c7ec-kube-api-access-zk4lr\") pod \"e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") " pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:44.100141 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:44.100046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:44.242262 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:44.242233    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"]
Jul 26 15:41:44.243767 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:41:44.243739    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9e024f4_72be_4483_acf0_63ee9c30c7ec.slice/crio-ef641174b4425e3d8f70047242f293efd327c1946bf0b137fba298103cb1d27b WatchSource:0}: Error finding container ef641174b4425e3d8f70047242f293efd327c1946bf0b137fba298103cb1d27b: Status 404 returned error can't find the container with id ef641174b4425e3d8f70047242f293efd327c1946bf0b137fba298103cb1d27b
Jul 26 15:41:45.111578 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:45.111544    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt" event={"ID":"b9e024f4-72be-4483-acf0-63ee9c30c7ec","Type":"ContainerStarted","Data":"676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411"}
Jul 26 15:41:45.111982 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:45.111585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt" event={"ID":"b9e024f4-72be-4483-acf0-63ee9c30c7ec","Type":"ContainerStarted","Data":"ef641174b4425e3d8f70047242f293efd327c1946bf0b137fba298103cb1d27b"}
Jul 26 15:41:45.129546 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:45.129498    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt" podStartSLOduration=2.129481451 podStartE2EDuration="2.129481451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:41:45.127183339 +0000 UTC m=+1414.488683144" watchObservedRunningTime="2026-07-26 15:41:45.129481451 +0000 UTC m=+1414.490981255"
Jul 26 15:41:54.101119 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:54.101016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:54.101119 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:54.101109    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:54.113984 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:54.113950    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:41:54.170114 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:41:54.170082    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:42:15.268965 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:15.268859    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"]
Jul 26 15:42:30.289233 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.289168    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt" podUID="b9e024f4-72be-4483-acf0-63ee9c30c7ec" containerName="main" containerID="cri-o://676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411" gracePeriod=45
Jul 26 15:42:30.567656 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.567614    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:42:30.717689 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717649    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tmp-dir\") pod \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") "
Jul 26 15:42:30.717896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-model-cache\") pod \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") "
Jul 26 15:42:30.717896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717738    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-home\") pod \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") "
Jul 26 15:42:30.717896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk4lr\" (UniqueName: \"kubernetes.io/projected/b9e024f4-72be-4483-acf0-63ee9c30c7ec-kube-api-access-zk4lr\") pod \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") "
Jul 26 15:42:30.717896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717802    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tls-certs\") pod \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") "
Jul 26 15:42:30.717896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-dshm\") pod \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\" (UID: \"b9e024f4-72be-4483-acf0-63ee9c30c7ec\") "
Jul 26 15:42:30.718172 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.717970    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9e024f4-72be-4483-acf0-63ee9c30c7ec" (UID: "b9e024f4-72be-4483-acf0-63ee9c30c7ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:42:30.718172 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.718062    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-home" (OuterVolumeSpecName: "home") pod "b9e024f4-72be-4483-acf0-63ee9c30c7ec" (UID: "b9e024f4-72be-4483-acf0-63ee9c30c7ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:42:30.718352 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.718189    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:42:30.718352 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.718209    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:42:30.718352 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.718289    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9e024f4-72be-4483-acf0-63ee9c30c7ec" (UID: "b9e024f4-72be-4483-acf0-63ee9c30c7ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:42:30.720602 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.720573    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e024f4-72be-4483-acf0-63ee9c30c7ec-kube-api-access-zk4lr" (OuterVolumeSpecName: "kube-api-access-zk4lr") pod "b9e024f4-72be-4483-acf0-63ee9c30c7ec" (UID: "b9e024f4-72be-4483-acf0-63ee9c30c7ec"). InnerVolumeSpecName "kube-api-access-zk4lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:42:30.720796 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.720776    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-dshm" (OuterVolumeSpecName: "dshm") pod "b9e024f4-72be-4483-acf0-63ee9c30c7ec" (UID: "b9e024f4-72be-4483-acf0-63ee9c30c7ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:42:30.720857 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.720834    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9e024f4-72be-4483-acf0-63ee9c30c7ec" (UID: "b9e024f4-72be-4483-acf0-63ee9c30c7ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:42:30.819265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.819174    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:42:30.819265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.819207    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk4lr\" (UniqueName: \"kubernetes.io/projected/b9e024f4-72be-4483-acf0-63ee9c30c7ec-kube-api-access-zk4lr\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:42:30.819265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.819220    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e024f4-72be-4483-acf0-63ee9c30c7ec-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:42:30.819265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:30.819230    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e024f4-72be-4483-acf0-63ee9c30c7ec-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:42:31.365365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.365273    2561 generic.go:356] "Generic (PLEG): container finished" podID="b9e024f4-72be-4483-acf0-63ee9c30c7ec" containerID="676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411" exitCode=0
Jul 26 15:42:31.365365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.365322    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"
Jul 26 15:42:31.365365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.365330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt" event={"ID":"b9e024f4-72be-4483-acf0-63ee9c30c7ec","Type":"ContainerDied","Data":"676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411"}
Jul 26 15:42:31.365845 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.365368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt" event={"ID":"b9e024f4-72be-4483-acf0-63ee9c30c7ec","Type":"ContainerDied","Data":"ef641174b4425e3d8f70047242f293efd327c1946bf0b137fba298103cb1d27b"}
Jul 26 15:42:31.365845 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.365390    2561 scope.go:117] "RemoveContainer" containerID="676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411"
Jul 26 15:42:31.374354 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.374337    2561 scope.go:117] "RemoveContainer" containerID="676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411"
Jul 26 15:42:31.374640 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:42:31.374620    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411\": container with ID starting with 676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411 not found: ID does not exist" containerID="676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411"
Jul 26 15:42:31.374739 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.374648    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411"} err="failed to get container status \"676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411\": rpc error: code = NotFound desc = could not find container \"676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411\": container with ID starting with 676f20d1a3a3641b91a54fe711267392d07b36f19bb37e7353492d10a970a411 not found: ID does not exist"
Jul 26 15:42:31.384469 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.384439    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"]
Jul 26 15:42:31.388528 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:31.388502    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-54ca8f82-kserve-75876f458c-flgpt"]
Jul 26 15:42:33.104370 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:42:33.104335    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e024f4-72be-4483-acf0-63ee9c30c7ec" path="/var/lib/kubelet/pods/b9e024f4-72be-4483-acf0-63ee9c30c7ec/volumes"
Jul 26 15:46:02.555621 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.555582    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"]
Jul 26 15:46:02.556215 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.556195    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e024f4-72be-4483-acf0-63ee9c30c7ec" containerName="main"
Jul 26 15:46:02.556295 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.556218    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e024f4-72be-4483-acf0-63ee9c30c7ec" containerName="main"
Jul 26 15:46:02.556345 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.556313    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e024f4-72be-4483-acf0-63ee9c30c7ec" containerName="main"
Jul 26 15:46:02.559575 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.559554    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.562254 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.562232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6440646a-openshift-default-dockercfg-m9tjt\""
Jul 26 15:46:02.570145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.570125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"]
Jul 26 15:46:02.615720 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-credential-socket\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.615720 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-envoy\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.615924 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-certs\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.615924 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-podinfo\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.615924 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-data\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.615924 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzp8k\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-kube-api-access-qzp8k\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.615924 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-socket\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.616146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-token\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.616146 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.615985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4df811c-0340-48c4-96d2-02cc3fbaa191-istiod-ca-cert\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717036 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzp8k\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-kube-api-access-qzp8k\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717220 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-socket\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717220 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-token\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717220 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4df811c-0340-48c4-96d2-02cc3fbaa191-istiod-ca-cert\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717220 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-credential-socket\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717220 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-envoy\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717220 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-certs\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717559 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-podinfo\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717559 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-data\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717559 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-socket\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717671    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-credential-socket\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717709    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-certs\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.717884 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.717869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-data\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.718176 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.718153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4df811c-0340-48c4-96d2-02cc3fbaa191-istiod-ca-cert\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.719829 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.719808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-envoy\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.720170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.720148    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-podinfo\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.725304 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.725260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-token\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.725457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.725436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzp8k\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-kube-api-access-qzp8k\") pod \"e2e-ait-6440646a-openshift-default-576f69c878-69rm2\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") " pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:02.869976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:02.869859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:03.013214 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.013189    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"]
Jul 26 15:46:03.014857 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:46:03.014831    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4df811c_0340_48c4_96d2_02cc3fbaa191.slice/crio-bbad230e7c386a12bc63f07fc3a603a715cf75833fed8712ad5fbbece15f41b1 WatchSource:0}: Error finding container bbad230e7c386a12bc63f07fc3a603a715cf75833fed8712ad5fbbece15f41b1: Status 404 returned error can't find the container with id bbad230e7c386a12bc63f07fc3a603a715cf75833fed8712ad5fbbece15f41b1
Jul 26 15:46:03.017045 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.017009    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:46:03.017162 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.017077    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:46:03.017162 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.017105    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:46:03.511287 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.511248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" event={"ID":"c4df811c-0340-48c4-96d2-02cc3fbaa191","Type":"ContainerStarted","Data":"8d6f86d4efc85f23d3c43b7ff07b6012ecccd07a0d8c96b6200fcc10f3a5a913"}
Jul 26 15:46:03.511478 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.511312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" event={"ID":"c4df811c-0340-48c4-96d2-02cc3fbaa191","Type":"ContainerStarted","Data":"bbad230e7c386a12bc63f07fc3a603a715cf75833fed8712ad5fbbece15f41b1"}
Jul 26 15:46:03.539732 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.539677    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" podStartSLOduration=1.5396615580000002 podStartE2EDuration="1.539661558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:46:03.537259257 +0000 UTC m=+1672.898759084" watchObservedRunningTime="2026-07-26 15:46:03.539661558 +0000 UTC m=+1672.901161359"
Jul 26 15:46:03.870627 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:03.870527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:04.877118 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:04.877083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:05.521882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:05.521843    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:05.522957 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:05.522911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:16.588360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:16.588328    2561 generic.go:356] "Generic (PLEG): container finished" podID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerID="8d6f86d4efc85f23d3c43b7ff07b6012ecccd07a0d8c96b6200fcc10f3a5a913" exitCode=0
Jul 26 15:46:16.588780 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:16.588390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" event={"ID":"c4df811c-0340-48c4-96d2-02cc3fbaa191","Type":"ContainerDied","Data":"8d6f86d4efc85f23d3c43b7ff07b6012ecccd07a0d8c96b6200fcc10f3a5a913"}
Jul 26 15:46:16.588780 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:16.588770    2561 scope.go:117] "RemoveContainer" containerID="8d6f86d4efc85f23d3c43b7ff07b6012ecccd07a0d8c96b6200fcc10f3a5a913"
Jul 26 15:46:16.589781 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:16.589749    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:46:16.589897 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:16.589832    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:46:16.589897 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:16.589876    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 15:46:17.595334 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:17.595289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" event={"ID":"c4df811c-0340-48c4-96d2-02cc3fbaa191","Type":"ContainerStarted","Data":"90f11b14b48bf6756f6d19b6941960d342045c1d93ce2f54b017059d454224e3"}
Jul 26 15:46:17.870254 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:17.870157    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:17.871323 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:17.871296    2561 patch_prober.go:28] interesting pod/e2e-ait-6440646a-openshift-default-576f69c878-69rm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 26 15:46:17.871453 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:17.871358    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 26 15:46:18.870504 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:18.870471    2561 patch_prober.go:28] interesting pod/e2e-ait-6440646a-openshift-default-576f69c878-69rm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 26 15:46:18.870892 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:18.870527    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 26 15:46:19.870808 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:19.870771    2561 patch_prober.go:28] interesting pod/e2e-ait-6440646a-openshift-default-576f69c878-69rm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 26 15:46:19.871217 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:19.870829    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 26 15:46:20.521783 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:20.521749    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:20.870981 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:20.870880    2561 patch_prober.go:28] interesting pod/e2e-ait-6440646a-openshift-default-576f69c878-69rm2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 26 15:46:20.871377 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:20.870977    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 26 15:46:21.875639 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:21.875607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:21.876824 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:21.876803    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:45.596870 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:45.596831    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"]
Jul 26 15:46:45.597525 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:45.597081    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy" containerID="cri-o://90f11b14b48bf6756f6d19b6941960d342045c1d93ce2f54b017059d454224e3" gracePeriod=30
Jul 26 15:46:50.771657 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.771388    2561 generic.go:356] "Generic (PLEG): container finished" podID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerID="90f11b14b48bf6756f6d19b6941960d342045c1d93ce2f54b017059d454224e3" exitCode=0
Jul 26 15:46:50.771657 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.771490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" event={"ID":"c4df811c-0340-48c4-96d2-02cc3fbaa191","Type":"ContainerDied","Data":"90f11b14b48bf6756f6d19b6941960d342045c1d93ce2f54b017059d454224e3"}
Jul 26 15:46:50.771657 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.771557    2561 scope.go:117] "RemoveContainer" containerID="8d6f86d4efc85f23d3c43b7ff07b6012ecccd07a0d8c96b6200fcc10f3a5a913"
Jul 26 15:46:50.856683 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.856660    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:50.953896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.953791    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-data\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.953896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.953858    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-podinfo\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.953896 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.953885    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-credential-socket\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.953905    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzp8k\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-kube-api-access-qzp8k\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.953996    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-envoy\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954055    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-token\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954098    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-socket\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-certs\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954199 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4df811c-0340-48c4-96d2-02cc3fbaa191-istiod-ca-cert\") pod \"c4df811c-0340-48c4-96d2-02cc3fbaa191\" (UID: \"c4df811c-0340-48c4-96d2-02cc3fbaa191\") "
Jul 26 15:46:50.954529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954246    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:46:50.954529 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954499    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-credential-socket\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:50.954646 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954538    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4df811c-0340-48c4-96d2-02cc3fbaa191-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:46:50.954716 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954629    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:46:50.954716 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.954688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:46:50.955113 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.955088    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:46:50.956276 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.956254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 15:46:50.956530 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.956509    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:46:50.956873 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.956852    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:46:50.957004 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:50.956885    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-kube-api-access-qzp8k" (OuterVolumeSpecName: "kube-api-access-qzp8k") pod "c4df811c-0340-48c4-96d2-02cc3fbaa191" (UID: "c4df811c-0340-48c4-96d2-02cc3fbaa191"). InnerVolumeSpecName "kube-api-access-qzp8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:46:51.055175 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055137    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-socket\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055175 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055171    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-workload-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055175 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055183    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4df811c-0340-48c4-96d2-02cc3fbaa191-istiod-ca-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055426 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055194    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055426 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055205    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-podinfo\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055426 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055215    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzp8k\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-kube-api-access-qzp8k\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055426 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055228    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-envoy\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.055426 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.055238    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4df811c-0340-48c4-96d2-02cc3fbaa191-istio-token\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:46:51.777757 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.777723    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"
Jul 26 15:46:51.777757 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.777745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2" event={"ID":"c4df811c-0340-48c4-96d2-02cc3fbaa191","Type":"ContainerDied","Data":"bbad230e7c386a12bc63f07fc3a603a715cf75833fed8712ad5fbbece15f41b1"}
Jul 26 15:46:51.778332 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.777807    2561 scope.go:117] "RemoveContainer" containerID="90f11b14b48bf6756f6d19b6941960d342045c1d93ce2f54b017059d454224e3"
Jul 26 15:46:51.796903 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.796877    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"]
Jul 26 15:46:51.803297 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:51.803271    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6440646a-openshift-default-576f69c878-69rm2"]
Jul 26 15:46:53.104681 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:46:53.104641    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" path="/var/lib/kubelet/pods/c4df811c-0340-48c4-96d2-02cc3fbaa191/volumes"
Jul 26 15:51:47.986712 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.986676    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"]
Jul 26 15:51:47.988994 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.987033    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy"
Jul 26 15:51:47.988994 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.987045    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy"
Jul 26 15:51:47.988994 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.987057    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy"
Jul 26 15:51:47.988994 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.987064    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy"
Jul 26 15:51:47.988994 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.987127    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy"
Jul 26 15:51:47.990072 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.990056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:47.992720 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.992699    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-35feb3ab\"/\"openshift-service-ca.crt\""
Jul 26 15:51:47.994049 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.994024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-35feb3ab\"/\"e2e-lifecycle-model-35feb3ab-kserve-self-signed-certs\""
Jul 26 15:51:47.994162 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.994019    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-35feb3ab\"/\"default-dockercfg-ps6vh\""
Jul 26 15:51:47.994162 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.994143    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-35feb3ab\"/\"kube-root-ca.crt\""
Jul 26 15:51:48.000006 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:47.999984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"]
Jul 26 15:51:48.081058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.081025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2cfg\" (UniqueName: \"kubernetes.io/projected/363abb8d-6313-4756-a064-1efdad520b1e-kube-api-access-t2cfg\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.081232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.081073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-model-cache\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.081232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.081167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-home\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.081232 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.081209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363abb8d-6313-4756-a064-1efdad520b1e-tls-certs\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.081360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.081272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-tmp-dir\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.081360 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.081290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-dshm\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182287 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-tmp-dir\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182287 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-dshm\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2cfg\" (UniqueName: \"kubernetes.io/projected/363abb8d-6313-4756-a064-1efdad520b1e-kube-api-access-t2cfg\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-model-cache\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-home\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182536 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363abb8d-6313-4756-a064-1efdad520b1e-tls-certs\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182758 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182711    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-tmp-dir\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182804 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-model-cache\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.182804 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.182781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-home\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.184701 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.184677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-dshm\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.185056 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.185039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363abb8d-6313-4756-a064-1efdad520b1e-tls-certs\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.190827 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.190802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2cfg\" (UniqueName: \"kubernetes.io/projected/363abb8d-6313-4756-a064-1efdad520b1e-kube-api-access-t2cfg\") pod \"e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") " pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.300295 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.300252    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:48.440179 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:48.440145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"]
Jul 26 15:51:48.442043 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:51:48.442014    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod363abb8d_6313_4756_a064_1efdad520b1e.slice/crio-90b47db5946da50e2a04e982b50fd2269275152eb48e3a734f96239f76a28ee1 WatchSource:0}: Error finding container 90b47db5946da50e2a04e982b50fd2269275152eb48e3a734f96239f76a28ee1: Status 404 returned error can't find the container with id 90b47db5946da50e2a04e982b50fd2269275152eb48e3a734f96239f76a28ee1
Jul 26 15:51:49.350877 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:49.350840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn" event={"ID":"363abb8d-6313-4756-a064-1efdad520b1e","Type":"ContainerStarted","Data":"0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2"}
Jul 26 15:51:49.350877 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:49.350884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn" event={"ID":"363abb8d-6313-4756-a064-1efdad520b1e","Type":"ContainerStarted","Data":"90b47db5946da50e2a04e982b50fd2269275152eb48e3a734f96239f76a28ee1"}
Jul 26 15:51:49.367324 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:49.367281    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn" podStartSLOduration=2.367261785 podStartE2EDuration="2.367261785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:49.366002365 +0000 UTC m=+2018.727502168" watchObservedRunningTime="2026-07-26 15:51:49.367261785 +0000 UTC m=+2018.728761579"
Jul 26 15:51:58.300651 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:58.300611    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:58.301085 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:58.300669    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:58.313638 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:58.313607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:51:58.410746 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:51:58.410717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:52:52.052541 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:52:52.052501    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"]
Jul 26 15:53:07.072330 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.072263    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn" podUID="363abb8d-6313-4756-a064-1efdad520b1e" containerName="main" containerID="cri-o://0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2" gracePeriod=45
Jul 26 15:53:07.335409 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.335346    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:53:07.482835 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.482802    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-tmp-dir\") pod \"363abb8d-6313-4756-a064-1efdad520b1e\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") "
Jul 26 15:53:07.483049 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.482857    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-model-cache\") pod \"363abb8d-6313-4756-a064-1efdad520b1e\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") "
Jul 26 15:53:07.483049 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.482911    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2cfg\" (UniqueName: \"kubernetes.io/projected/363abb8d-6313-4756-a064-1efdad520b1e-kube-api-access-t2cfg\") pod \"363abb8d-6313-4756-a064-1efdad520b1e\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") "
Jul 26 15:53:07.483049 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.482964    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-home\") pod \"363abb8d-6313-4756-a064-1efdad520b1e\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") "
Jul 26 15:53:07.483049 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483030    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363abb8d-6313-4756-a064-1efdad520b1e-tls-certs\") pod \"363abb8d-6313-4756-a064-1efdad520b1e\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") "
Jul 26 15:53:07.483273 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483072    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-dshm\") pod \"363abb8d-6313-4756-a064-1efdad520b1e\" (UID: \"363abb8d-6313-4756-a064-1efdad520b1e\") "
Jul 26 15:53:07.483273 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483167    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "363abb8d-6313-4756-a064-1efdad520b1e" (UID: "363abb8d-6313-4756-a064-1efdad520b1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:53:07.483273 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483256    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-home" (OuterVolumeSpecName: "home") pod "363abb8d-6313-4756-a064-1efdad520b1e" (UID: "363abb8d-6313-4756-a064-1efdad520b1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:53:07.483421 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "363abb8d-6313-4756-a064-1efdad520b1e" (UID: "363abb8d-6313-4756-a064-1efdad520b1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:53:07.483477 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483442    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:53:07.483477 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483462    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:53:07.483551 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.483476    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:53:07.485317 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.485282    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-dshm" (OuterVolumeSpecName: "dshm") pod "363abb8d-6313-4756-a064-1efdad520b1e" (UID: "363abb8d-6313-4756-a064-1efdad520b1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:53:07.485317 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.485295    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/363abb8d-6313-4756-a064-1efdad520b1e-kube-api-access-t2cfg" (OuterVolumeSpecName: "kube-api-access-t2cfg") pod "363abb8d-6313-4756-a064-1efdad520b1e" (UID: "363abb8d-6313-4756-a064-1efdad520b1e"). InnerVolumeSpecName "kube-api-access-t2cfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:53:07.485457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.485330    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/363abb8d-6313-4756-a064-1efdad520b1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "363abb8d-6313-4756-a064-1efdad520b1e" (UID: "363abb8d-6313-4756-a064-1efdad520b1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:53:07.584405 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.584368    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2cfg\" (UniqueName: \"kubernetes.io/projected/363abb8d-6313-4756-a064-1efdad520b1e-kube-api-access-t2cfg\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:53:07.584405 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.584399    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/363abb8d-6313-4756-a064-1efdad520b1e-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:53:07.584405 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.584409    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/363abb8d-6313-4756-a064-1efdad520b1e-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:53:07.772494 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.772457    2561 generic.go:356] "Generic (PLEG): container finished" podID="363abb8d-6313-4756-a064-1efdad520b1e" containerID="0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2" exitCode=0
Jul 26 15:53:07.772707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.772501    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"
Jul 26 15:53:07.772707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.772514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn" event={"ID":"363abb8d-6313-4756-a064-1efdad520b1e","Type":"ContainerDied","Data":"0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2"}
Jul 26 15:53:07.772707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.772558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn" event={"ID":"363abb8d-6313-4756-a064-1efdad520b1e","Type":"ContainerDied","Data":"90b47db5946da50e2a04e982b50fd2269275152eb48e3a734f96239f76a28ee1"}
Jul 26 15:53:07.772707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.772579    2561 scope.go:117] "RemoveContainer" containerID="0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2"
Jul 26 15:53:07.782259 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.782237    2561 scope.go:117] "RemoveContainer" containerID="0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2"
Jul 26 15:53:07.782523 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:53:07.782502    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2\": container with ID starting with 0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2 not found: ID does not exist" containerID="0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2"
Jul 26 15:53:07.782577 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.782533    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2"} err="failed to get container status \"0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2\": rpc error: code = NotFound desc = could not find container \"0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2\": container with ID starting with 0ead22c18d010df768852d740e7b15453f0c3b66f9e8b21145d447ffbaa907e2 not found: ID does not exist"
Jul 26 15:53:07.794551 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.794522    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"]
Jul 26 15:53:07.799981 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:07.799958    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-35feb3ab/e2e-lifecycle-model-35feb3ab-kserve-746799564c-b95sn"]
Jul 26 15:53:09.104441 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:53:09.104407    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="363abb8d-6313-4756-a064-1efdad520b1e" path="/var/lib/kubelet/pods/363abb8d-6313-4756-a064-1efdad520b1e/volumes"
Jul 26 15:54:42.584209 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.584169    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"]
Jul 26 15:54:42.584655 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.584525    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363abb8d-6313-4756-a064-1efdad520b1e" containerName="main"
Jul 26 15:54:42.584655 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.584537    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="363abb8d-6313-4756-a064-1efdad520b1e" containerName="main"
Jul 26 15:54:42.584655 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.584602    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4df811c-0340-48c4-96d2-02cc3fbaa191" containerName="istio-proxy"
Jul 26 15:54:42.584655 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.584613    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="363abb8d-6313-4756-a064-1efdad520b1e" containerName="main"
Jul 26 15:54:42.588172 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.588151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.591145 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.591119    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-8c61fd-dockercfg-98fnd\""
Jul 26 15:54:42.591302 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.591179    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-8c61fd\""
Jul 26 15:54:42.597473 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.597449    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"]
Jul 26 15:54:42.757795 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.757757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71c38af3-2584-4bf9-bc80-387aa0fb02b4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.758044 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.757829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4sc\" (UniqueName: \"kubernetes.io/projected/71c38af3-2584-4bf9-bc80-387aa0fb02b4-kube-api-access-nw4sc\") pod \"payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.859389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.859287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71c38af3-2584-4bf9-bc80-387aa0fb02b4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.859389 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.859365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4sc\" (UniqueName: \"kubernetes.io/projected/71c38af3-2584-4bf9-bc80-387aa0fb02b4-kube-api-access-nw4sc\") pod \"payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.860087 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.860064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71c38af3-2584-4bf9-bc80-387aa0fb02b4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.869007 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.868974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4sc\" (UniqueName: \"kubernetes.io/projected/71c38af3-2584-4bf9-bc80-387aa0fb02b4-kube-api-access-nw4sc\") pod \"payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:42.899820 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:42.899761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:43.059197 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:43.059158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"]
Jul 26 15:54:43.060802 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:54:43.060773    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c38af3_2584_4bf9_bc80_387aa0fb02b4.slice/crio-17d87ec80077c79c65c4440725b902309e23cdf21c02821548cc5bdf6e07dbde WatchSource:0}: Error finding container 17d87ec80077c79c65c4440725b902309e23cdf21c02821548cc5bdf6e07dbde: Status 404 returned error can't find the container with id 17d87ec80077c79c65c4440725b902309e23cdf21c02821548cc5bdf6e07dbde
Jul 26 15:54:43.063017 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:43.063000    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:54:43.286717 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:43.286680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6" event={"ID":"71c38af3-2584-4bf9-bc80-387aa0fb02b4","Type":"ContainerStarted","Data":"17d87ec80077c79c65c4440725b902309e23cdf21c02821548cc5bdf6e07dbde"}
Jul 26 15:54:45.301168 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:45.301128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6" event={"ID":"71c38af3-2584-4bf9-bc80-387aa0fb02b4","Type":"ContainerStarted","Data":"cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d"}
Jul 26 15:54:45.301600 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:45.301197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:54:45.316685 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:45.316627    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6" podStartSLOduration=1.6919211490000001 podStartE2EDuration="3.316610799s" totalImagesPullingTime="1.62468965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:54:45.316152457 +0000 UTC m=+2194.677652272" watchObservedRunningTime="2026-07-26 15:54:45.316610799 +0000 UTC m=+2194.678110603"
Jul 26 15:54:56.309121 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:54:56.309087    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:55:00.778291 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.778253    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"]
Jul 26 15:55:00.782668 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.782646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.785247 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.785213    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ff0984\"/\"openshift-service-ca.crt\""
Jul 26 15:55:00.785381 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.785324    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ff0984\"/\"kube-root-ca.crt\""
Jul 26 15:55:00.786430 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.786401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ff0984\"/\"default-dockercfg-djb4z\""
Jul 26 15:55:00.786526 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.786453    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ff0984\"/\"test-model-ff0984-kserve-self-signed-certs\""
Jul 26 15:55:00.791920 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.791898    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"]
Jul 26 15:55:00.799725 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.799700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cg29\" (UniqueName: \"kubernetes.io/projected/2ab9c70e-5cff-4053-a4a3-b7637f277f97-kube-api-access-6cg29\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.799827 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.799756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-model-cache\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.799827 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.799818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tls-certs\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.800060 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.799853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tmp-dir\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.800060 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.799886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-dshm\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.800060 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.799962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-home\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.900762 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.900729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tls-certs\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.900922 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.900772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tmp-dir\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.900922 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.900810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-dshm\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.900922 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.900861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-home\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.901099 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.901010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cg29\" (UniqueName: \"kubernetes.io/projected/2ab9c70e-5cff-4053-a4a3-b7637f277f97-kube-api-access-6cg29\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.901099 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.901080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-model-cache\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.901288 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.901250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-home\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.901288 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.901275    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tmp-dir\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.901472 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.901453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-model-cache\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.903359 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.903337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-dshm\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.903451 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.903438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tls-certs\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:00.910329 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:00.910302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cg29\" (UniqueName: \"kubernetes.io/projected/2ab9c70e-5cff-4053-a4a3-b7637f277f97-kube-api-access-6cg29\") pod \"test-model-ff0984-kserve-665f5d4d9f-ww952\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") " pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:01.092988 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:01.092870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:01.235882 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:01.235839    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"]
Jul 26 15:55:01.239777 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:55:01.239748    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ab9c70e_5cff_4053_a4a3_b7637f277f97.slice/crio-1f0cced1c10313027c178532ccb5ed843ff6d1d75e3bbe7a5ab69d1ceb44322c WatchSource:0}: Error finding container 1f0cced1c10313027c178532ccb5ed843ff6d1d75e3bbe7a5ab69d1ceb44322c: Status 404 returned error can't find the container with id 1f0cced1c10313027c178532ccb5ed843ff6d1d75e3bbe7a5ab69d1ceb44322c
Jul 26 15:55:01.397075 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:01.396977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952" event={"ID":"2ab9c70e-5cff-4053-a4a3-b7637f277f97","Type":"ContainerStarted","Data":"6bb430bb8f57df3cb24ad065e0cf3a50f7073e6e17e05efdcf7c229df6ec9f59"}
Jul 26 15:55:01.397075 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:01.397027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952" event={"ID":"2ab9c70e-5cff-4053-a4a3-b7637f277f97","Type":"ContainerStarted","Data":"1f0cced1c10313027c178532ccb5ed843ff6d1d75e3bbe7a5ab69d1ceb44322c"}
Jul 26 15:55:01.413590 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:01.413538    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952" podStartSLOduration=1.413523903 podStartE2EDuration="1.413523903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:01.413152312 +0000 UTC m=+2210.774652119" watchObservedRunningTime="2026-07-26 15:55:01.413523903 +0000 UTC m=+2210.775023706"
Jul 26 15:55:11.093368 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:11.093331    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:11.093759 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:11.093385    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:11.106722 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:11.106697    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:11.465310 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:11.465223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:55:19.789223 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.789184    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"]
Jul 26 15:55:19.792714 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.792695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.795400 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.795376    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8c61fd\"/\"kube-root-ca.crt\""
Jul 26 15:55:19.796588 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.796562    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8c61fd\"/\"openshift-service-ca.crt\""
Jul 26 15:55:19.796693 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.796592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8c61fd\"/\"test-model-8c61fd-kserve-self-signed-certs\""
Jul 26 15:55:19.796693 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.796624    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8c61fd\"/\"default-dockercfg-2ptzs\""
Jul 26 15:55:19.801062 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.801044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"]
Jul 26 15:55:19.876271 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.876237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-home\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.876271 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.876275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tmp-dir\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.876509 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.876374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-dshm\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.876509 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.876413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tls-certs\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.876509 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.876453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-model-cache\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.876636 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.876498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjpd\" (UniqueName: \"kubernetes.io/projected/3a1d7a31-622d-453f-bfe0-1636be5a2bce-kube-api-access-9kjpd\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978074 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-home\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978258 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tmp-dir\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978258 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-dshm\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978258 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tls-certs\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978258 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-model-cache\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978485 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjpd\" (UniqueName: \"kubernetes.io/projected/3a1d7a31-622d-453f-bfe0-1636be5a2bce-kube-api-access-9kjpd\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978540 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978517    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-home\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.978812 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.978783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-model-cache\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.979211 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.979189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tmp-dir\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.980665 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.980638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-dshm\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.980821 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.980805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tls-certs\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:19.986968 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:19.986946    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjpd\" (UniqueName: \"kubernetes.io/projected/3a1d7a31-622d-453f-bfe0-1636be5a2bce-kube-api-access-9kjpd\") pod \"test-model-8c61fd-kserve-6554df548f-d62bs\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") " pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:20.104305 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:20.104209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:20.252827 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:20.252797    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"]
Jul 26 15:55:20.254958 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:55:20.254910    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a1d7a31_622d_453f_bfe0_1636be5a2bce.slice/crio-4c1af2ae3519d155e3c2755cb9542d142096a315b2720f35acaeb6f144991354 WatchSource:0}: Error finding container 4c1af2ae3519d155e3c2755cb9542d142096a315b2720f35acaeb6f144991354: Status 404 returned error can't find the container with id 4c1af2ae3519d155e3c2755cb9542d142096a315b2720f35acaeb6f144991354
Jul 26 15:55:20.505001 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:20.504956    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs" event={"ID":"3a1d7a31-622d-453f-bfe0-1636be5a2bce","Type":"ContainerStarted","Data":"28eb2c6ec122810430c51f0e5fd943d01af5dd2d32f5f5bc246b08dc2d4d6b71"}
Jul 26 15:55:20.505175 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:20.505011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs" event={"ID":"3a1d7a31-622d-453f-bfe0-1636be5a2bce","Type":"ContainerStarted","Data":"4c1af2ae3519d155e3c2755cb9542d142096a315b2720f35acaeb6f144991354"}
Jul 26 15:55:20.522480 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:20.522429    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs" podStartSLOduration=1.522411132 podStartE2EDuration="1.522411132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:20.52068203 +0000 UTC m=+2229.882181834" watchObservedRunningTime="2026-07-26 15:55:20.522411132 +0000 UTC m=+2229.883910914"
Jul 26 15:55:30.104917 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:30.104872    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:30.105405 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:30.104956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:30.117660 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:30.117634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:55:30.574508 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:55:30.574479    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:56:00.558198 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:00.558160    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"]
Jul 26 15:56:01.564410 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:01.564371    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"]
Jul 26 15:56:15.579273 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.579234    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952" podUID="2ab9c70e-5cff-4053-a4a3-b7637f277f97" containerName="main" containerID="cri-o://6bb430bb8f57df3cb24ad065e0cf3a50f7073e6e17e05efdcf7c229df6ec9f59" gracePeriod=45
Jul 26 15:56:15.817056 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.817011    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ab9c70e-5cff-4053-a4a3-b7637f277f97" containerID="6bb430bb8f57df3cb24ad065e0cf3a50f7073e6e17e05efdcf7c229df6ec9f59" exitCode=0
Jul 26 15:56:15.817189 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.817075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952" event={"ID":"2ab9c70e-5cff-4053-a4a3-b7637f277f97","Type":"ContainerDied","Data":"6bb430bb8f57df3cb24ad065e0cf3a50f7073e6e17e05efdcf7c229df6ec9f59"}
Jul 26 15:56:15.841244 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.841184    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:56:15.905585 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905555    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tmp-dir\") pod \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") "
Jul 26 15:56:15.905774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905595    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-home\") pod \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") "
Jul 26 15:56:15.905774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905628    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cg29\" (UniqueName: \"kubernetes.io/projected/2ab9c70e-5cff-4053-a4a3-b7637f277f97-kube-api-access-6cg29\") pod \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") "
Jul 26 15:56:15.905774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905664    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-dshm\") pod \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") "
Jul 26 15:56:15.905774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-model-cache\") pod \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") "
Jul 26 15:56:15.905774 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905709    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tls-certs\") pod \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\" (UID: \"2ab9c70e-5cff-4053-a4a3-b7637f277f97\") "
Jul 26 15:56:15.906058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905877    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-home" (OuterVolumeSpecName: "home") pod "2ab9c70e-5cff-4053-a4a3-b7637f277f97" (UID: "2ab9c70e-5cff-4053-a4a3-b7637f277f97"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:15.906058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905895    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ab9c70e-5cff-4053-a4a3-b7637f277f97" (UID: "2ab9c70e-5cff-4053-a4a3-b7637f277f97"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:15.906058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.905991    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ab9c70e-5cff-4053-a4a3-b7637f277f97" (UID: "2ab9c70e-5cff-4053-a4a3-b7637f277f97"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:15.906058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.906042    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:15.906058 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.906055    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:15.908151 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.908127    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ab9c70e-5cff-4053-a4a3-b7637f277f97" (UID: "2ab9c70e-5cff-4053-a4a3-b7637f277f97"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:56:15.908264 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.908154    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-dshm" (OuterVolumeSpecName: "dshm") pod "2ab9c70e-5cff-4053-a4a3-b7637f277f97" (UID: "2ab9c70e-5cff-4053-a4a3-b7637f277f97"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:15.908264 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:15.908187    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab9c70e-5cff-4053-a4a3-b7637f277f97-kube-api-access-6cg29" (OuterVolumeSpecName: "kube-api-access-6cg29") pod "2ab9c70e-5cff-4053-a4a3-b7637f277f97" (UID: "2ab9c70e-5cff-4053-a4a3-b7637f277f97"). InnerVolumeSpecName "kube-api-access-6cg29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:16.006514 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.006477    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cg29\" (UniqueName: \"kubernetes.io/projected/2ab9c70e-5cff-4053-a4a3-b7637f277f97-kube-api-access-6cg29\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.006514 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.006506    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.006514 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.006517    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ab9c70e-5cff-4053-a4a3-b7637f277f97-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.006514 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.006526    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab9c70e-5cff-4053-a4a3-b7637f277f97-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.584114 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.584052    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs" podUID="3a1d7a31-622d-453f-bfe0-1636be5a2bce" containerName="main" containerID="cri-o://28eb2c6ec122810430c51f0e5fd943d01af5dd2d32f5f5bc246b08dc2d4d6b71" gracePeriod=45
Jul 26 15:56:16.823911 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.823874    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a1d7a31-622d-453f-bfe0-1636be5a2bce" containerID="28eb2c6ec122810430c51f0e5fd943d01af5dd2d32f5f5bc246b08dc2d4d6b71" exitCode=0
Jul 26 15:56:16.824065 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.823963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs" event={"ID":"3a1d7a31-622d-453f-bfe0-1636be5a2bce","Type":"ContainerDied","Data":"28eb2c6ec122810430c51f0e5fd943d01af5dd2d32f5f5bc246b08dc2d4d6b71"}
Jul 26 15:56:16.825387 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.825371    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"
Jul 26 15:56:16.825508 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.825414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952" event={"ID":"2ab9c70e-5cff-4053-a4a3-b7637f277f97","Type":"ContainerDied","Data":"1f0cced1c10313027c178532ccb5ed843ff6d1d75e3bbe7a5ab69d1ceb44322c"}
Jul 26 15:56:16.825508 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.825461    2561 scope.go:117] "RemoveContainer" containerID="6bb430bb8f57df3cb24ad065e0cf3a50f7073e6e17e05efdcf7c229df6ec9f59"
Jul 26 15:56:16.845156 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.845136    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:56:16.855308 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.855283    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"]
Jul 26 15:56:16.860983 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.860962    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ff0984/test-model-ff0984-kserve-665f5d4d9f-ww952"]
Jul 26 15:56:16.915033 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915006    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-dshm\") pod \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") "
Jul 26 15:56:16.915170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915055    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tmp-dir\") pod \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") "
Jul 26 15:56:16.915170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tls-certs\") pod \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") "
Jul 26 15:56:16.915170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915106    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kjpd\" (UniqueName: \"kubernetes.io/projected/3a1d7a31-622d-453f-bfe0-1636be5a2bce-kube-api-access-9kjpd\") pod \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") "
Jul 26 15:56:16.915293 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915175    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-home\") pod \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") "
Jul 26 15:56:16.915293 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915202    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-model-cache\") pod \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\" (UID: \"3a1d7a31-622d-453f-bfe0-1636be5a2bce\") "
Jul 26 15:56:16.915365 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915308    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a1d7a31-622d-453f-bfe0-1636be5a2bce" (UID: "3a1d7a31-622d-453f-bfe0-1636be5a2bce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:16.915483 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915460    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-home" (OuterVolumeSpecName: "home") pod "3a1d7a31-622d-453f-bfe0-1636be5a2bce" (UID: "3a1d7a31-622d-453f-bfe0-1636be5a2bce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:16.915552 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a1d7a31-622d-453f-bfe0-1636be5a2bce" (UID: "3a1d7a31-622d-453f-bfe0-1636be5a2bce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:16.915595 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915572    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.915595 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915583    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.915595 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.915591    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:16.917507 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.917484    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-dshm" (OuterVolumeSpecName: "dshm") pod "3a1d7a31-622d-453f-bfe0-1636be5a2bce" (UID: "3a1d7a31-622d-453f-bfe0-1636be5a2bce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:16.917507 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.917501    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1d7a31-622d-453f-bfe0-1636be5a2bce-kube-api-access-9kjpd" (OuterVolumeSpecName: "kube-api-access-9kjpd") pod "3a1d7a31-622d-453f-bfe0-1636be5a2bce" (UID: "3a1d7a31-622d-453f-bfe0-1636be5a2bce"). InnerVolumeSpecName "kube-api-access-9kjpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:16.917640 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:16.917530    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a1d7a31-622d-453f-bfe0-1636be5a2bce" (UID: "3a1d7a31-622d-453f-bfe0-1636be5a2bce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:56:17.016423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.016397    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a1d7a31-622d-453f-bfe0-1636be5a2bce-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:17.016423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.016421    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kjpd\" (UniqueName: \"kubernetes.io/projected/3a1d7a31-622d-453f-bfe0-1636be5a2bce-kube-api-access-9kjpd\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:17.016423 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.016430    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a1d7a31-622d-453f-bfe0-1636be5a2bce-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:17.110647 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.110570    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab9c70e-5cff-4053-a4a3-b7637f277f97" path="/var/lib/kubelet/pods/2ab9c70e-5cff-4053-a4a3-b7637f277f97/volumes"
Jul 26 15:56:17.832733 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.832698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs" event={"ID":"3a1d7a31-622d-453f-bfe0-1636be5a2bce","Type":"ContainerDied","Data":"4c1af2ae3519d155e3c2755cb9542d142096a315b2720f35acaeb6f144991354"}
Jul 26 15:56:17.833285 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.832741    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"
Jul 26 15:56:17.833285 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.832754    2561 scope.go:117] "RemoveContainer" containerID="28eb2c6ec122810430c51f0e5fd943d01af5dd2d32f5f5bc246b08dc2d4d6b71"
Jul 26 15:56:17.850577 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.850552    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"]
Jul 26 15:56:17.852713 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:17.852691    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8c61fd/test-model-8c61fd-kserve-6554df548f-d62bs"]
Jul 26 15:56:19.104614 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:19.104579    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a1d7a31-622d-453f-bfe0-1636be5a2bce" path="/var/lib/kubelet/pods/3a1d7a31-622d-453f-bfe0-1636be5a2bce/volumes"
Jul 26 15:56:33.971091 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:33.971050    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"]
Jul 26 15:56:33.971599 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:33.971386    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6" podUID="71c38af3-2584-4bf9-bc80-387aa0fb02b4" containerName="payload-processing" containerID="cri-o://cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d" gracePeriod=30
Jul 26 15:56:34.232388 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.232319    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:56:34.272605 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.272570    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71c38af3-2584-4bf9-bc80-387aa0fb02b4-plugins-config-volume\") pod \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") "
Jul 26 15:56:34.272809 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.272658    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw4sc\" (UniqueName: \"kubernetes.io/projected/71c38af3-2584-4bf9-bc80-387aa0fb02b4-kube-api-access-nw4sc\") pod \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\" (UID: \"71c38af3-2584-4bf9-bc80-387aa0fb02b4\") "
Jul 26 15:56:34.273136 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.273097    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71c38af3-2584-4bf9-bc80-387aa0fb02b4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71c38af3-2584-4bf9-bc80-387aa0fb02b4" (UID: "71c38af3-2584-4bf9-bc80-387aa0fb02b4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:56:34.275415 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.275386    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c38af3-2584-4bf9-bc80-387aa0fb02b4-kube-api-access-nw4sc" (OuterVolumeSpecName: "kube-api-access-nw4sc") pod "71c38af3-2584-4bf9-bc80-387aa0fb02b4" (UID: "71c38af3-2584-4bf9-bc80-387aa0fb02b4"). InnerVolumeSpecName "kube-api-access-nw4sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:34.373850 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.373809    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw4sc\" (UniqueName: \"kubernetes.io/projected/71c38af3-2584-4bf9-bc80-387aa0fb02b4-kube-api-access-nw4sc\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:34.373850 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.373842    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71c38af3-2584-4bf9-bc80-387aa0fb02b4-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:56:34.929096 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.929056    2561 generic.go:356] "Generic (PLEG): container finished" podID="71c38af3-2584-4bf9-bc80-387aa0fb02b4" containerID="cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d" exitCode=0
Jul 26 15:56:34.929096 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.929093    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"
Jul 26 15:56:34.929355 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.929133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6" event={"ID":"71c38af3-2584-4bf9-bc80-387aa0fb02b4","Type":"ContainerDied","Data":"cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d"}
Jul 26 15:56:34.929355 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.929187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6" event={"ID":"71c38af3-2584-4bf9-bc80-387aa0fb02b4","Type":"ContainerDied","Data":"17d87ec80077c79c65c4440725b902309e23cdf21c02821548cc5bdf6e07dbde"}
Jul 26 15:56:34.929355 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.929209    2561 scope.go:117] "RemoveContainer" containerID="cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d"
Jul 26 15:56:34.938383 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.938365    2561 scope.go:117] "RemoveContainer" containerID="cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d"
Jul 26 15:56:34.938664 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:56:34.938644    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d\": container with ID starting with cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d not found: ID does not exist" containerID="cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d"
Jul 26 15:56:34.938705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.938674    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d"} err="failed to get container status \"cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d\": rpc error: code = NotFound desc = could not find container \"cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d\": container with ID starting with cb707850a6c7e7f939b865a8e887f548068e055bc1039f1363ddf97f3c3b016d not found: ID does not exist"
Jul 26 15:56:34.950980 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.950955    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"]
Jul 26 15:56:34.954982 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:34.954962    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8c61fd-8669c6c89b-8v4f6"]
Jul 26 15:56:35.104248 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:35.104215    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c38af3-2584-4bf9-bc80-387aa0fb02b4" path="/var/lib/kubelet/pods/71c38af3-2584-4bf9-bc80-387aa0fb02b4/volumes"
Jul 26 15:56:49.459314 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459275    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"]
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459794    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab9c70e-5cff-4053-a4a3-b7637f277f97" containerName="main"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459810    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab9c70e-5cff-4053-a4a3-b7637f277f97" containerName="main"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459822    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c38af3-2584-4bf9-bc80-387aa0fb02b4" containerName="payload-processing"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459827    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c38af3-2584-4bf9-bc80-387aa0fb02b4" containerName="payload-processing"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459844    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1d7a31-622d-453f-bfe0-1636be5a2bce" containerName="main"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459849    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1d7a31-622d-453f-bfe0-1636be5a2bce" containerName="main"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459902    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a1d7a31-622d-453f-bfe0-1636be5a2bce" containerName="main"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459909    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab9c70e-5cff-4053-a4a3-b7637f277f97" containerName="main"
Jul 26 15:56:49.461976 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.459919    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c38af3-2584-4bf9-bc80-387aa0fb02b4" containerName="payload-processing"
Jul 26 15:56:49.462788 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.462767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.465749 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.465723    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-126bb0\""
Jul 26 15:56:49.465877 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.465723    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-126bb0-dockercfg-m4zmt\""
Jul 26 15:56:49.473891 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.473866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"]
Jul 26 15:56:49.504797 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.504760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d030f19-0da8-4dff-ab66-90981fca5f00-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.504993 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.504879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h56lz\" (UniqueName: \"kubernetes.io/projected/4d030f19-0da8-4dff-ab66-90981fca5f00-kube-api-access-h56lz\") pod \"payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.606212 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.606169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h56lz\" (UniqueName: \"kubernetes.io/projected/4d030f19-0da8-4dff-ab66-90981fca5f00-kube-api-access-h56lz\") pod \"payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.606468 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.606269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d030f19-0da8-4dff-ab66-90981fca5f00-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.607031 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.607011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d030f19-0da8-4dff-ab66-90981fca5f00-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.614211 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.614189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h56lz\" (UniqueName: \"kubernetes.io/projected/4d030f19-0da8-4dff-ab66-90981fca5f00-kube-api-access-h56lz\") pod \"payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.774136 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.774097    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:49.917191 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:49.917164    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"]
Jul 26 15:56:49.918876 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:56:49.918847    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d030f19_0da8_4dff_ab66_90981fca5f00.slice/crio-83b721a800c7fbc53e6e67ebc0bc7afa2215d5629cbd9037a7cb29e1b69e4612 WatchSource:0}: Error finding container 83b721a800c7fbc53e6e67ebc0bc7afa2215d5629cbd9037a7cb29e1b69e4612: Status 404 returned error can't find the container with id 83b721a800c7fbc53e6e67ebc0bc7afa2215d5629cbd9037a7cb29e1b69e4612
Jul 26 15:56:50.009666 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:50.009635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2" event={"ID":"4d030f19-0da8-4dff-ab66-90981fca5f00","Type":"ContainerStarted","Data":"249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79"}
Jul 26 15:56:50.009853 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:50.009692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2" event={"ID":"4d030f19-0da8-4dff-ab66-90981fca5f00","Type":"ContainerStarted","Data":"83b721a800c7fbc53e6e67ebc0bc7afa2215d5629cbd9037a7cb29e1b69e4612"}
Jul 26 15:56:50.009853 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:50.009758    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:56:50.025445 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:50.025326    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2" podStartSLOduration=1.025311335 podStartE2EDuration="1.025311335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:50.024470099 +0000 UTC m=+2319.385969902" watchObservedRunningTime="2026-07-26 15:56:50.025311335 +0000 UTC m=+2319.386811138"
Jul 26 15:56:57.306912 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.306871    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"]
Jul 26 15:56:57.310538 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.310521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.313072 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.313052    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-0da5f0\""
Jul 26 15:56:57.319620 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.319326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"]
Jul 26 15:56:57.378332 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.378300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.378522 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.378368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7trfl\" (UniqueName: \"kubernetes.io/projected/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-kube-api-access-7trfl\") pod \"payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.479284 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.479227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7trfl\" (UniqueName: \"kubernetes.io/projected/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-kube-api-access-7trfl\") pod \"payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.479498 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.479339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.480148 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.480116    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.489227 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.489200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7trfl\" (UniqueName: \"kubernetes.io/projected/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-kube-api-access-7trfl\") pod \"payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.623096 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.623001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:57.788183 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:57.788143    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"]
Jul 26 15:56:57.789329 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:56:57.789307    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fee9f82_9a4e_4b3a_93fc_4b7e6c87652b.slice/crio-5c9a1c84b32e6f0e67fd60e15d9d163dbdcf4c7a4865cb8d38c7de181aac03b9 WatchSource:0}: Error finding container 5c9a1c84b32e6f0e67fd60e15d9d163dbdcf4c7a4865cb8d38c7de181aac03b9: Status 404 returned error can't find the container with id 5c9a1c84b32e6f0e67fd60e15d9d163dbdcf4c7a4865cb8d38c7de181aac03b9
Jul 26 15:56:58.055603 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:58.055566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4" event={"ID":"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b","Type":"ContainerStarted","Data":"a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9"}
Jul 26 15:56:58.055777 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:58.055618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4" event={"ID":"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b","Type":"ContainerStarted","Data":"5c9a1c84b32e6f0e67fd60e15d9d163dbdcf4c7a4865cb8d38c7de181aac03b9"}
Jul 26 15:56:58.055825 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:58.055775    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:56:58.074228 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:56:58.074178    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4" podStartSLOduration=1.074162943 podStartE2EDuration="1.074162943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:58.073698283 +0000 UTC m=+2327.435198086" watchObservedRunningTime="2026-07-26 15:56:58.074162943 +0000 UTC m=+2327.435662724"
Jul 26 15:57:01.016889 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:01.016861    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:57:08.975185 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:08.975104    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"]
Jul 26 15:57:08.978686 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:08.978668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:08.981484 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:08.981452    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 15:57:08.981661 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:08.981644    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxrsw\""
Jul 26 15:57:08.987131 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:08.987105    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"]
Jul 26 15:57:09.062969 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:09.062911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:57:09.095392 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:09.095356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0308da82-f14b-4c99-85b6-187524a4597f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-126bb0-xbq84\" (UID: \"0308da82-f14b-4c99-85b6-187524a4597f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:09.196068 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:09.196032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0308da82-f14b-4c99-85b6-187524a4597f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-126bb0-xbq84\" (UID: \"0308da82-f14b-4c99-85b6-187524a4597f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:09.196707 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:09.196687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0308da82-f14b-4c99-85b6-187524a4597f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-126bb0-xbq84\" (UID: \"0308da82-f14b-4c99-85b6-187524a4597f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:09.290358 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:09.290320    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:09.433276 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:09.433247    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"]
Jul 26 15:57:09.434706 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:57:09.434672    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0308da82_f14b_4c99_85b6_187524a4597f.slice/crio-71fcea07cd2b7926992bcd46023c678f584004881bfc4829a2331439abfb16c0 WatchSource:0}: Error finding container 71fcea07cd2b7926992bcd46023c678f584004881bfc4829a2331439abfb16c0: Status 404 returned error can't find the container with id 71fcea07cd2b7926992bcd46023c678f584004881bfc4829a2331439abfb16c0
Jul 26 15:57:10.125315 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:10.125269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84" event={"ID":"0308da82-f14b-4c99-85b6-187524a4597f","Type":"ContainerStarted","Data":"71fcea07cd2b7926992bcd46023c678f584004881bfc4829a2331439abfb16c0"}
Jul 26 15:57:12.138623 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:12.138563    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84" event={"ID":"0308da82-f14b-4c99-85b6-187524a4597f","Type":"ContainerStarted","Data":"18efc0633ab492b126f82e995dac30a373766e492efc22491566a728dc1c5dc7"}
Jul 26 15:57:12.154092 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:12.154037    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84" podStartSLOduration=1.8594728759999999 podStartE2EDuration="4.154020431s" totalImagesPullingTime="2.294547555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:12.152498409 +0000 UTC m=+2341.513998214" watchObservedRunningTime="2026-07-26 15:57:12.154020431 +0000 UTC m=+2341.515520234"
Jul 26 15:57:13.145459 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:13.145423    2561 generic.go:356] "Generic (PLEG): container finished" podID="0308da82-f14b-4c99-85b6-187524a4597f" containerID="18efc0633ab492b126f82e995dac30a373766e492efc22491566a728dc1c5dc7" exitCode=0
Jul 26 15:57:13.145843 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:13.145513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84" event={"ID":"0308da82-f14b-4c99-85b6-187524a4597f","Type":"ContainerDied","Data":"18efc0633ab492b126f82e995dac30a373766e492efc22491566a728dc1c5dc7"}
Jul 26 15:57:14.289723 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:14.289689    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:14.445797 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:14.445699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0308da82-f14b-4c99-85b6-187524a4597f-maas-api-service-ca\") pod \"0308da82-f14b-4c99-85b6-187524a4597f\" (UID: \"0308da82-f14b-4c99-85b6-187524a4597f\") "
Jul 26 15:57:14.446157 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:14.446125    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0308da82-f14b-4c99-85b6-187524a4597f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0308da82-f14b-4c99-85b6-187524a4597f" (UID: "0308da82-f14b-4c99-85b6-187524a4597f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:14.547292 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:14.547255    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0308da82-f14b-4c99-85b6-187524a4597f-maas-api-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:57:15.156832 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:15.156800    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"
Jul 26 15:57:15.157022 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:15.156847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84" event={"ID":"0308da82-f14b-4c99-85b6-187524a4597f","Type":"ContainerDied","Data":"71fcea07cd2b7926992bcd46023c678f584004881bfc4829a2331439abfb16c0"}
Jul 26 15:57:15.157022 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:15.156905    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71fcea07cd2b7926992bcd46023c678f584004881bfc4829a2331439abfb16c0"
Jul 26 15:57:24.780871 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:24.780839    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"]
Jul 26 15:57:24.781409 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:24.781084    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2" podUID="4d030f19-0da8-4dff-ab66-90981fca5f00" containerName="payload-pre-processing" containerID="cri-o://249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79" gracePeriod=30
Jul 26 15:57:25.053129 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.053099    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:57:25.144385 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.144347    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h56lz\" (UniqueName: \"kubernetes.io/projected/4d030f19-0da8-4dff-ab66-90981fca5f00-kube-api-access-h56lz\") pod \"4d030f19-0da8-4dff-ab66-90981fca5f00\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") "
Jul 26 15:57:25.144579 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.144408    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d030f19-0da8-4dff-ab66-90981fca5f00-plugins-config-volume\") pod \"4d030f19-0da8-4dff-ab66-90981fca5f00\" (UID: \"4d030f19-0da8-4dff-ab66-90981fca5f00\") "
Jul 26 15:57:25.144827 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.144795    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d030f19-0da8-4dff-ab66-90981fca5f00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d030f19-0da8-4dff-ab66-90981fca5f00" (UID: "4d030f19-0da8-4dff-ab66-90981fca5f00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:25.146685 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.146665    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d030f19-0da8-4dff-ab66-90981fca5f00-kube-api-access-h56lz" (OuterVolumeSpecName: "kube-api-access-h56lz") pod "4d030f19-0da8-4dff-ab66-90981fca5f00" (UID: "4d030f19-0da8-4dff-ab66-90981fca5f00"). InnerVolumeSpecName "kube-api-access-h56lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:57:25.213520 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.213482    2561 generic.go:356] "Generic (PLEG): container finished" podID="4d030f19-0da8-4dff-ab66-90981fca5f00" containerID="249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79" exitCode=0
Jul 26 15:57:25.213688 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.213529    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"
Jul 26 15:57:25.213688 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.213559    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2" event={"ID":"4d030f19-0da8-4dff-ab66-90981fca5f00","Type":"ContainerDied","Data":"249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79"}
Jul 26 15:57:25.213688 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.213616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2" event={"ID":"4d030f19-0da8-4dff-ab66-90981fca5f00","Type":"ContainerDied","Data":"83b721a800c7fbc53e6e67ebc0bc7afa2215d5629cbd9037a7cb29e1b69e4612"}
Jul 26 15:57:25.213688 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.213641    2561 scope.go:117] "RemoveContainer" containerID="249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79"
Jul 26 15:57:25.223784 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.223768    2561 scope.go:117] "RemoveContainer" containerID="249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79"
Jul 26 15:57:25.224089 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:57:25.224069    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79\": container with ID starting with 249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79 not found: ID does not exist" containerID="249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79"
Jul 26 15:57:25.224170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.224100    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79"} err="failed to get container status \"249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79\": rpc error: code = NotFound desc = could not find container \"249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79\": container with ID starting with 249816859f09582f318e6be037d9fc5f7a31e77a767e531a5b323397dcd27c79 not found: ID does not exist"
Jul 26 15:57:25.237615 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.237584    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"]
Jul 26 15:57:25.240757 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.240734    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-126bb0-58f8596f68-tggh2"]
Jul 26 15:57:25.245535 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.245512    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h56lz\" (UniqueName: \"kubernetes.io/projected/4d030f19-0da8-4dff-ab66-90981fca5f00-kube-api-access-h56lz\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:57:25.245535 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:25.245537    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d030f19-0da8-4dff-ab66-90981fca5f00-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:57:27.105825 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:27.105784    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d030f19-0da8-4dff-ab66-90981fca5f00" path="/var/lib/kubelet/pods/4d030f19-0da8-4dff-ab66-90981fca5f00/volumes"
Jul 26 15:57:29.048884 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:29.048824    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"]
Jul 26 15:57:29.051294 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:29.051264    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-126bb0-xbq84"]
Jul 26 15:57:29.104820 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:29.104779    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0308da82-f14b-4c99-85b6-187524a4597f" path="/var/lib/kubelet/pods/0308da82-f14b-4c99-85b6-187524a4597f/volumes"
Jul 26 15:57:35.760815 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.760781    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"]
Jul 26 15:57:35.761241 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.761186    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0308da82-f14b-4c99-85b6-187524a4597f" containerName="revoke-keys"
Jul 26 15:57:35.761241 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.761199    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0308da82-f14b-4c99-85b6-187524a4597f" containerName="revoke-keys"
Jul 26 15:57:35.761241 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.761221    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d030f19-0da8-4dff-ab66-90981fca5f00" containerName="payload-pre-processing"
Jul 26 15:57:35.761241 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.761226    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d030f19-0da8-4dff-ab66-90981fca5f00" containerName="payload-pre-processing"
Jul 26 15:57:35.761429 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.761288    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d030f19-0da8-4dff-ab66-90981fca5f00" containerName="payload-pre-processing"
Jul 26 15:57:35.761429 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.761297    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0308da82-f14b-4c99-85b6-187524a4597f" containerName="revoke-keys"
Jul 26 15:57:35.766914 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.766894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:35.769783 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.769742    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxrsw\""
Jul 26 15:57:35.770067 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.769783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 15:57:35.771870 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.771844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"]
Jul 26 15:57:35.848685 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.848645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4698ce46-f961-433a-b18b-e8af669a236f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv\" (UID: \"4698ce46-f961-433a-b18b-e8af669a236f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:35.949603 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.949570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4698ce46-f961-433a-b18b-e8af669a236f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv\" (UID: \"4698ce46-f961-433a-b18b-e8af669a236f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:35.950222 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:35.950196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4698ce46-f961-433a-b18b-e8af669a236f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv\" (UID: \"4698ce46-f961-433a-b18b-e8af669a236f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:36.079491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:36.079411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:36.216796 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:36.216768    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"]
Jul 26 15:57:36.218607 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:57:36.218580    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4698ce46_f961_433a_b18b_e8af669a236f.slice/crio-204c7566a84db35ebfdaeb41508b8ffd17a79ec4e2ef41110d042a7ce768bf47 WatchSource:0}: Error finding container 204c7566a84db35ebfdaeb41508b8ffd17a79ec4e2ef41110d042a7ce768bf47: Status 404 returned error can't find the container with id 204c7566a84db35ebfdaeb41508b8ffd17a79ec4e2ef41110d042a7ce768bf47
Jul 26 15:57:36.275621 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:36.275590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv" event={"ID":"4698ce46-f961-433a-b18b-e8af669a236f","Type":"ContainerStarted","Data":"204c7566a84db35ebfdaeb41508b8ffd17a79ec4e2ef41110d042a7ce768bf47"}
Jul 26 15:57:37.283566 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:37.283527    2561 generic.go:356] "Generic (PLEG): container finished" podID="4698ce46-f961-433a-b18b-e8af669a236f" containerID="204e52f76441e256a9b885868e48cf3c80201e1eff6c9c075912e7c25008fd3b" exitCode=0
Jul 26 15:57:37.283966 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:37.283612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv" event={"ID":"4698ce46-f961-433a-b18b-e8af669a236f","Type":"ContainerDied","Data":"204e52f76441e256a9b885868e48cf3c80201e1eff6c9c075912e7c25008fd3b"}
Jul 26 15:57:38.428570 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:38.428543    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:38.472651 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:38.472616    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4698ce46-f961-433a-b18b-e8af669a236f-maas-api-service-ca\") pod \"4698ce46-f961-433a-b18b-e8af669a236f\" (UID: \"4698ce46-f961-433a-b18b-e8af669a236f\") "
Jul 26 15:57:38.472984 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:38.472958    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4698ce46-f961-433a-b18b-e8af669a236f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4698ce46-f961-433a-b18b-e8af669a236f" (UID: "4698ce46-f961-433a-b18b-e8af669a236f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:38.574242 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:38.574157    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4698ce46-f961-433a-b18b-e8af669a236f-maas-api-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:57:39.295159 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:39.295122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv" event={"ID":"4698ce46-f961-433a-b18b-e8af669a236f","Type":"ContainerDied","Data":"204c7566a84db35ebfdaeb41508b8ffd17a79ec4e2ef41110d042a7ce768bf47"}
Jul 26 15:57:39.295304 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:39.295174    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="204c7566a84db35ebfdaeb41508b8ffd17a79ec4e2ef41110d042a7ce768bf47"
Jul 26 15:57:39.295304 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:39.295140    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"
Jul 26 15:57:51.274995 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.274945    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"]
Jul 26 15:57:51.275491 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.275226    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4" podUID="7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" containerName="payload-pre-processing" containerID="cri-o://a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9" gracePeriod=30
Jul 26 15:57:51.538518 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.538449    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:57:51.687902 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.687862    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7trfl\" (UniqueName: \"kubernetes.io/projected/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-kube-api-access-7trfl\") pod \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") "
Jul 26 15:57:51.688143 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.687918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-plugins-config-volume\") pod \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\" (UID: \"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b\") "
Jul 26 15:57:51.688289 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.688264    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" (UID: "7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:51.690224 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.690197    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-kube-api-access-7trfl" (OuterVolumeSpecName: "kube-api-access-7trfl") pod "7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" (UID: "7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b"). InnerVolumeSpecName "kube-api-access-7trfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:57:51.789455 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.789352    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7trfl\" (UniqueName: \"kubernetes.io/projected/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-kube-api-access-7trfl\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:57:51.789455 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:51.789389    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 15:57:52.364553 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.364517    2561 generic.go:356] "Generic (PLEG): container finished" podID="7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" containerID="a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9" exitCode=0
Jul 26 15:57:52.365027 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.364560    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"
Jul 26 15:57:52.365027 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.364570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4" event={"ID":"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b","Type":"ContainerDied","Data":"a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9"}
Jul 26 15:57:52.365027 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.364615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4" event={"ID":"7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b","Type":"ContainerDied","Data":"5c9a1c84b32e6f0e67fd60e15d9d163dbdcf4c7a4865cb8d38c7de181aac03b9"}
Jul 26 15:57:52.365027 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.364635    2561 scope.go:117] "RemoveContainer" containerID="a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9"
Jul 26 15:57:52.374165 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.374142    2561 scope.go:117] "RemoveContainer" containerID="a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9"
Jul 26 15:57:52.374491 ip-10-0-137-96 kubenswrapper[2561]: E0726 15:57:52.374471    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9\": container with ID starting with a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9 not found: ID does not exist" containerID="a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9"
Jul 26 15:57:52.374566 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.374511    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9"} err="failed to get container status \"a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9\": rpc error: code = NotFound desc = could not find container \"a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9\": container with ID starting with a3a5b3a142b34e974f0aa58676e8c01a1633cc835ad73ec78abf53606b2318a9 not found: ID does not exist"
Jul 26 15:57:52.386000 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.385963    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"]
Jul 26 15:57:52.389315 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:52.389286    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0da5f0-b7f7587cb-wpbj4"]
Jul 26 15:57:53.104705 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:53.104670    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" path="/var/lib/kubelet/pods/7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b/volumes"
Jul 26 15:57:55.861722 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:55.861674    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"]
Jul 26 15:57:55.864399 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:55.864373    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0da5f0-kfhfv"]
Jul 26 15:57:57.104648 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:57:57.104609    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4698ce46-f961-433a-b18b-e8af669a236f" path="/var/lib/kubelet/pods/4698ce46-f961-433a-b18b-e8af669a236f/volumes"
Jul 26 15:58:06.826647 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.826608    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"]
Jul 26 15:58:06.827243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.827210    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4698ce46-f961-433a-b18b-e8af669a236f" containerName="revoke-keys"
Jul 26 15:58:06.827243 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.827241    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4698ce46-f961-433a-b18b-e8af669a236f" containerName="revoke-keys"
Jul 26 15:58:06.827438 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.827268    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" containerName="payload-pre-processing"
Jul 26 15:58:06.827438 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.827277    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" containerName="payload-pre-processing"
Jul 26 15:58:06.827438 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.827385    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fee9f82-9a4e-4b3a-93fc-4b7e6c87652b" containerName="payload-pre-processing"
Jul 26 15:58:06.827438 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.827399    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4698ce46-f961-433a-b18b-e8af669a236f" containerName="revoke-keys"
Jul 26 15:58:06.832397 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.832376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:06.835143 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.835123    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-d81393\""
Jul 26 15:58:06.835278 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.835163    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-d81393-dockercfg-znh48\""
Jul 26 15:58:06.839668 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:06.839648    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"]
Jul 26 15:58:07.027340 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.027295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252b0e28-aa35-49e8-8390-5b0ec0634b91-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.027526 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.027421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5p4d\" (UniqueName: \"kubernetes.io/projected/252b0e28-aa35-49e8-8390-5b0ec0634b91-kube-api-access-p5p4d\") pod \"payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.128751 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.128654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252b0e28-aa35-49e8-8390-5b0ec0634b91-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.128945 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.128761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5p4d\" (UniqueName: \"kubernetes.io/projected/252b0e28-aa35-49e8-8390-5b0ec0634b91-kube-api-access-p5p4d\") pod \"payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.129369 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.129348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252b0e28-aa35-49e8-8390-5b0ec0634b91-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.137439 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.137416    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5p4d\" (UniqueName: \"kubernetes.io/projected/252b0e28-aa35-49e8-8390-5b0ec0634b91-kube-api-access-p5p4d\") pod \"payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.144265 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.144240    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:07.492011 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:07.491986    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"]
Jul 26 15:58:07.493514 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:58:07.493483    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252b0e28_aa35_49e8_8390_5b0ec0634b91.slice/crio-2408e6cc1f37e73dda4abff50354477abd9fd5903dd2f19d9b66190847829f12 WatchSource:0}: Error finding container 2408e6cc1f37e73dda4abff50354477abd9fd5903dd2f19d9b66190847829f12: Status 404 returned error can't find the container with id 2408e6cc1f37e73dda4abff50354477abd9fd5903dd2f19d9b66190847829f12
Jul 26 15:58:08.454055 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:08.454008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r" event={"ID":"252b0e28-aa35-49e8-8390-5b0ec0634b91","Type":"ContainerStarted","Data":"da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e"}
Jul 26 15:58:08.454055 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:08.454075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r" event={"ID":"252b0e28-aa35-49e8-8390-5b0ec0634b91","Type":"ContainerStarted","Data":"2408e6cc1f37e73dda4abff50354477abd9fd5903dd2f19d9b66190847829f12"}
Jul 26 15:58:08.454530 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:08.454157    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:08.470785 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:08.470700    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r" podStartSLOduration=2.470686228 podStartE2EDuration="2.470686228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:08.468651217 +0000 UTC m=+2397.830151023" watchObservedRunningTime="2026-07-26 15:58:08.470686228 +0000 UTC m=+2397.832186046"
Jul 26 15:58:14.974715 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.974675    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"]
Jul 26 15:58:14.979517 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.979495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:14.982218 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.982191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-976e7c\""
Jul 26 15:58:14.982457 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.982434    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-976e7c-dockercfg-j54ll\""
Jul 26 15:58:14.990093 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.990062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxq42\" (UniqueName: \"kubernetes.io/projected/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-kube-api-access-gxq42\") pod \"payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:14.990214 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.990119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:14.993478 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:14.993455    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"]
Jul 26 15:58:15.090520 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.090472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:15.090724 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.090595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxq42\" (UniqueName: \"kubernetes.io/projected/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-kube-api-access-gxq42\") pod \"payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:15.091244 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.091222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:15.100655 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.100623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxq42\" (UniqueName: \"kubernetes.io/projected/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-kube-api-access-gxq42\") pod \"payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:15.290517 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.290476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:15.432082 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.432059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"]
Jul 26 15:58:15.434577 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:58:15.434548    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a0d8f4_325a_4d8b_aa50_683ee1c7896f.slice/crio-6135c08bedf96b6ab36e9dc1637e57835855dc59128fdabdd34db3edc72626a4 WatchSource:0}: Error finding container 6135c08bedf96b6ab36e9dc1637e57835855dc59128fdabdd34db3edc72626a4: Status 404 returned error can't find the container with id 6135c08bedf96b6ab36e9dc1637e57835855dc59128fdabdd34db3edc72626a4
Jul 26 15:58:15.496978 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:15.496919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" event={"ID":"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f","Type":"ContainerStarted","Data":"6135c08bedf96b6ab36e9dc1637e57835855dc59128fdabdd34db3edc72626a4"}
Jul 26 15:58:16.504748 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:16.504708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" event={"ID":"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f","Type":"ContainerStarted","Data":"fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15"}
Jul 26 15:58:16.505170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:16.504825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:16.521170 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:16.521124    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" podStartSLOduration=2.521109226 podStartE2EDuration="2.521109226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:16.519384702 +0000 UTC m=+2405.880884505" watchObservedRunningTime="2026-07-26 15:58:16.521109226 +0000 UTC m=+2405.882609030"
Jul 26 15:58:19.462528 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:19.462496    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 15:58:27.512815 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:27.512783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 15:58:31.485144 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.485107    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"]
Jul 26 15:58:31.488659 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.488643    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.491292 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.491267    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"kube-root-ca.crt\""
Jul 26 15:58:31.491424 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.491328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"openshift-service-ca.crt\""
Jul 26 15:58:31.492480 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.492459    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"default-dockercfg-vhqb7\""
Jul 26 15:58:31.492567 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.492463    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"auth-test-model-d81393-kserve-self-signed-certs\""
Jul 26 15:58:31.496802 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.496783    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"]
Jul 26 15:58:31.528325 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.528296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-tmp-dir\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.528493 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.528366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-model-cache\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.528493 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.528448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da982aa5-36d7-4292-bc56-56b504522371-tls-certs\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.528593 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.528495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-home\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.528657 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.528634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gg8v\" (UniqueName: \"kubernetes.io/projected/da982aa5-36d7-4292-bc56-56b504522371-kube-api-access-5gg8v\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.528697 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.528677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-dshm\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.629399 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-model-cache\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.629586 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da982aa5-36d7-4292-bc56-56b504522371-tls-certs\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.629586 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-home\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.629586 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gg8v\" (UniqueName: \"kubernetes.io/projected/da982aa5-36d7-4292-bc56-56b504522371-kube-api-access-5gg8v\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.629586 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-dshm\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.629915 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629892    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-home\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.630106 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.629904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-tmp-dir\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.630249 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.630121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-model-cache\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.630249 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.630239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-tmp-dir\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.632242 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.632212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-dshm\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.632533 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.632513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da982aa5-36d7-4292-bc56-56b504522371-tls-certs\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.637851 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.637829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gg8v\" (UniqueName: \"kubernetes.io/projected/da982aa5-36d7-4292-bc56-56b504522371-kube-api-access-5gg8v\") pod \"auth-test-model-d81393-kserve-7cdc846f9-k2ls7\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") " pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.798373 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.798338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:31.942966 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:31.941282    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"]
Jul 26 15:58:32.594657 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:32.594622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7" event={"ID":"da982aa5-36d7-4292-bc56-56b504522371","Type":"ContainerStarted","Data":"ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06"}
Jul 26 15:58:32.595125 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:32.594667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7" event={"ID":"da982aa5-36d7-4292-bc56-56b504522371","Type":"ContainerStarted","Data":"05b61dd06d959180c23a09fee65a9f2544398f3e632106195fb9ea81e3dead79"}
Jul 26 15:58:32.613377 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:32.613327    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7" podStartSLOduration=1.613311849 podStartE2EDuration="1.613311849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:32.612908643 +0000 UTC m=+2421.974408448" watchObservedRunningTime="2026-07-26 15:58:32.613311849 +0000 UTC m=+2421.974811652"
Jul 26 15:58:41.799619 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:41.799584    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:41.800163 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:41.799640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:41.812100 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:41.812070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:58:42.660681 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:58:42.660652    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 15:59:00.496018 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.495987    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"]
Jul 26 15:59:00.499377 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.499360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.503303 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.503276    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"openshift-service-ca.crt\""
Jul 26 15:59:00.503432 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.503303    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"kube-root-ca.crt\""
Jul 26 15:59:00.503432 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.503287    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"auth-test-model-976e7c-kserve-self-signed-certs\""
Jul 26 15:59:00.503569 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.503276    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"default-dockercfg-xwnkb\""
Jul 26 15:59:00.508734 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.508711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"]
Jul 26 15:59:00.596205 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.596171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tls-certs\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.596205 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.596207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-home\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.596454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.596232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs5gf\" (UniqueName: \"kubernetes.io/projected/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-kube-api-access-rs5gf\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.596454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.596347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-dshm\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.596454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.596380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-model-cache\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.596454 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.596436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tmp-dir\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697419 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tls-certs\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697419 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-home\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697649 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs5gf\" (UniqueName: \"kubernetes.io/projected/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-kube-api-access-rs5gf\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697649 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-dshm\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697649 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-model-cache\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697649 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tmp-dir\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697861 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-home\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697919 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-model-cache\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.697919 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.697912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tmp-dir\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.699980 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.699954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-dshm\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.700151 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.700135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tls-certs\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.704986 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.704963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs5gf\" (UniqueName: \"kubernetes.io/projected/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-kube-api-access-rs5gf\") pod \"auth-test-model-976e7c-kserve-6d48c7987-cl8rl\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") " pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.810973 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.810864    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:00.951777 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:00.951746    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"]
Jul 26 15:59:00.953057 ip-10-0-137-96 kubenswrapper[2561]: W0726 15:59:00.953031    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1ae1885_07dd_45dd_8aac_9d0e6bbb1ffd.slice/crio-67fefe4e42935936e89bba558f4422512ff8243291138227b7952bd7b83ef096 WatchSource:0}: Error finding container 67fefe4e42935936e89bba558f4422512ff8243291138227b7952bd7b83ef096: Status 404 returned error can't find the container with id 67fefe4e42935936e89bba558f4422512ff8243291138227b7952bd7b83ef096
Jul 26 15:59:01.758977 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:01.758919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl" event={"ID":"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd","Type":"ContainerStarted","Data":"6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e"}
Jul 26 15:59:01.759420 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:01.758986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl" event={"ID":"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd","Type":"ContainerStarted","Data":"67fefe4e42935936e89bba558f4422512ff8243291138227b7952bd7b83ef096"}
Jul 26 15:59:01.777467 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:01.777416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl" podStartSLOduration=1.777398931 podStartE2EDuration="1.777398931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:59:01.775101463 +0000 UTC m=+2451.136601268" watchObservedRunningTime="2026-07-26 15:59:01.777398931 +0000 UTC m=+2451.138898780"
Jul 26 15:59:10.811659 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:10.811619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:10.812090 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:10.811684    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:10.824372 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:10.824348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 15:59:11.827216 ip-10-0-137-96 kubenswrapper[2561]: I0726 15:59:11.827184    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 16:03:29.620200 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:29.620101    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"]
Jul 26 16:03:30.670960 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:30.670909    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"]
Jul 26 16:03:44.641367 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.641327    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7" podUID="da982aa5-36d7-4292-bc56-56b504522371" containerName="main" containerID="cri-o://ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06" gracePeriod=45
Jul 26 16:03:44.893238 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.893172    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 16:03:44.947346 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947316    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-tmp-dir\") pod \"da982aa5-36d7-4292-bc56-56b504522371\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") "
Jul 26 16:03:44.947517 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947360    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da982aa5-36d7-4292-bc56-56b504522371-tls-certs\") pod \"da982aa5-36d7-4292-bc56-56b504522371\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") "
Jul 26 16:03:44.947517 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947390    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-dshm\") pod \"da982aa5-36d7-4292-bc56-56b504522371\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") "
Jul 26 16:03:44.947517 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947469    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-model-cache\") pod \"da982aa5-36d7-4292-bc56-56b504522371\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") "
Jul 26 16:03:44.947517 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gg8v\" (UniqueName: \"kubernetes.io/projected/da982aa5-36d7-4292-bc56-56b504522371-kube-api-access-5gg8v\") pod \"da982aa5-36d7-4292-bc56-56b504522371\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") "
Jul 26 16:03:44.947886 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947865    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-home\") pod \"da982aa5-36d7-4292-bc56-56b504522371\" (UID: \"da982aa5-36d7-4292-bc56-56b504522371\") "
Jul 26 16:03:44.948012 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da982aa5-36d7-4292-bc56-56b504522371" (UID: "da982aa5-36d7-4292-bc56-56b504522371"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:44.948012 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.947780    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-model-cache" (OuterVolumeSpecName: "model-cache") pod "da982aa5-36d7-4292-bc56-56b504522371" (UID: "da982aa5-36d7-4292-bc56-56b504522371"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:44.948288 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.948110    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-home" (OuterVolumeSpecName: "home") pod "da982aa5-36d7-4292-bc56-56b504522371" (UID: "da982aa5-36d7-4292-bc56-56b504522371"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:44.948457 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.948437    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:44.948517 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.948462    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:44.948517 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.948477    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:44.949761 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.949738    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-dshm" (OuterVolumeSpecName: "dshm") pod "da982aa5-36d7-4292-bc56-56b504522371" (UID: "da982aa5-36d7-4292-bc56-56b504522371"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:44.949761 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.949746    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da982aa5-36d7-4292-bc56-56b504522371-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da982aa5-36d7-4292-bc56-56b504522371" (UID: "da982aa5-36d7-4292-bc56-56b504522371"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:03:44.949883 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:44.949857    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da982aa5-36d7-4292-bc56-56b504522371-kube-api-access-5gg8v" (OuterVolumeSpecName: "kube-api-access-5gg8v") pod "da982aa5-36d7-4292-bc56-56b504522371" (UID: "da982aa5-36d7-4292-bc56-56b504522371"). InnerVolumeSpecName "kube-api-access-5gg8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:03:45.049359 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.049329    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gg8v\" (UniqueName: \"kubernetes.io/projected/da982aa5-36d7-4292-bc56-56b504522371-kube-api-access-5gg8v\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:45.049359 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.049355    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da982aa5-36d7-4292-bc56-56b504522371-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:45.049359 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.049365    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da982aa5-36d7-4292-bc56-56b504522371-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:45.374049 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.374012    2561 generic.go:356] "Generic (PLEG): container finished" podID="da982aa5-36d7-4292-bc56-56b504522371" containerID="ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06" exitCode=0
Jul 26 16:03:45.374049 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.374048    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"
Jul 26 16:03:45.374252 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.374092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7" event={"ID":"da982aa5-36d7-4292-bc56-56b504522371","Type":"ContainerDied","Data":"ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06"}
Jul 26 16:03:45.374252 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.374136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7" event={"ID":"da982aa5-36d7-4292-bc56-56b504522371","Type":"ContainerDied","Data":"05b61dd06d959180c23a09fee65a9f2544398f3e632106195fb9ea81e3dead79"}
Jul 26 16:03:45.374252 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.374156    2561 scope.go:117] "RemoveContainer" containerID="ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06"
Jul 26 16:03:45.383350 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.383331    2561 scope.go:117] "RemoveContainer" containerID="ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06"
Jul 26 16:03:45.383625 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:03:45.383596    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06\": container with ID starting with ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06 not found: ID does not exist" containerID="ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06"
Jul 26 16:03:45.383729 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.383623    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06"} err="failed to get container status \"ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06\": rpc error: code = NotFound desc = could not find container \"ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06\": container with ID starting with ddae58680124957c6976b1500fb984221b1af2d88e62fdc4a1faff36eda34c06 not found: ID does not exist"
Jul 26 16:03:45.391222 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.391194    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"]
Jul 26 16:03:45.394828 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.394807    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/auth-test-model-d81393-kserve-7cdc846f9-k2ls7"]
Jul 26 16:03:45.691836 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.691743    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl" podUID="a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" containerName="main" containerID="cri-o://6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e" gracePeriod=45
Jul 26 16:03:45.948940 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:45.948869    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 16:03:46.058923 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.058894    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs5gf\" (UniqueName: \"kubernetes.io/projected/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-kube-api-access-rs5gf\") pod \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") "
Jul 26 16:03:46.058923 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.058949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tls-certs\") pod \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") "
Jul 26 16:03:46.059191 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.058970    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-dshm\") pod \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") "
Jul 26 16:03:46.059191 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.059005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-model-cache\") pod \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") "
Jul 26 16:03:46.059191 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.059047    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tmp-dir\") pod \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") "
Jul 26 16:03:46.059191 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.059089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-home\") pod \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\" (UID: \"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd\") "
Jul 26 16:03:46.059387 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.059287    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-model-cache" (OuterVolumeSpecName: "model-cache") pod "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" (UID: "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:46.059387 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.059311    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" (UID: "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:46.059464 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.059426    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-home" (OuterVolumeSpecName: "home") pod "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" (UID: "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:46.061279 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.061259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-kube-api-access-rs5gf" (OuterVolumeSpecName: "kube-api-access-rs5gf") pod "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" (UID: "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd"). InnerVolumeSpecName "kube-api-access-rs5gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:03:46.061357 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.061299    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" (UID: "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:03:46.061357 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.061331    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-dshm" (OuterVolumeSpecName: "dshm") pod "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" (UID: "a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:03:46.159965 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.159914    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:46.159965 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.159959    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs5gf\" (UniqueName: \"kubernetes.io/projected/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-kube-api-access-rs5gf\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:46.159965 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.159970    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:46.160260 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.159982    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:46.160260 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.159994    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:46.160260 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.160003    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:03:46.389103 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.389066    2561 generic.go:356] "Generic (PLEG): container finished" podID="a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" containerID="6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e" exitCode=0
Jul 26 16:03:46.389296 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.389129    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"
Jul 26 16:03:46.389296 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.389152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl" event={"ID":"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd","Type":"ContainerDied","Data":"6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e"}
Jul 26 16:03:46.389296 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.389192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl" event={"ID":"a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd","Type":"ContainerDied","Data":"67fefe4e42935936e89bba558f4422512ff8243291138227b7952bd7b83ef096"}
Jul 26 16:03:46.389296 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.389209    2561 scope.go:117] "RemoveContainer" containerID="6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e"
Jul 26 16:03:46.398899 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.398880    2561 scope.go:117] "RemoveContainer" containerID="6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e"
Jul 26 16:03:46.399178 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:03:46.399160    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e\": container with ID starting with 6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e not found: ID does not exist" containerID="6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e"
Jul 26 16:03:46.399227 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.399188    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e"} err="failed to get container status \"6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e\": rpc error: code = NotFound desc = could not find container \"6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e\": container with ID starting with 6b44bb9caca90831d8c9a89ebeb967ab7dda97dfc255872690054e8d5ea0e86e not found: ID does not exist"
Jul 26 16:03:46.411452 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.411426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"]
Jul 26 16:03:46.415052 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:46.415029    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/auth-test-model-976e7c-kserve-6d48c7987-cl8rl"]
Jul 26 16:03:47.105647 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:47.105617    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" path="/var/lib/kubelet/pods/a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd/volumes"
Jul 26 16:03:47.106024 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:03:47.106011    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da982aa5-36d7-4292-bc56-56b504522371" path="/var/lib/kubelet/pods/da982aa5-36d7-4292-bc56-56b504522371/volumes"
Jul 26 16:04:11.753315 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:11.753270    2561 scope.go:117] "RemoveContainer" containerID="18efc0633ab492b126f82e995dac30a373766e492efc22491566a728dc1c5dc7"
Jul 26 16:04:11.762895 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:11.762859    2561 scope.go:117] "RemoveContainer" containerID="204e52f76441e256a9b885868e48cf3c80201e1eff6c9c075912e7c25008fd3b"
Jul 26 16:04:17.095133 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095100    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"]
Jul 26 16:04:17.095694 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095678    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" containerName="main"
Jul 26 16:04:17.095741 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095698    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" containerName="main"
Jul 26 16:04:17.095741 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095715    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da982aa5-36d7-4292-bc56-56b504522371" containerName="main"
Jul 26 16:04:17.095741 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="da982aa5-36d7-4292-bc56-56b504522371" containerName="main"
Jul 26 16:04:17.095865 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095806    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ae1885-07dd-45dd-8aac-9d0e6bbb1ffd" containerName="main"
Jul 26 16:04:17.095865 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.095821    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="da982aa5-36d7-4292-bc56-56b504522371" containerName="main"
Jul 26 16:04:17.100631 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.100606    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.105193 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.103960    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"kube-root-ca.crt\""
Jul 26 16:04:17.105193 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.104237    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"openshift-service-ca.crt\""
Jul 26 16:04:17.105403 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.105229    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"sub-test-model-976e7c-kserve-self-signed-certs\""
Jul 26 16:04:17.105403 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.105357    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"default-dockercfg-xwnkb\""
Jul 26 16:04:17.119238 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.119213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"]
Jul 26 16:04:17.154349 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.154314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-home\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.154531 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.154357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hd6g\" (UniqueName: \"kubernetes.io/projected/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-kube-api-access-2hd6g\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.154531 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.154389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-dshm\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.154531 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.154499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tmp-dir\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.154663 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.154550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tls-certs\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.154663 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.154621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-model-cache\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.255540 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-home\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.255811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hd6g\" (UniqueName: \"kubernetes.io/projected/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-kube-api-access-2hd6g\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.255811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-dshm\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.255811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tmp-dir\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.255811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tls-certs\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.255811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-model-cache\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.256172 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.255998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-home\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.256172 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.256047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tmp-dir\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.256284 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.256216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-model-cache\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.258077 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.258056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-dshm\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.258437 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.258417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tls-certs\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.263969 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.263947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hd6g\" (UniqueName: \"kubernetes.io/projected/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-kube-api-access-2hd6g\") pod \"sub-test-model-976e7c-kserve-668685b44f-7dqkp\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") " pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.416532 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.416432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:17.563665 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:17.563640    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"]
Jul 26 16:04:17.565844 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:04:17.565818    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c335ed0_98fe_49ec_b2e5_1b0d8364b7ae.slice/crio-dc3752e4f30d90f35c900fb9a5f597fbeb36415591e0484d04481616b09d01f3 WatchSource:0}: Error finding container dc3752e4f30d90f35c900fb9a5f597fbeb36415591e0484d04481616b09d01f3: Status 404 returned error can't find the container with id dc3752e4f30d90f35c900fb9a5f597fbeb36415591e0484d04481616b09d01f3
Jul 26 16:04:18.566789 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:18.566753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp" event={"ID":"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae","Type":"ContainerStarted","Data":"d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f"}
Jul 26 16:04:18.567261 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:18.566803    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp" event={"ID":"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae","Type":"ContainerStarted","Data":"dc3752e4f30d90f35c900fb9a5f597fbeb36415591e0484d04481616b09d01f3"}
Jul 26 16:04:18.584493 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:18.584444    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp" podStartSLOduration=1.584429141 podStartE2EDuration="1.584429141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:04:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:04:18.5820178 +0000 UTC m=+2767.943517603" watchObservedRunningTime="2026-07-26 16:04:18.584429141 +0000 UTC m=+2767.945928942"
Jul 26 16:04:27.417126 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:27.417086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:27.417535 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:27.417375    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:27.430410 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:27.430375    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:04:27.628304 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:04:27.628275    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:05:16.406014 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:16.405974    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"]
Jul 26 16:05:31.425707 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.425661    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp" podUID="5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" containerName="main" containerID="cri-o://d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f" gracePeriod=45
Jul 26 16:05:31.682793 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.682710    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:05:31.788998 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.788965    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"]
Jul 26 16:05:31.789345 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.789330    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" containerName="main"
Jul 26 16:05:31.789345 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.789344    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" containerName="main"
Jul 26 16:05:31.789487 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.789401    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" containerName="main"
Jul 26 16:05:31.792314 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.792294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.795113 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.795057    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"default-dockercfg-vhqb7\""
Jul 26 16:05:31.795113 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.795101    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"kube-root-ca.crt\""
Jul 26 16:05:31.795317 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.795111    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"openshift-service-ca.crt\""
Jul 26 16:05:31.795317 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.795112    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d81393\"/\"rate-test-model-d81393-kserve-self-signed-certs\""
Jul 26 16:05:31.801771 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.801741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"]
Jul 26 16:05:31.833043 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833006    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-dshm\") pod \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") "
Jul 26 16:05:31.833247 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-model-cache\") pod \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") "
Jul 26 16:05:31.833247 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833121    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hd6g\" (UniqueName: \"kubernetes.io/projected/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-kube-api-access-2hd6g\") pod \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") "
Jul 26 16:05:31.833247 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tmp-dir\") pod \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") "
Jul 26 16:05:31.833247 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-home\") pod \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") "
Jul 26 16:05:31.833247 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833192    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tls-certs\") pod \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\" (UID: \"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae\") "
Jul 26 16:05:31.833523 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833430    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" (UID: "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:05:31.833523 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833440    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" (UID: "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:05:31.833662 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.833640    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-home" (OuterVolumeSpecName: "home") pod "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" (UID: "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:05:31.835786 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.835757    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" (UID: "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:05:31.836101 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.836081    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-dshm" (OuterVolumeSpecName: "dshm") pod "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" (UID: "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:05:31.836101 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.836089    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-kube-api-access-2hd6g" (OuterVolumeSpecName: "kube-api-access-2hd6g") pod "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" (UID: "5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae"). InnerVolumeSpecName "kube-api-access-2hd6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:05:31.934228 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99d80dd-4b96-4099-a026-29be477b5220-tls-certs\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.934228 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-model-cache\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-dshm\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-home\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rblwz\" (UniqueName: \"kubernetes.io/projected/a99d80dd-4b96-4099-a026-29be477b5220-kube-api-access-rblwz\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-tmp-dir\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934449    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934461    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934471    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hd6g\" (UniqueName: \"kubernetes.io/projected/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-kube-api-access-2hd6g\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934479    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:05:31.934484 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934487    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:05:31.934909 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.934499    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:05:31.974038 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.974001    2561 generic.go:356] "Generic (PLEG): container finished" podID="5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" containerID="d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f" exitCode=0
Jul 26 16:05:31.974225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.974068    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"
Jul 26 16:05:31.974225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.974088    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp" event={"ID":"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae","Type":"ContainerDied","Data":"d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f"}
Jul 26 16:05:31.974225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.974148    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp" event={"ID":"5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae","Type":"ContainerDied","Data":"dc3752e4f30d90f35c900fb9a5f597fbeb36415591e0484d04481616b09d01f3"}
Jul 26 16:05:31.974225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.974171    2561 scope.go:117] "RemoveContainer" containerID="d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f"
Jul 26 16:05:31.985605 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.985581    2561 scope.go:117] "RemoveContainer" containerID="d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f"
Jul 26 16:05:31.986005 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:05:31.985978    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f\": container with ID starting with d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f not found: ID does not exist" containerID="d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f"
Jul 26 16:05:31.986089 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.986016    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f"} err="failed to get container status \"d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f\": rpc error: code = NotFound desc = could not find container \"d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f\": container with ID starting with d70c51746c5f8649e0ff506ba21a69fe48632c6795533d9f04df1f86023c722f not found: ID does not exist"
Jul 26 16:05:31.997637 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:31.997606    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"]
Jul 26 16:05:32.001298 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.001274    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/sub-test-model-976e7c-kserve-668685b44f-7dqkp"]
Jul 26 16:05:32.035592 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.035513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-dshm\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.035592 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.035579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-home\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.035816 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.035612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rblwz\" (UniqueName: \"kubernetes.io/projected/a99d80dd-4b96-4099-a026-29be477b5220-kube-api-access-rblwz\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.035816 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.035655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-tmp-dir\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.035816 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.035687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99d80dd-4b96-4099-a026-29be477b5220-tls-certs\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.035816 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.035706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-model-cache\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.036131 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.036111    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-home\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.036191 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.036147    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-model-cache\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.036191 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.036177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-tmp-dir\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.037984 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.037965    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-dshm\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.038225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.038211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99d80dd-4b96-4099-a026-29be477b5220-tls-certs\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.043656 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.043629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rblwz\" (UniqueName: \"kubernetes.io/projected/a99d80dd-4b96-4099-a026-29be477b5220-kube-api-access-rblwz\") pod \"rate-test-model-d81393-kserve-6dc59dff75-lk5vq\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") " pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.104412 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.104361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:32.244279 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.244246    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"]
Jul 26 16:05:32.247070 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:05:32.247040    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda99d80dd_4b96_4099_a026_29be477b5220.slice/crio-fdaa92c9b943b56df566de895ac8e99559249993a146a229ebd8e87b06d7a724 WatchSource:0}: Error finding container fdaa92c9b943b56df566de895ac8e99559249993a146a229ebd8e87b06d7a724: Status 404 returned error can't find the container with id fdaa92c9b943b56df566de895ac8e99559249993a146a229ebd8e87b06d7a724
Jul 26 16:05:32.981225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.981183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq" event={"ID":"a99d80dd-4b96-4099-a026-29be477b5220","Type":"ContainerStarted","Data":"b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6"}
Jul 26 16:05:32.981225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.981227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq" event={"ID":"a99d80dd-4b96-4099-a026-29be477b5220","Type":"ContainerStarted","Data":"fdaa92c9b943b56df566de895ac8e99559249993a146a229ebd8e87b06d7a724"}
Jul 26 16:05:32.998248 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:32.998183    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq" podStartSLOduration=1.998168454 podStartE2EDuration="1.998168454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:05:32.997129969 +0000 UTC m=+2842.358629773" watchObservedRunningTime="2026-07-26 16:05:32.998168454 +0000 UTC m=+2842.359668257"
Jul 26 16:05:33.105227 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:33.105184    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae" path="/var/lib/kubelet/pods/5c335ed0-98fe-49ec-b2e5-1b0d8364b7ae/volumes"
Jul 26 16:05:42.105334 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:42.105300    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:42.105334 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:42.105343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:42.117695 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:42.117675    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:43.049494 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:43.049461    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:05:57.190507 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.190455    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"]
Jul 26 16:05:57.194561 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.194539    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.198941 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.198887    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"kube-root-ca.crt\""
Jul 26 16:05:57.198941 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.198896    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"openshift-service-ca.crt\""
Jul 26 16:05:57.199136 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.198963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"rate-test-model-976e7c-kserve-self-signed-certs\""
Jul 26 16:05:57.199136 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.198963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-976e7c\"/\"default-dockercfg-xwnkb\""
Jul 26 16:05:57.205357 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.205332    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"]
Jul 26 16:05:57.249451 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.249418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smwz2\" (UniqueName: \"kubernetes.io/projected/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-kube-api-access-smwz2\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.249639 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.249470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-dshm\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.249639 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.249502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tls-certs\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.249639 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.249583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-home\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.249639 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.249621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tmp-dir\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.249807 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.249647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-model-cache\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351130 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smwz2\" (UniqueName: \"kubernetes.io/projected/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-kube-api-access-smwz2\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351343 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-dshm\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351343 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tls-certs\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351343 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-home\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351343 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tmp-dir\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351343 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-model-cache\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351737 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-model-cache\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351827 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-home\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.351827 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.351787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tmp-dir\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.353783 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.353760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-dshm\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.354015 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.353995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tls-certs\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.359520 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.359501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smwz2\" (UniqueName: \"kubernetes.io/projected/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-kube-api-access-smwz2\") pod \"rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") " pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.505439 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.505398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:05:57.648901 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:57.648869    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"]
Jul 26 16:05:57.650520 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:05:57.650493    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeb22a69_9af9_4d2b_9466_8ca9c2ef79cc.slice/crio-9319dac3a49256f02675172def586b36b6e253196d10a45553f9ba152a962b3b WatchSource:0}: Error finding container 9319dac3a49256f02675172def586b36b6e253196d10a45553f9ba152a962b3b: Status 404 returned error can't find the container with id 9319dac3a49256f02675172def586b36b6e253196d10a45553f9ba152a962b3b
Jul 26 16:05:58.123566 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:58.123527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b" event={"ID":"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc","Type":"ContainerStarted","Data":"f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805"}
Jul 26 16:05:58.123751 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:58.123584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b" event={"ID":"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc","Type":"ContainerStarted","Data":"9319dac3a49256f02675172def586b36b6e253196d10a45553f9ba152a962b3b"}
Jul 26 16:05:58.144414 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:05:58.144358    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b" podStartSLOduration=1.144341686 podStartE2EDuration="1.144341686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:05:58.141825156 +0000 UTC m=+2867.503324959" watchObservedRunningTime="2026-07-26 16:05:58.144341686 +0000 UTC m=+2867.505841487"
Jul 26 16:06:07.505570 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:06:07.505475    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:06:07.505570 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:06:07.505548    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:06:07.518087 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:06:07.518048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:06:08.190427 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:06:08.190390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:07:12.978591 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:12.978551    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"]
Jul 26 16:07:13.796978 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:13.796916    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"]
Jul 26 16:07:27.998360 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:27.998290    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq" podUID="a99d80dd-4b96-4099-a026-29be477b5220" containerName="main" containerID="cri-o://b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6" gracePeriod=45
Jul 26 16:07:28.255684 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.255623    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:07:28.317100 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317070    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rblwz\" (UniqueName: \"kubernetes.io/projected/a99d80dd-4b96-4099-a026-29be477b5220-kube-api-access-rblwz\") pod \"a99d80dd-4b96-4099-a026-29be477b5220\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") "
Jul 26 16:07:28.317249 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317118    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-tmp-dir\") pod \"a99d80dd-4b96-4099-a026-29be477b5220\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") "
Jul 26 16:07:28.317249 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317153    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99d80dd-4b96-4099-a026-29be477b5220-tls-certs\") pod \"a99d80dd-4b96-4099-a026-29be477b5220\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") "
Jul 26 16:07:28.317249 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317188    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-model-cache\") pod \"a99d80dd-4b96-4099-a026-29be477b5220\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") "
Jul 26 16:07:28.317249 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-home\") pod \"a99d80dd-4b96-4099-a026-29be477b5220\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") "
Jul 26 16:07:28.317417 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317355    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-dshm\") pod \"a99d80dd-4b96-4099-a026-29be477b5220\" (UID: \"a99d80dd-4b96-4099-a026-29be477b5220\") "
Jul 26 16:07:28.317472 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317421    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a99d80dd-4b96-4099-a026-29be477b5220" (UID: "a99d80dd-4b96-4099-a026-29be477b5220"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:28.317530 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317482    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-home" (OuterVolumeSpecName: "home") pod "a99d80dd-4b96-4099-a026-29be477b5220" (UID: "a99d80dd-4b96-4099-a026-29be477b5220"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:28.317679 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317658    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:28.317679 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317680    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:28.317843 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.317683    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-model-cache" (OuterVolumeSpecName: "model-cache") pod "a99d80dd-4b96-4099-a026-29be477b5220" (UID: "a99d80dd-4b96-4099-a026-29be477b5220"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:28.319370 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.319343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a99d80dd-4b96-4099-a026-29be477b5220-kube-api-access-rblwz" (OuterVolumeSpecName: "kube-api-access-rblwz") pod "a99d80dd-4b96-4099-a026-29be477b5220" (UID: "a99d80dd-4b96-4099-a026-29be477b5220"). InnerVolumeSpecName "kube-api-access-rblwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:07:28.319466 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.319378    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a99d80dd-4b96-4099-a026-29be477b5220-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a99d80dd-4b96-4099-a026-29be477b5220" (UID: "a99d80dd-4b96-4099-a026-29be477b5220"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:07:28.319466 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.319438    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-dshm" (OuterVolumeSpecName: "dshm") pod "a99d80dd-4b96-4099-a026-29be477b5220" (UID: "a99d80dd-4b96-4099-a026-29be477b5220"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:28.418538 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.418508    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99d80dd-4b96-4099-a026-29be477b5220-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:28.418538 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.418534    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:28.418538 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.418542    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99d80dd-4b96-4099-a026-29be477b5220-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:28.418772 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.418549    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rblwz\" (UniqueName: \"kubernetes.io/projected/a99d80dd-4b96-4099-a026-29be477b5220-kube-api-access-rblwz\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:28.629559 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.629464    2561 generic.go:356] "Generic (PLEG): container finished" podID="a99d80dd-4b96-4099-a026-29be477b5220" containerID="b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6" exitCode=0
Jul 26 16:07:28.629559 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.629508    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"
Jul 26 16:07:28.629559 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.629547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq" event={"ID":"a99d80dd-4b96-4099-a026-29be477b5220","Type":"ContainerDied","Data":"b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6"}
Jul 26 16:07:28.629811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.629597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq" event={"ID":"a99d80dd-4b96-4099-a026-29be477b5220","Type":"ContainerDied","Data":"fdaa92c9b943b56df566de895ac8e99559249993a146a229ebd8e87b06d7a724"}
Jul 26 16:07:28.629811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.629619    2561 scope.go:117] "RemoveContainer" containerID="b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6"
Jul 26 16:07:28.639600 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.639584    2561 scope.go:117] "RemoveContainer" containerID="b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6"
Jul 26 16:07:28.639878 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:07:28.639861    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6\": container with ID starting with b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6 not found: ID does not exist" containerID="b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6"
Jul 26 16:07:28.639961 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.639885    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6"} err="failed to get container status \"b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6\": rpc error: code = NotFound desc = could not find container \"b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6\": container with ID starting with b8e1a8f8473392f4a174706d3a0913fc8fb1bc3f417e302ccd735e9d4361ccb6 not found: ID does not exist"
Jul 26 16:07:28.651563 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.651539    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"]
Jul 26 16:07:28.658139 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.658117    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d81393/rate-test-model-d81393-kserve-6dc59dff75-lk5vq"]
Jul 26 16:07:28.816207 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:28.816171    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b" podUID="aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" containerName="main" containerID="cri-o://f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805" gracePeriod=45
Jul 26 16:07:29.076408 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.076383    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:07:29.107254 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.107216    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a99d80dd-4b96-4099-a026-29be477b5220" path="/var/lib/kubelet/pods/a99d80dd-4b96-4099-a026-29be477b5220/volumes"
Jul 26 16:07:29.123827 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.123805    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-dshm\") pod \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") "
Jul 26 16:07:29.123969 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.123844    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-model-cache\") pod \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") "
Jul 26 16:07:29.123969 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.123867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smwz2\" (UniqueName: \"kubernetes.io/projected/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-kube-api-access-smwz2\") pod \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") "
Jul 26 16:07:29.123969 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.123909    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tmp-dir\") pod \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") "
Jul 26 16:07:29.124131 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.123982    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tls-certs\") pod \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") "
Jul 26 16:07:29.124131 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.124015    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-home\") pod \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\" (UID: \"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc\") "
Jul 26 16:07:29.124131 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.124106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-model-cache" (OuterVolumeSpecName: "model-cache") pod "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" (UID: "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:29.124284 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.124261    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-model-cache\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:29.124341 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.124287    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" (UID: "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:29.124393 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.124366    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-home" (OuterVolumeSpecName: "home") pod "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" (UID: "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:29.126144 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.126117    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-dshm" (OuterVolumeSpecName: "dshm") pod "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" (UID: "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:07:29.126346 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.126318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" (UID: "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:07:29.126533 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.126516    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-kube-api-access-smwz2" (OuterVolumeSpecName: "kube-api-access-smwz2") pod "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" (UID: "aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc"). InnerVolumeSpecName "kube-api-access-smwz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:07:29.225757 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.225664    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tmp-dir\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:29.225757 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.225695    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-tls-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:29.225757 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.225705    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-home\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:29.225757 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.225716    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-dshm\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:29.225757 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.225729    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smwz2\" (UniqueName: \"kubernetes.io/projected/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc-kube-api-access-smwz2\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:07:29.637728 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.637689    2561 generic.go:356] "Generic (PLEG): container finished" podID="aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" containerID="f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805" exitCode=0
Jul 26 16:07:29.637950 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.637750    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"
Jul 26 16:07:29.637950 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.637781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b" event={"ID":"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc","Type":"ContainerDied","Data":"f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805"}
Jul 26 16:07:29.637950 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.637840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b" event={"ID":"aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc","Type":"ContainerDied","Data":"9319dac3a49256f02675172def586b36b6e253196d10a45553f9ba152a962b3b"}
Jul 26 16:07:29.637950 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.637863    2561 scope.go:117] "RemoveContainer" containerID="f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805"
Jul 26 16:07:29.650553 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.650530    2561 scope.go:117] "RemoveContainer" containerID="f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805"
Jul 26 16:07:29.650808 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:07:29.650791    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805\": container with ID starting with f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805 not found: ID does not exist" containerID="f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805"
Jul 26 16:07:29.650853 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.650817    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805"} err="failed to get container status \"f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805\": rpc error: code = NotFound desc = could not find container \"f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805\": container with ID starting with f5faf60c9b9b93cf4b4654bdcf0e2ad8998bdfb8e6d13b852bd4fd774f32c805 not found: ID does not exist"
Jul 26 16:07:29.664465 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.664442    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"]
Jul 26 16:07:29.669407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:29.669387    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-976e7c/rate-test-model-976e7c-kserve-7574dd4bbc-ltf8b"]
Jul 26 16:07:31.105106 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:31.105078    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" path="/var/lib/kubelet/pods/aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc/volumes"
Jul 26 16:07:33.933984 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.933949    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"]
Jul 26 16:07:33.934537 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.934517    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" containerName="main"
Jul 26 16:07:33.934626 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.934539    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" containerName="main"
Jul 26 16:07:33.934626 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.934554    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a99d80dd-4b96-4099-a026-29be477b5220" containerName="main"
Jul 26 16:07:33.934626 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.934562    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a99d80dd-4b96-4099-a026-29be477b5220" containerName="main"
Jul 26 16:07:33.934778 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.934686    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a99d80dd-4b96-4099-a026-29be477b5220" containerName="main"
Jul 26 16:07:33.934778 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.934704    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb22a69-9af9-4d2b-9466-8ca9c2ef79cc" containerName="main"
Jul 26 16:07:33.939214 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.939193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:33.942972 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.942947    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9a599d-openshift-default-dockercfg-zhgl7\""
Jul 26 16:07:33.951688 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:33.951668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"]
Jul 26 16:07:34.068568 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-data\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.068568 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-socket\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.068825 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c59536a-929f-4768-95c8-f776792fd364-istiod-ca-cert\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.068825 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-istio-token\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.068825 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c59536a-929f-4768-95c8-f776792fd364-istio-podinfo\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.069040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-credential-socket\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.069040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-certs\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.069040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.068897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxb9j\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-kube-api-access-qxb9j\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.069040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.069027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-envoy\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169525 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-istio-token\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169704 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c59536a-929f-4768-95c8-f776792fd364-istio-podinfo\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169704 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-credential-socket\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169704 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-certs\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169823 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxb9j\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-kube-api-access-qxb9j\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169892 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-envoy\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.169981 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-data\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.169996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-socket\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.170029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c59536a-929f-4768-95c8-f776792fd364-istiod-ca-cert\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170268 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.170244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-credential-socket\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170393 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.170305    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-certs\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170471 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.170450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-data\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170688 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.170669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-socket\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.170782 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.170767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c59536a-929f-4768-95c8-f776792fd364-istiod-ca-cert\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.172189 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.172168    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-envoy\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.172446 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.172426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c59536a-929f-4768-95c8-f776792fd364-istio-podinfo\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.177974 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.177953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-istio-token\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.178582 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.178563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxb9j\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-kube-api-access-qxb9j\") pod \"e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") " pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.250316 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.250286    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:34.392748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.392716    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"]
Jul 26 16:07:34.393806 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:07:34.393775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c59536a_929f_4768_95c8_f776792fd364.slice/crio-9b4013f9466983a576b3d38f2d9fb9a8d23406253454cfd210407f90be0edddf WatchSource:0}: Error finding container 9b4013f9466983a576b3d38f2d9fb9a8d23406253454cfd210407f90be0edddf: Status 404 returned error can't find the container with id 9b4013f9466983a576b3d38f2d9fb9a8d23406253454cfd210407f90be0edddf
Jul 26 16:07:34.396062 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.396026    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:07:34.396138 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.396096    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:07:34.396138 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.396130    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:07:34.668648 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.668536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" event={"ID":"4c59536a-929f-4768-95c8-f776792fd364","Type":"ContainerStarted","Data":"91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"}
Jul 26 16:07:34.668648 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.668595    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" event={"ID":"4c59536a-929f-4768-95c8-f776792fd364","Type":"ContainerStarted","Data":"9b4013f9466983a576b3d38f2d9fb9a8d23406253454cfd210407f90be0edddf"}
Jul 26 16:07:34.695731 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:34.695666    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podStartSLOduration=1.695647466 podStartE2EDuration="1.695647466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:07:34.693677878 +0000 UTC m=+2964.055177706" watchObservedRunningTime="2026-07-26 16:07:34.695647466 +0000 UTC m=+2964.057147267"
Jul 26 16:07:35.250516 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:35.250481    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:35.255418 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:35.255392    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:35.673983 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:35.673889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:35.675004 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:35.674984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:51.715158 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:51.715109    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 16:07:51.715597 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:51.715177    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 16:07:53.789152 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:53.789058    2561 generic.go:356] "Generic (PLEG): container finished" podID="4c59536a-929f-4768-95c8-f776792fd364" containerID="91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f" exitCode=0
Jul 26 16:07:53.789670 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:53.789140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" event={"ID":"4c59536a-929f-4768-95c8-f776792fd364","Type":"ContainerDied","Data":"91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"}
Jul 26 16:07:53.789740 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:53.789681    2561 scope.go:117] "RemoveContainer" containerID="91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"
Jul 26 16:07:53.790791 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:53.790762    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:07:53.790852 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:53.790834    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:07:53.790894 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:53.790870    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:07:54.797718 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:54.797683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" event={"ID":"4c59536a-929f-4768-95c8-f776792fd364","Type":"ContainerStarted","Data":"460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c"}
Jul 26 16:07:55.251000 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:55.250953    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:55.251281 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:55.251257    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:07:55.251365 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:55.251334    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:07:56.250993 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:56.250919    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:07:56.251393 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:56.251039    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:07:57.251291 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:57.251252    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:07:57.251670 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:57.251326    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:07:58.253977 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:58.253408    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:07:58.253977 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:58.253471    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:07:59.254285 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:59.254257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:59.254771 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:59.254541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:07:59.255244 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:07:59.255226    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:08:02.634004 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.633971    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"]
Jul 26 16:08:02.637956 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.637919    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.640971 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.640920    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-51789d-openshift-default-dockercfg-6q2m5\""
Jul 26 16:08:02.651156 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.651132    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"]
Jul 26 16:08:02.737041 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737009    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-podinfo\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737228 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-token\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737228 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-certs\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737228 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-credential-socket\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-data\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istiod-ca-cert\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-socket\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9rw6\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-kube-api-access-d9rw6\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.737407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.737347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-envoy\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838118 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-podinfo\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838118 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-token\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838371 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-certs\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838371 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-credential-socket\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838371 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-data\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838371 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istiod-ca-cert\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838585 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-socket\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838585 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9rw6\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-kube-api-access-d9rw6\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838585 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-envoy\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838736 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-certs\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838736 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838657    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-data\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.838881 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.838855    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-socket\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.839343 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.839313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istiod-ca-cert\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.839722 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.839696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-credential-socket\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.841405 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.841383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-envoy\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.841522 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.841500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-podinfo\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.847418 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.847393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-token\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.847964 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.847944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9rw6\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-kube-api-access-d9rw6\") pod \"e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") " pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:02.950742 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:02.950652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:03.105785 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:08:03.105753    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bca293d_bc9e_43ed_82b6_9b93b443ac38.slice/crio-d089f3c8a807871d43b03e94d2b93c941dedfff187923962e175bb79d0cfd9c2 WatchSource:0}: Error finding container d089f3c8a807871d43b03e94d2b93c941dedfff187923962e175bb79d0cfd9c2: Status 404 returned error can't find the container with id d089f3c8a807871d43b03e94d2b93c941dedfff187923962e175bb79d0cfd9c2
Jul 26 16:08:03.106547 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.106523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"]
Jul 26 16:08:03.107893 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.107862    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:08:03.107979 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.107943    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:08:03.108034 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.107980    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:08:03.852921 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.852888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" event={"ID":"2bca293d-bc9e-43ed-82b6-9b93b443ac38","Type":"ContainerStarted","Data":"208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"}
Jul 26 16:08:03.853318 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.852980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" event={"ID":"2bca293d-bc9e-43ed-82b6-9b93b443ac38","Type":"ContainerStarted","Data":"d089f3c8a807871d43b03e94d2b93c941dedfff187923962e175bb79d0cfd9c2"}
Jul 26 16:08:03.876607 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.876552    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podStartSLOduration=1.8765362780000001 podStartE2EDuration="1.876536278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:08:03.873090306 +0000 UTC m=+2993.234590109" watchObservedRunningTime="2026-07-26 16:08:03.876536278 +0000 UTC m=+2993.238036081"
Jul 26 16:08:03.950788 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:03.950757    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:04.956155 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:04.956121    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:05.865524 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:05.865487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:05.866583 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:05.866561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:21.908129 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:21.908076    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 16:08:21.908760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:21.908156    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 16:08:23.984046 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:23.983917    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerID="208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc" exitCode=0
Jul 26 16:08:23.984046 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:23.983990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" event={"ID":"2bca293d-bc9e-43ed-82b6-9b93b443ac38","Type":"ContainerDied","Data":"208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"}
Jul 26 16:08:23.984479 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:23.984400    2561 scope.go:117] "RemoveContainer" containerID="208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"
Jul 26 16:08:23.985497 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:23.985469    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:08:23.985558 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:23.985537    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:08:23.985594 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:23.985578    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 26 16:08:24.991349 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:24.991313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" event={"ID":"2bca293d-bc9e-43ed-82b6-9b93b443ac38","Type":"ContainerStarted","Data":"baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c"}
Jul 26 16:08:25.951627 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:25.951577    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:08:25.951847 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:25.951662    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:08:25.952065 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:25.952040    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:26.951807 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:26.951767    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:08:26.952283 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:26.951852    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:08:27.951830 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:27.951784    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:08:27.952245 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:27.951859    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:08:28.952114 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:28.952067    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:08:28.952546 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:28.952160    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:08:29.954751 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:29.954714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:29.955198 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:29.954974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:08:29.955618 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:08:29.955599    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:09:20.570314 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.570219    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"]
Jul 26 16:09:20.573701 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.573683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.576645 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.576619    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-36235c\""
Jul 26 16:09:20.576804 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.576788    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-36235c-dockercfg-j5mdg\""
Jul 26 16:09:20.585213 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.585188    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"]
Jul 26 16:09:20.599841 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.599807    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"]
Jul 26 16:09:20.603329 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.603311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.614696 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.614670    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"]
Jul 26 16:09:20.685689 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.685654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48198c69-3481-4b7f-9e4d-19d02144746b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.685875 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.685761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js5qn\" (UniqueName: \"kubernetes.io/projected/48198c69-3481-4b7f-9e4d-19d02144746b-kube-api-access-js5qn\") pod \"payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.786840 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.786804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzhs\" (UniqueName: \"kubernetes.io/projected/0b4f7139-2098-46a4-a873-a168681b6b61-kube-api-access-wpzhs\") pod \"payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.787063 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.786851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js5qn\" (UniqueName: \"kubernetes.io/projected/48198c69-3481-4b7f-9e4d-19d02144746b-kube-api-access-js5qn\") pod \"payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.787063 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.786954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48198c69-3481-4b7f-9e4d-19d02144746b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.787063 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.787016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b4f7139-2098-46a4-a873-a168681b6b61-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.787705 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.787686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48198c69-3481-4b7f-9e4d-19d02144746b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.794942 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.794894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js5qn\" (UniqueName: \"kubernetes.io/projected/48198c69-3481-4b7f-9e4d-19d02144746b-kube-api-access-js5qn\") pod \"payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.885060 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.884970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:20.888571 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.888097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b4f7139-2098-46a4-a873-a168681b6b61-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.888571 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.888178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzhs\" (UniqueName: \"kubernetes.io/projected/0b4f7139-2098-46a4-a873-a168681b6b61-kube-api-access-wpzhs\") pod \"payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.888794 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.888774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b4f7139-2098-46a4-a873-a168681b6b61-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.896471 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.896441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzhs\" (UniqueName: \"kubernetes.io/projected/0b4f7139-2098-46a4-a873-a168681b6b61-kube-api-access-wpzhs\") pod \"payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:20.915492 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:20.915452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:21.057857 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.057824    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"]
Jul 26 16:09:21.094981 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.094957    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"]
Jul 26 16:09:21.098252 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:09:21.098225    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4f7139_2098_46a4_a873_a168681b6b61.slice/crio-cefc114abbfa562e348763a72417f74dede05bd250d0c0068bd2cbc69aa84793 WatchSource:0}: Error finding container cefc114abbfa562e348763a72417f74dede05bd250d0c0068bd2cbc69aa84793: Status 404 returned error can't find the container with id cefc114abbfa562e348763a72417f74dede05bd250d0c0068bd2cbc69aa84793
Jul 26 16:09:21.299651 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.299613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs" event={"ID":"48198c69-3481-4b7f-9e4d-19d02144746b","Type":"ContainerStarted","Data":"d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b"}
Jul 26 16:09:21.299849 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.299687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:21.299849 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.299709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs" event={"ID":"48198c69-3481-4b7f-9e4d-19d02144746b","Type":"ContainerStarted","Data":"e98396e9729ece4e05c01e89c4c74dadf153472244d7c01d3002de7ac602f4f2"}
Jul 26 16:09:21.301171 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.301144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm" event={"ID":"0b4f7139-2098-46a4-a873-a168681b6b61","Type":"ContainerStarted","Data":"a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224"}
Jul 26 16:09:21.301308 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.301193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm" event={"ID":"0b4f7139-2098-46a4-a873-a168681b6b61","Type":"ContainerStarted","Data":"cefc114abbfa562e348763a72417f74dede05bd250d0c0068bd2cbc69aa84793"}
Jul 26 16:09:21.301308 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.301245    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:21.318897 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.318853    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs" podStartSLOduration=1.318839677 podStartE2EDuration="1.318839677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:21.316623749 +0000 UTC m=+3070.678123551" watchObservedRunningTime="2026-07-26 16:09:21.318839677 +0000 UTC m=+3070.680339481"
Jul 26 16:09:21.334118 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:21.334073    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm" podStartSLOduration=1.33405721 podStartE2EDuration="1.33405721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:09:21.332211537 +0000 UTC m=+3070.693711341" watchObservedRunningTime="2026-07-26 16:09:21.33405721 +0000 UTC m=+3070.695557015"
Jul 26 16:09:32.309685 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:32.309654    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:32.310088 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:32.309724    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:48.974614 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:48.974572    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"]
Jul 26 16:09:48.975138 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:48.974865    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm" podUID="0b4f7139-2098-46a4-a873-a168681b6b61" containerName="payload-processing" containerID="cri-o://a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224" gracePeriod=30
Jul 26 16:09:48.981081 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:48.981012    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"]
Jul 26 16:09:48.981299 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:48.981270    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs" podUID="48198c69-3481-4b7f-9e4d-19d02144746b" containerName="payload-pre-processing" containerID="cri-o://d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b" gracePeriod=30
Jul 26 16:09:49.246114 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.246083    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:49.276972 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.276921    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:49.348646 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.348602    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpzhs\" (UniqueName: \"kubernetes.io/projected/0b4f7139-2098-46a4-a873-a168681b6b61-kube-api-access-wpzhs\") pod \"0b4f7139-2098-46a4-a873-a168681b6b61\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") "
Jul 26 16:09:49.348832 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.348655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js5qn\" (UniqueName: \"kubernetes.io/projected/48198c69-3481-4b7f-9e4d-19d02144746b-kube-api-access-js5qn\") pod \"48198c69-3481-4b7f-9e4d-19d02144746b\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") "
Jul 26 16:09:49.348832 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.348700    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b4f7139-2098-46a4-a873-a168681b6b61-plugins-config-volume\") pod \"0b4f7139-2098-46a4-a873-a168681b6b61\" (UID: \"0b4f7139-2098-46a4-a873-a168681b6b61\") "
Jul 26 16:09:49.348832 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.348779    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48198c69-3481-4b7f-9e4d-19d02144746b-plugins-config-volume\") pod \"48198c69-3481-4b7f-9e4d-19d02144746b\" (UID: \"48198c69-3481-4b7f-9e4d-19d02144746b\") "
Jul 26 16:09:49.349154 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.349125    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b4f7139-2098-46a4-a873-a168681b6b61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b4f7139-2098-46a4-a873-a168681b6b61" (UID: "0b4f7139-2098-46a4-a873-a168681b6b61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:09:49.349291 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.349243    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48198c69-3481-4b7f-9e4d-19d02144746b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48198c69-3481-4b7f-9e4d-19d02144746b" (UID: "48198c69-3481-4b7f-9e4d-19d02144746b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:09:49.351135 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.351106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48198c69-3481-4b7f-9e4d-19d02144746b-kube-api-access-js5qn" (OuterVolumeSpecName: "kube-api-access-js5qn") pod "48198c69-3481-4b7f-9e4d-19d02144746b" (UID: "48198c69-3481-4b7f-9e4d-19d02144746b"). InnerVolumeSpecName "kube-api-access-js5qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:09:49.351135 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.351125    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b4f7139-2098-46a4-a873-a168681b6b61-kube-api-access-wpzhs" (OuterVolumeSpecName: "kube-api-access-wpzhs") pod "0b4f7139-2098-46a4-a873-a168681b6b61" (UID: "0b4f7139-2098-46a4-a873-a168681b6b61"). InnerVolumeSpecName "kube-api-access-wpzhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:09:49.449839 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.449777    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48198c69-3481-4b7f-9e4d-19d02144746b-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:09:49.449839 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.449831    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpzhs\" (UniqueName: \"kubernetes.io/projected/0b4f7139-2098-46a4-a873-a168681b6b61-kube-api-access-wpzhs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:09:49.449839 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.449853    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js5qn\" (UniqueName: \"kubernetes.io/projected/48198c69-3481-4b7f-9e4d-19d02144746b-kube-api-access-js5qn\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:09:49.450122 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.449862    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b4f7139-2098-46a4-a873-a168681b6b61-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:09:49.460195 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.460163    2561 generic.go:356] "Generic (PLEG): container finished" podID="48198c69-3481-4b7f-9e4d-19d02144746b" containerID="d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b" exitCode=0
Jul 26 16:09:49.460373 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.460212    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"
Jul 26 16:09:49.460373 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.460251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs" event={"ID":"48198c69-3481-4b7f-9e4d-19d02144746b","Type":"ContainerDied","Data":"d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b"}
Jul 26 16:09:49.460373 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.460317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs" event={"ID":"48198c69-3481-4b7f-9e4d-19d02144746b","Type":"ContainerDied","Data":"e98396e9729ece4e05c01e89c4c74dadf153472244d7c01d3002de7ac602f4f2"}
Jul 26 16:09:49.460373 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.460351    2561 scope.go:117] "RemoveContainer" containerID="d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b"
Jul 26 16:09:49.461751 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.461723    2561 generic.go:356] "Generic (PLEG): container finished" podID="0b4f7139-2098-46a4-a873-a168681b6b61" containerID="a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224" exitCode=0
Jul 26 16:09:49.461887 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.461764    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"
Jul 26 16:09:49.461887 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.461819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm" event={"ID":"0b4f7139-2098-46a4-a873-a168681b6b61","Type":"ContainerDied","Data":"a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224"}
Jul 26 16:09:49.462025 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.461890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm" event={"ID":"0b4f7139-2098-46a4-a873-a168681b6b61","Type":"ContainerDied","Data":"cefc114abbfa562e348763a72417f74dede05bd250d0c0068bd2cbc69aa84793"}
Jul 26 16:09:49.470217 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.470195    2561 scope.go:117] "RemoveContainer" containerID="d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b"
Jul 26 16:09:49.470571 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:09:49.470552    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b\": container with ID starting with d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b not found: ID does not exist" containerID="d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b"
Jul 26 16:09:49.470666 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.470582    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b"} err="failed to get container status \"d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b\": rpc error: code = NotFound desc = could not find container \"d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b\": container with ID starting with d01ed451d118432c2069f1c8dd5015e7c06313d7588f493293f25b773695121b not found: ID does not exist"
Jul 26 16:09:49.470666 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.470604    2561 scope.go:117] "RemoveContainer" containerID="a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224"
Jul 26 16:09:49.479593 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.479575    2561 scope.go:117] "RemoveContainer" containerID="a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224"
Jul 26 16:09:49.479877 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:09:49.479857    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224\": container with ID starting with a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224 not found: ID does not exist" containerID="a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224"
Jul 26 16:09:49.479977 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.479884    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224"} err="failed to get container status \"a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224\": rpc error: code = NotFound desc = could not find container \"a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224\": container with ID starting with a41935affbef89b14462b12d1701883bfe0766f584598406bcf4d18970e93224 not found: ID does not exist"
Jul 26 16:09:49.486147 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.486121    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"]
Jul 26 16:09:49.490238 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.490215    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-36235c-5798b64676-8trbs"]
Jul 26 16:09:49.501669 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.501638    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"]
Jul 26 16:09:49.505106 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:49.505079    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-36235c-6b74554f64-95gbm"]
Jul 26 16:09:51.105595 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:51.105552    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b4f7139-2098-46a4-a873-a168681b6b61" path="/var/lib/kubelet/pods/0b4f7139-2098-46a4-a873-a168681b6b61/volumes"
Jul 26 16:09:51.106259 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:09:51.106237    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48198c69-3481-4b7f-9e4d-19d02144746b" path="/var/lib/kubelet/pods/48198c69-3481-4b7f-9e4d-19d02144746b/volumes"
Jul 26 16:10:03.205289 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205253    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"]
Jul 26 16:10:03.205748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205627    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b4f7139-2098-46a4-a873-a168681b6b61" containerName="payload-processing"
Jul 26 16:10:03.205748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205639    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b4f7139-2098-46a4-a873-a168681b6b61" containerName="payload-processing"
Jul 26 16:10:03.205748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205658    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48198c69-3481-4b7f-9e4d-19d02144746b" containerName="payload-pre-processing"
Jul 26 16:10:03.205748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205663    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="48198c69-3481-4b7f-9e4d-19d02144746b" containerName="payload-pre-processing"
Jul 26 16:10:03.205748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205738    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="48198c69-3481-4b7f-9e4d-19d02144746b" containerName="payload-pre-processing"
Jul 26 16:10:03.205748 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.205748    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b4f7139-2098-46a4-a873-a168681b6b61" containerName="payload-processing"
Jul 26 16:10:03.209865 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.209849    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:03.212776 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.212758    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxrsw\""
Jul 26 16:10:03.212877 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.212848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:10:03.218141 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.218116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"]
Jul 26 16:10:03.285040 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.285000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67120c25-906e-47b4-bf39-a9a0d0fd0471-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq\" (UID: \"67120c25-906e-47b4-bf39-a9a0d0fd0471\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:03.386842 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.386799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67120c25-906e-47b4-bf39-a9a0d0fd0471-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq\" (UID: \"67120c25-906e-47b4-bf39-a9a0d0fd0471\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:03.387524 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.387496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67120c25-906e-47b4-bf39-a9a0d0fd0471-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq\" (UID: \"67120c25-906e-47b4-bf39-a9a0d0fd0471\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:03.522117 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.522076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:03.659483 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:03.659454    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"]
Jul 26 16:10:03.661666 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:10:03.661636    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67120c25_906e_47b4_bf39_a9a0d0fd0471.slice/crio-bedce9d1456e11e2a2895d143b57dc8d5c70626723a73e5989dab324bc3166ab WatchSource:0}: Error finding container bedce9d1456e11e2a2895d143b57dc8d5c70626723a73e5989dab324bc3166ab: Status 404 returned error can't find the container with id bedce9d1456e11e2a2895d143b57dc8d5c70626723a73e5989dab324bc3166ab
Jul 26 16:10:04.550793 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:04.550761    2561 generic.go:356] "Generic (PLEG): container finished" podID="67120c25-906e-47b4-bf39-a9a0d0fd0471" containerID="2b1c79d34d343b990c5c5e2e4b8330099ca7ab6612f4422f9adcca395873e2de" exitCode=0
Jul 26 16:10:04.551241 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:04.550851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq" event={"ID":"67120c25-906e-47b4-bf39-a9a0d0fd0471","Type":"ContainerDied","Data":"2b1c79d34d343b990c5c5e2e4b8330099ca7ab6612f4422f9adcca395873e2de"}
Jul 26 16:10:04.551241 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:04.550918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq" event={"ID":"67120c25-906e-47b4-bf39-a9a0d0fd0471","Type":"ContainerStarted","Data":"bedce9d1456e11e2a2895d143b57dc8d5c70626723a73e5989dab324bc3166ab"}
Jul 26 16:10:05.703361 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:05.703335    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:05.810000 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:05.809903    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67120c25-906e-47b4-bf39-a9a0d0fd0471-maas-api-service-ca\") pod \"67120c25-906e-47b4-bf39-a9a0d0fd0471\" (UID: \"67120c25-906e-47b4-bf39-a9a0d0fd0471\") "
Jul 26 16:10:05.810263 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:05.810237    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67120c25-906e-47b4-bf39-a9a0d0fd0471-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67120c25-906e-47b4-bf39-a9a0d0fd0471" (UID: "67120c25-906e-47b4-bf39-a9a0d0fd0471"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:10:05.911691 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:05.911651    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67120c25-906e-47b4-bf39-a9a0d0fd0471-maas-api-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:10:06.563780 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:06.563747    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"
Jul 26 16:10:06.563780 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:06.563768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq" event={"ID":"67120c25-906e-47b4-bf39-a9a0d0fd0471","Type":"ContainerDied","Data":"bedce9d1456e11e2a2895d143b57dc8d5c70626723a73e5989dab324bc3166ab"}
Jul 26 16:10:06.564023 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:06.563812    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bedce9d1456e11e2a2895d143b57dc8d5c70626723a73e5989dab324bc3166ab"
Jul 26 16:10:23.297543 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:23.297506    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"]
Jul 26 16:10:23.301309 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:23.301283    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9a599d-dgltq"]
Jul 26 16:10:25.104715 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:10:25.104680    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67120c25-906e-47b4-bf39-a9a0d0fd0471" path="/var/lib/kubelet/pods/67120c25-906e-47b4-bf39-a9a0d0fd0471/volumes"
Jul 26 16:11:12.365300 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:12.365260    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"]
Jul 26 16:11:12.365839 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:12.365519    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" containerID="cri-o://460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c" gracePeriod=30
Jul 26 16:11:14.257232 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:14.257189    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 16:11:14.257598 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:14.257248    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:11:17.631608 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.631541    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:11:17.666770 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666742    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-istio-token\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666786    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-socket\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666810    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-credential-socket\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666827    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-envoy\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c59536a-929f-4768-95c8-f776792fd364-istio-podinfo\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666890    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c59536a-929f-4768-95c8-f776792fd364-istiod-ca-cert\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.666949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxb9j\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-kube-api-access-qxb9j\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-certs\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667037    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-data\") pod \"4c59536a-929f-4768-95c8-f776792fd364\" (UID: \"4c59536a-929f-4768-95c8-f776792fd364\") "
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667134    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667171    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667408    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-socket\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667426    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-credential-socket\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667633    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:17.667726 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.667659    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c59536a-929f-4768-95c8-f776792fd364-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:11:17.668733 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.668041    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:17.669496 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.669472    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-kube-api-access-qxb9j" (OuterVolumeSpecName: "kube-api-access-qxb9j") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "kube-api-access-qxb9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:11:17.669581 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.669541    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:17.669656 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.669631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:11:17.669725 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.669696    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c59536a-929f-4768-95c8-f776792fd364-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c59536a-929f-4768-95c8-f776792fd364" (UID: "4c59536a-929f-4768-95c8-f776792fd364"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:11:17.768193 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768157    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-istio-token\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.768193 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768186    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-envoy\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.768193 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768195    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c59536a-929f-4768-95c8-f776792fd364-istio-podinfo\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.768499 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768213    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c59536a-929f-4768-95c8-f776792fd364-istiod-ca-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.768499 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768222    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxb9j\" (UniqueName: \"kubernetes.io/projected/4c59536a-929f-4768-95c8-f776792fd364-kube-api-access-qxb9j\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.768499 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768232    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-workload-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.768499 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.768240    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c59536a-929f-4768-95c8-f776792fd364-istio-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:17.949010 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.948896    2561 generic.go:356] "Generic (PLEG): container finished" podID="4c59536a-929f-4768-95c8-f776792fd364" containerID="460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c" exitCode=0
Jul 26 16:11:17.949010 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.948977    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"
Jul 26 16:11:17.949185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.948979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" event={"ID":"4c59536a-929f-4768-95c8-f776792fd364","Type":"ContainerDied","Data":"460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c"}
Jul 26 16:11:17.949185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.949090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r" event={"ID":"4c59536a-929f-4768-95c8-f776792fd364","Type":"ContainerDied","Data":"9b4013f9466983a576b3d38f2d9fb9a8d23406253454cfd210407f90be0edddf"}
Jul 26 16:11:17.949185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.949111    2561 scope.go:117] "RemoveContainer" containerID="460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c"
Jul 26 16:11:17.966435 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.966414    2561 scope.go:117] "RemoveContainer" containerID="91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"
Jul 26 16:11:17.974744 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.974727    2561 scope.go:117] "RemoveContainer" containerID="460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c"
Jul 26 16:11:17.975006 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:11:17.974987    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c\": container with ID starting with 460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c not found: ID does not exist" containerID="460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c"
Jul 26 16:11:17.975074 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.975015    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c"} err="failed to get container status \"460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c\": rpc error: code = NotFound desc = could not find container \"460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c\": container with ID starting with 460905a739152b53d0692987c26493e28cd63946cda49145e27da8ee2627897c not found: ID does not exist"
Jul 26 16:11:17.975074 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.975037    2561 scope.go:117] "RemoveContainer" containerID="91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"
Jul 26 16:11:17.975260 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:11:17.975244    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f\": container with ID starting with 91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f not found: ID does not exist" containerID="91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"
Jul 26 16:11:17.975313 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.975265    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f"} err="failed to get container status \"91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f\": rpc error: code = NotFound desc = could not find container \"91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f\": container with ID starting with 91bf973ac5ec053c573eb74cc76a68490400b36d73f5bb05378bb41406e5d74f not found: ID does not exist"
Jul 26 16:11:17.978847 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.978821    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"]
Jul 26 16:11:17.982213 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:17.982188    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9a599d-openshift-default-5c6d8bf6c6-fsq6r"]
Jul 26 16:11:19.105580 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:19.105547    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c59536a-929f-4768-95c8-f776792fd364" path="/var/lib/kubelet/pods/4c59536a-929f-4768-95c8-f776792fd364/volumes"
Jul 26 16:11:34.416823 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:34.416784    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"]
Jul 26 16:11:34.417330 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:34.417074    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy" containerID="cri-o://baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c" gracePeriod=30
Jul 26 16:11:39.682393 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.682319    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:11:39.770224 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770173    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-certs\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770224 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-credential-socket\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770246    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-data\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istiod-ca-cert\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-envoy\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770384    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-socket\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770430    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-podinfo\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770471    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-token\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770511 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770497    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9rw6\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-kube-api-access-d9rw6\") pod \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\" (UID: \"2bca293d-bc9e-43ed-82b6-9b93b443ac38\") "
Jul 26 16:11:39.770803 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:39.770803 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770587    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:39.770803 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770691    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:39.770903 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770875    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-socket\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.770903 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770896    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-workload-certs\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.771026 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.770910    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-credential-socket\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.771275 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.771239    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:11:39.771407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.771311    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:39.772727 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.772700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:11:39.773095 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.773077    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:11:39.773549 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.773526    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:11:39.773623 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.773597    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-kube-api-access-d9rw6" (OuterVolumeSpecName: "kube-api-access-d9rw6") pod "2bca293d-bc9e-43ed-82b6-9b93b443ac38" (UID: "2bca293d-bc9e-43ed-82b6-9b93b443ac38"). InnerVolumeSpecName "kube-api-access-d9rw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:11:39.871453 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.871423    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-podinfo\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.871453 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.871450    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-token\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.871453 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.871459    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9rw6\" (UniqueName: \"kubernetes.io/projected/2bca293d-bc9e-43ed-82b6-9b93b443ac38-kube-api-access-d9rw6\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.871677 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.871470    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.871677 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.871479    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istiod-ca-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:39.871677 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:39.871486    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bca293d-bc9e-43ed-82b6-9b93b443ac38-istio-envoy\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:40.069861 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.069827    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerID="baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c" exitCode=0
Jul 26 16:11:40.070073 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.069878    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"
Jul 26 16:11:40.070073 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.069897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" event={"ID":"2bca293d-bc9e-43ed-82b6-9b93b443ac38","Type":"ContainerDied","Data":"baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c"}
Jul 26 16:11:40.070073 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.069967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts" event={"ID":"2bca293d-bc9e-43ed-82b6-9b93b443ac38","Type":"ContainerDied","Data":"d089f3c8a807871d43b03e94d2b93c941dedfff187923962e175bb79d0cfd9c2"}
Jul 26 16:11:40.070073 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.069988    2561 scope.go:117] "RemoveContainer" containerID="baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c"
Jul 26 16:11:40.079585 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.079568    2561 scope.go:117] "RemoveContainer" containerID="208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"
Jul 26 16:11:40.091886 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.091868    2561 scope.go:117] "RemoveContainer" containerID="baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c"
Jul 26 16:11:40.092164 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:11:40.092144    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c\": container with ID starting with baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c not found: ID does not exist" containerID="baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c"
Jul 26 16:11:40.092220 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.092172    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c"} err="failed to get container status \"baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c\": rpc error: code = NotFound desc = could not find container \"baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c\": container with ID starting with baa2c6bc25d93eb2b7b15edab21d3a55b55ec5be9c56ac668c28587fe12ab23c not found: ID does not exist"
Jul 26 16:11:40.092220 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.092189    2561 scope.go:117] "RemoveContainer" containerID="208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"
Jul 26 16:11:40.092417 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:11:40.092400    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc\": container with ID starting with 208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc not found: ID does not exist" containerID="208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"
Jul 26 16:11:40.092460 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.092423    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc"} err="failed to get container status \"208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc\": rpc error: code = NotFound desc = could not find container \"208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc\": container with ID starting with 208533e51c65e1a95c6fef23f14e398a70b054d80311bde10471414325ea64fc not found: ID does not exist"
Jul 26 16:11:40.095504 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.095479    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"]
Jul 26 16:11:40.098946 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:40.098913    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-51789d-openshift-default-59c579dbd-822ts"]
Jul 26 16:11:41.105207 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:41.105176    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" path="/var/lib/kubelet/pods/2bca293d-bc9e-43ed-82b6-9b93b443ac38/volumes"
Jul 26 16:11:46.415019 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.414985    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"]
Jul 26 16:11:46.415537 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.415228    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r" podUID="252b0e28-aa35-49e8-8390-5b0ec0634b91" containerName="payload-processing" containerID="cri-o://da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e" gracePeriod=30
Jul 26 16:11:46.679626 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.679553    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 16:11:46.835150 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.835109    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5p4d\" (UniqueName: \"kubernetes.io/projected/252b0e28-aa35-49e8-8390-5b0ec0634b91-kube-api-access-p5p4d\") pod \"252b0e28-aa35-49e8-8390-5b0ec0634b91\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") "
Jul 26 16:11:46.835333 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.835209    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252b0e28-aa35-49e8-8390-5b0ec0634b91-plugins-config-volume\") pod \"252b0e28-aa35-49e8-8390-5b0ec0634b91\" (UID: \"252b0e28-aa35-49e8-8390-5b0ec0634b91\") "
Jul 26 16:11:46.835650 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.835612    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252b0e28-aa35-49e8-8390-5b0ec0634b91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "252b0e28-aa35-49e8-8390-5b0ec0634b91" (UID: "252b0e28-aa35-49e8-8390-5b0ec0634b91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:11:46.837293 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.837267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252b0e28-aa35-49e8-8390-5b0ec0634b91-kube-api-access-p5p4d" (OuterVolumeSpecName: "kube-api-access-p5p4d") pod "252b0e28-aa35-49e8-8390-5b0ec0634b91" (UID: "252b0e28-aa35-49e8-8390-5b0ec0634b91"). InnerVolumeSpecName "kube-api-access-p5p4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:11:46.936297 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.936216    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/252b0e28-aa35-49e8-8390-5b0ec0634b91-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:46.936297 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:46.936245    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5p4d\" (UniqueName: \"kubernetes.io/projected/252b0e28-aa35-49e8-8390-5b0ec0634b91-kube-api-access-p5p4d\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:11:47.107993 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.107960    2561 generic.go:356] "Generic (PLEG): container finished" podID="252b0e28-aa35-49e8-8390-5b0ec0634b91" containerID="da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e" exitCode=0
Jul 26 16:11:47.108182 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.108048    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"
Jul 26 16:11:47.108182 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.108100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r" event={"ID":"252b0e28-aa35-49e8-8390-5b0ec0634b91","Type":"ContainerDied","Data":"da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e"}
Jul 26 16:11:47.108182 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.108158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r" event={"ID":"252b0e28-aa35-49e8-8390-5b0ec0634b91","Type":"ContainerDied","Data":"2408e6cc1f37e73dda4abff50354477abd9fd5903dd2f19d9b66190847829f12"}
Jul 26 16:11:47.108344 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.108185    2561 scope.go:117] "RemoveContainer" containerID="da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e"
Jul 26 16:11:47.120974 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.120956    2561 scope.go:117] "RemoveContainer" containerID="da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e"
Jul 26 16:11:47.121264 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:11:47.121241    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e\": container with ID starting with da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e not found: ID does not exist" containerID="da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e"
Jul 26 16:11:47.121342 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.121277    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e"} err="failed to get container status \"da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e\": rpc error: code = NotFound desc = could not find container \"da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e\": container with ID starting with da665399007e6f609909268390a97fe1d8c16b6dd99f5cbe0921bbf15c4e5b6e not found: ID does not exist"
Jul 26 16:11:47.130617 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.130588    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"]
Jul 26 16:11:47.138179 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:47.138153    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-d81393-66f8dc8798-tct6r"]
Jul 26 16:11:49.104567 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:49.104536    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252b0e28-aa35-49e8-8390-5b0ec0634b91" path="/var/lib/kubelet/pods/252b0e28-aa35-49e8-8390-5b0ec0634b91/volumes"
Jul 26 16:11:57.085575 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085538    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"]
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085887    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67120c25-906e-47b4-bf39-a9a0d0fd0471" containerName="revoke-keys"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085898    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67120c25-906e-47b4-bf39-a9a0d0fd0471" containerName="revoke-keys"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085911    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252b0e28-aa35-49e8-8390-5b0ec0634b91" containerName="payload-processing"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085917    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="252b0e28-aa35-49e8-8390-5b0ec0634b91" containerName="payload-processing"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085939    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085945    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085952    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085957    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085966    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085970    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085985    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy"
Jul 26 16:11:57.085996 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.085990    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy"
Jul 26 16:11:57.086366 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.086045    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy"
Jul 26 16:11:57.086366 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.086051    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c59536a-929f-4768-95c8-f776792fd364" containerName="istio-proxy"
Jul 26 16:11:57.086366 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.086059    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="252b0e28-aa35-49e8-8390-5b0ec0634b91" containerName="payload-processing"
Jul 26 16:11:57.086366 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.086067    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy"
Jul 26 16:11:57.086366 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.086072    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bca293d-bc9e-43ed-82b6-9b93b443ac38" containerName="istio-proxy"
Jul 26 16:11:57.086366 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.086079    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="67120c25-906e-47b4-bf39-a9a0d0fd0471" containerName="revoke-keys"
Jul 26 16:11:57.089173 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.089153    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:11:57.091711 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.091678    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxrsw\""
Jul 26 16:11:57.091835 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.091717    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:11:57.095475 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.095448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"]
Jul 26 16:11:57.124298 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.124262    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59014720-0b40-4395-a0df-b870a17d6771-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6\" (UID: \"59014720-0b40-4395-a0df-b870a17d6771\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:11:57.225102 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.225062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59014720-0b40-4395-a0df-b870a17d6771-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6\" (UID: \"59014720-0b40-4395-a0df-b870a17d6771\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:11:57.225899 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.225873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59014720-0b40-4395-a0df-b870a17d6771-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6\" (UID: \"59014720-0b40-4395-a0df-b870a17d6771\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:11:57.401753 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.401673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:11:57.538076 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:57.538047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"]
Jul 26 16:11:57.539720 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:11:57.539691    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59014720_0b40_4395_a0df_b870a17d6771.slice/crio-56c8691d9cbf02658cec2c1f851168441d31c8052d041add8e3d5d259cbeab50 WatchSource:0}: Error finding container 56c8691d9cbf02658cec2c1f851168441d31c8052d041add8e3d5d259cbeab50: Status 404 returned error can't find the container with id 56c8691d9cbf02658cec2c1f851168441d31c8052d041add8e3d5d259cbeab50
Jul 26 16:11:58.166969 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:58.166909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6" event={"ID":"59014720-0b40-4395-a0df-b870a17d6771","Type":"ContainerStarted","Data":"2af81d13f9fb1025c295fb32c3e04005871d818b4d5e7af7b712854bc845b953"}
Jul 26 16:11:58.167336 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:58.166987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6" event={"ID":"59014720-0b40-4395-a0df-b870a17d6771","Type":"ContainerStarted","Data":"56c8691d9cbf02658cec2c1f851168441d31c8052d041add8e3d5d259cbeab50"}
Jul 26 16:11:58.183161 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:58.183102    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6" podStartSLOduration=1.183085811 podStartE2EDuration="1.183085811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:11:58.18167721 +0000 UTC m=+3227.543177013" watchObservedRunningTime="2026-07-26 16:11:58.183085811 +0000 UTC m=+3227.544585679"
Jul 26 16:11:59.173103 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:59.173068    2561 generic.go:356] "Generic (PLEG): container finished" podID="59014720-0b40-4395-a0df-b870a17d6771" containerID="2af81d13f9fb1025c295fb32c3e04005871d818b4d5e7af7b712854bc845b953" exitCode=0
Jul 26 16:11:59.173496 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:11:59.173149    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6" event={"ID":"59014720-0b40-4395-a0df-b870a17d6771","Type":"ContainerDied","Data":"2af81d13f9fb1025c295fb32c3e04005871d818b4d5e7af7b712854bc845b953"}
Jul 26 16:12:00.306473 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:00.306447    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:12:00.348973 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:00.348940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59014720-0b40-4395-a0df-b870a17d6771-maas-api-service-ca\") pod \"59014720-0b40-4395-a0df-b870a17d6771\" (UID: \"59014720-0b40-4395-a0df-b870a17d6771\") "
Jul 26 16:12:00.349355 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:00.349328    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59014720-0b40-4395-a0df-b870a17d6771-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59014720-0b40-4395-a0df-b870a17d6771" (UID: "59014720-0b40-4395-a0df-b870a17d6771"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:12:00.449528 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:00.449440    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59014720-0b40-4395-a0df-b870a17d6771-maas-api-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:12:01.185002 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:01.184965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6" event={"ID":"59014720-0b40-4395-a0df-b870a17d6771","Type":"ContainerDied","Data":"56c8691d9cbf02658cec2c1f851168441d31c8052d041add8e3d5d259cbeab50"}
Jul 26 16:12:01.185160 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:01.185046    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56c8691d9cbf02658cec2c1f851168441d31c8052d041add8e3d5d259cbeab50"
Jul 26 16:12:01.185160 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:01.184978    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"
Jul 26 16:12:07.363021 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.362792    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"]
Jul 26 16:12:07.363771 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.363741    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" podUID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" containerName="payload-pre-processing" containerID="cri-o://fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15" gracePeriod=30
Jul 26 16:12:07.510538 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.510488    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" podUID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.61:9004: connect: connection refused"
Jul 26 16:12:07.629626 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.629594    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 16:12:07.712944 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.712907    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxq42\" (UniqueName: \"kubernetes.io/projected/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-kube-api-access-gxq42\") pod \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") "
Jul 26 16:12:07.713149 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.712984    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-plugins-config-volume\") pod \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\" (UID: \"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f\") "
Jul 26 16:12:07.713347 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.713317    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" (UID: "d1a0d8f4-325a-4d8b-aa50-683ee1c7896f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:12:07.715238 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.715214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-kube-api-access-gxq42" (OuterVolumeSpecName: "kube-api-access-gxq42") pod "d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" (UID: "d1a0d8f4-325a-4d8b-aa50-683ee1c7896f"). InnerVolumeSpecName "kube-api-access-gxq42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:12:07.813630 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.813590    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxq42\" (UniqueName: \"kubernetes.io/projected/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-kube-api-access-gxq42\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:12:07.813630 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:07.813623    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f-plugins-config-volume\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\""
Jul 26 16:12:08.223247 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.223213    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" containerID="fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15" exitCode=0
Jul 26 16:12:08.223423 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.223253    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"
Jul 26 16:12:08.223423 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.223290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" event={"ID":"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f","Type":"ContainerDied","Data":"fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15"}
Jul 26 16:12:08.223423 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.223342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn" event={"ID":"d1a0d8f4-325a-4d8b-aa50-683ee1c7896f","Type":"ContainerDied","Data":"6135c08bedf96b6ab36e9dc1637e57835855dc59128fdabdd34db3edc72626a4"}
Jul 26 16:12:08.223423 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.223365    2561 scope.go:117] "RemoveContainer" containerID="fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15"
Jul 26 16:12:08.232723 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.232701    2561 scope.go:117] "RemoveContainer" containerID="fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15"
Jul 26 16:12:08.233006 ip-10-0-137-96 kubenswrapper[2561]: E0726 16:12:08.232988    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15\": container with ID starting with fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15 not found: ID does not exist" containerID="fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15"
Jul 26 16:12:08.233069 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.233018    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15"} err="failed to get container status \"fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15\": rpc error: code = NotFound desc = could not find container \"fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15\": container with ID starting with fea949c115c173d54b83f48748de829c92142b12dac84a8ec549489d2af11e15 not found: ID does not exist"
Jul 26 16:12:08.244889 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.244859    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"]
Jul 26 16:12:08.249863 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:08.249834    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-976e7c-7446fc99f6-cl2pn"]
Jul 26 16:12:09.105760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:09.105728    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" path="/var/lib/kubelet/pods/d1a0d8f4-325a-4d8b-aa50-683ee1c7896f/volumes"
Jul 26 16:12:12.157503 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:12.157423    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"]
Jul 26 16:12:12.159552 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:12.159528    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-976e7c-f58j6"]
Jul 26 16:12:13.104216 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:13.104179    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59014720-0b40-4395-a0df-b870a17d6771" path="/var/lib/kubelet/pods/59014720-0b40-4395-a0df-b870a17d6771/volumes"
Jul 26 16:12:19.235066 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:19.235031    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84d488899c-vx67n_dce27635-01c3-4947-aafb-ef630a68538f/authorino/0.log"
Jul 26 16:12:24.638341 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:24.638307    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qb5kh_05fe37b2-5c3c-414b-9d73-ddee8a68ee28/manager/0.log"
Jul 26 16:12:24.761102 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:24.761069    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cm45j_0d53616a-41be-49cf-9663-e5a4f0eca739/manager/0.log"
Jul 26 16:12:24.988734 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:24.988650    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vkzmx_383812c7-37de-4736-8798-6bada7a044aa/server/0.log"
Jul 26 16:12:25.113066 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:25.113028    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wrhz6_789931d7-a736-4c27-af1b-efb84411eb5e/manager/0.log"
Jul 26 16:12:25.493265 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:25.493227    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d786d858-qd2fl_cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd/copy-manifests/0.log"
Jul 26 16:12:25.500060 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:25.500013    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d786d858-qd2fl_cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd/manager/0.log"
Jul 26 16:12:27.079461 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.079426    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58_5c8b9ca6-5a35-407e-afc5-3346fafe9495/pull/0.log"
Jul 26 16:12:27.085489 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.085458    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58_5c8b9ca6-5a35-407e-afc5-3346fafe9495/extract/0.log"
Jul 26 16:12:27.091143 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.091122    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58_5c8b9ca6-5a35-407e-afc5-3346fafe9495/util/0.log"
Jul 26 16:12:27.206053 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.206020    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c_61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf/extract/0.log"
Jul 26 16:12:27.212264 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.212243    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c_61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf/util/0.log"
Jul 26 16:12:27.218821 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.218795    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c_61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf/pull/0.log"
Jul 26 16:12:27.329407 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.329377    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv_590a23f7-6fac-4b89-a6b7-3ff87ee98e84/util/0.log"
Jul 26 16:12:27.335862 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.335792    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv_590a23f7-6fac-4b89-a6b7-3ff87ee98e84/pull/0.log"
Jul 26 16:12:27.341799 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.341781    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv_590a23f7-6fac-4b89-a6b7-3ff87ee98e84/extract/0.log"
Jul 26 16:12:27.451464 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.451430    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v_d33db239-2d88-4203-90bc-bf347e3a7286/util/0.log"
Jul 26 16:12:27.457634 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.457600    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v_d33db239-2d88-4203-90bc-bf347e3a7286/pull/0.log"
Jul 26 16:12:27.463601 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.463579    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v_d33db239-2d88-4203-90bc-bf347e3a7286/extract/0.log"
Jul 26 16:12:27.580899 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.580872    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84d488899c-vx67n_dce27635-01c3-4947-aafb-ef630a68538f/authorino/0.log"
Jul 26 16:12:27.701501 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.701411    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jzc74_a0d630dc-04b6-4f15-bfa8-f4ebbed14cce/manager/0.log"
Jul 26 16:12:27.808203 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:27.808177    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kslmm_758bf8aa-0132-4934-8939-c5c04d6d811e/manager/0.log"
Jul 26 16:12:28.045574 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:28.045537    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kjdz5_c0b898cb-99ff-41d8-968e-b44e81b0aad1/registry-server/0.log"
Jul 26 16:12:28.170220 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:28.170190    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lhrrc_a7cec265-5555-4a41-84a5-281bf5c49c1d/manager/0.log"
Jul 26 16:12:28.400392 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:28.400310    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d2l65_cb1c08c0-126e-463b-a6f5-4915c078577d/manager/0.log"
Jul 26 16:12:28.759821 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:28.759793    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b_defc65fa-1763-4d63-9e3c-9fdd44fa7bc3/istio-proxy/0.log"
Jul 26 16:12:29.116115 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:29.116028    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dc54b99bb-mgnn5_106ad561-9ff6-4cb6-90e0-efe29e446a38/kube-auth-proxy/0.log"
Jul 26 16:12:29.245175 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:29.245145    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/1.log"
Jul 26 16:12:30.076731 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:30.076705    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bjwwj_da419925-c238-47af-b720-3f8ecff1a95a/main/0.log"
Jul 26 16:12:30.192812 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:30.192783    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5nzqr_fc8ee1fd-c70a-4117-8213-14acc6ef9753/main/0.log"
Jul 26 16:12:30.568886 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:30.568857    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-p2c6d_a4902df7-5d80-48dd-a715-8051b507f6f1/main/0.log"
Jul 26 16:12:38.686254 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:38.686226    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hg694_1fd9c967-865a-487c-bacd-26c2ce1c9052/global-pull-secret-syncer/0.log"
Jul 26 16:12:38.783225 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:38.783197    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q54g6_10df3e54-9a17-4a24-a7a8-33ccda9aa4b0/konnectivity-agent/0.log"
Jul 26 16:12:38.837509 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:38.837482    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-96.ec2.internal_5ead0cc72982e9e04768074e71044edc/haproxy/0.log"
Jul 26 16:12:43.484224 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.484190    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58_5c8b9ca6-5a35-407e-afc5-3346fafe9495/extract/0.log"
Jul 26 16:12:43.505147 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.505115    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58_5c8b9ca6-5a35-407e-afc5-3346fafe9495/util/0.log"
Jul 26 16:12:43.528998 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.528967    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nnr58_5c8b9ca6-5a35-407e-afc5-3346fafe9495/pull/0.log"
Jul 26 16:12:43.552582 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.552554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c_61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf/extract/0.log"
Jul 26 16:12:43.573200 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.573174    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c_61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf/util/0.log"
Jul 26 16:12:43.595076 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.595047    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mgg8c_61ea645c-3d3a-4676-b2bf-fb0b1ba82dbf/pull/0.log"
Jul 26 16:12:43.617882 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.617860    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv_590a23f7-6fac-4b89-a6b7-3ff87ee98e84/extract/0.log"
Jul 26 16:12:43.636757 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.636734    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv_590a23f7-6fac-4b89-a6b7-3ff87ee98e84/util/0.log"
Jul 26 16:12:43.655454 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.655427    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mwjbv_590a23f7-6fac-4b89-a6b7-3ff87ee98e84/pull/0.log"
Jul 26 16:12:43.680488 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.680458    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v_d33db239-2d88-4203-90bc-bf347e3a7286/extract/0.log"
Jul 26 16:12:43.699204 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.699179    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v_d33db239-2d88-4203-90bc-bf347e3a7286/util/0.log"
Jul 26 16:12:43.717866 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:43.717840    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ht89v_d33db239-2d88-4203-90bc-bf347e3a7286/pull/0.log"
Jul 26 16:12:44.370799 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:44.370763    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84d488899c-vx67n_dce27635-01c3-4947-aafb-ef630a68538f/authorino/0.log"
Jul 26 16:12:44.397818 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:44.397789    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jzc74_a0d630dc-04b6-4f15-bfa8-f4ebbed14cce/manager/0.log"
Jul 26 16:12:44.432287 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:44.432257    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kslmm_758bf8aa-0132-4934-8939-c5c04d6d811e/manager/0.log"
Jul 26 16:12:44.511199 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:44.511170    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kjdz5_c0b898cb-99ff-41d8-968e-b44e81b0aad1/registry-server/0.log"
Jul 26 16:12:44.778763 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:44.778722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lhrrc_a7cec265-5555-4a41-84a5-281bf5c49c1d/manager/0.log"
Jul 26 16:12:44.921495 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:44.921460    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d2l65_cb1c08c0-126e-463b-a6f5-4915c078577d/manager/0.log"
Jul 26 16:12:46.879107 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:46.879060    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58l9l_b3f01a00-2040-45e7-a3df-f7e665fcfbb2/node-exporter/0.log"
Jul 26 16:12:46.897153 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:46.897124    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58l9l_b3f01a00-2040-45e7-a3df-f7e665fcfbb2/kube-rbac-proxy/0.log"
Jul 26 16:12:46.915866 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:46.915809    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58l9l_b3f01a00-2040-45e7-a3df-f7e665fcfbb2/init-textfile/0.log"
Jul 26 16:12:48.693339 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693300    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"]
Jul 26 16:12:48.693760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693654    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59014720-0b40-4395-a0df-b870a17d6771" containerName="revoke-keys"
Jul 26 16:12:48.693760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693665    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="59014720-0b40-4395-a0df-b870a17d6771" containerName="revoke-keys"
Jul 26 16:12:48.693760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693690    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" containerName="payload-pre-processing"
Jul 26 16:12:48.693760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693695    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" containerName="payload-pre-processing"
Jul 26 16:12:48.693760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693754    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="59014720-0b40-4395-a0df-b870a17d6771" containerName="revoke-keys"
Jul 26 16:12:48.693760 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.693763    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1a0d8f4-325a-4d8b-aa50-683ee1c7896f" containerName="payload-pre-processing"
Jul 26 16:12:48.697215 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.697197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.700029 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.700011    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jncg9\"/\"openshift-service-ca.crt\""
Jul 26 16:12:48.700029 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.700019    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jncg9\"/\"kube-root-ca.crt\""
Jul 26 16:12:48.700200 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.700021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jncg9\"/\"default-dockercfg-km9tz\""
Jul 26 16:12:48.706903 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.706878    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"]
Jul 26 16:12:48.771289 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.771252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rnpg\" (UniqueName: \"kubernetes.io/projected/c4af6883-0e31-4841-88a0-7e45fb52596c-kube-api-access-6rnpg\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.771289 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.771292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-sys\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.771515 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.771315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-lib-modules\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.771515 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.771380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-podres\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.771515 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.771431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-proc\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.871973 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.871914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rnpg\" (UniqueName: \"kubernetes.io/projected/c4af6883-0e31-4841-88a0-7e45fb52596c-kube-api-access-6rnpg\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.871973 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.871977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-sys\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.871998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-lib-modules\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.872024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-podres\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.872129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-sys\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.872143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-podres\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872185 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.872153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-proc\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872361 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.872195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-proc\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.872361 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.872196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4af6883-0e31-4841-88a0-7e45fb52596c-lib-modules\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:48.880305 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:48.880277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rnpg\" (UniqueName: \"kubernetes.io/projected/c4af6883-0e31-4841-88a0-7e45fb52596c-kube-api-access-6rnpg\") pod \"perf-node-gather-daemonset-r2q7d\" (UID: \"c4af6883-0e31-4841-88a0-7e45fb52596c\") " pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:49.007229 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:49.007196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:49.148022 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:49.147989    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"]
Jul 26 16:12:49.149869 ip-10-0-137-96 kubenswrapper[2561]: W0726 16:12:49.149840    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc4af6883_0e31_4841_88a0_7e45fb52596c.slice/crio-75b8015cd1dcb0e7db39702c87167152fac6e621f7c20c9105a822f548c883b2 WatchSource:0}: Error finding container 75b8015cd1dcb0e7db39702c87167152fac6e621f7c20c9105a822f548c883b2: Status 404 returned error can't find the container with id 75b8015cd1dcb0e7db39702c87167152fac6e621f7c20c9105a822f548c883b2
Jul 26 16:12:49.452795 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:49.452698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d" event={"ID":"c4af6883-0e31-4841-88a0-7e45fb52596c","Type":"ContainerStarted","Data":"200ffbb44318a582129df5f2d12c389c87a24d3b28737d54441cb88a68afa5c2"}
Jul 26 16:12:49.452795 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:49.452759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d" event={"ID":"c4af6883-0e31-4841-88a0-7e45fb52596c","Type":"ContainerStarted","Data":"75b8015cd1dcb0e7db39702c87167152fac6e621f7c20c9105a822f548c883b2"}
Jul 26 16:12:49.452795 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:49.452788    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:49.471864 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:49.471810    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d" podStartSLOduration=1.471792666 podStartE2EDuration="1.471792666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:12:49.469035674 +0000 UTC m=+3278.830535478" watchObservedRunningTime="2026-07-26 16:12:49.471792666 +0000 UTC m=+3278.833292468"
Jul 26 16:12:51.619337 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:51.619304    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pjm8_b42dc95f-9578-4d2f-a323-978105b51494/dns/0.log"
Jul 26 16:12:51.639792 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:51.639753    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pjm8_b42dc95f-9578-4d2f-a323-978105b51494/kube-rbac-proxy/0.log"
Jul 26 16:12:51.727607 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:51.727573    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzqx7_3161f551-cb17-41b1-af1d-6a103b2f303d/dns-node-resolver/0.log"
Jul 26 16:12:52.293657 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:52.293623    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-db455859b-f57xh_3c87c346-f88a-4e60-a787-7bb46d0a6679/registry/0.log"
Jul 26 16:12:52.360166 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:52.360132    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgw6g_eb958b2d-6ce7-4d68-9fc4-c02f2dce305c/node-ca/0.log"
Jul 26 16:12:53.249587 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:53.249560    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b_defc65fa-1763-4d63-9e3c-9fdd44fa7bc3/istio-proxy/0.log"
Jul 26 16:12:53.439765 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:53.439737    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dc54b99bb-mgnn5_106ad561-9ff6-4cb6-90e0-efe29e446a38/kube-auth-proxy/0.log"
Jul 26 16:12:53.467814 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:53.467789    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/0.log"
Jul 26 16:12:53.523623 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:53.523515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/1.log"
Jul 26 16:12:54.415794 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:54.415759    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kg2g6_40df5a6f-5aa3-415a-84d1-4a06df657748/serve-healthcheck-canary/0.log"
Jul 26 16:12:54.975892 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:54.975858    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkm75_545cbb6e-eb78-4fce-9532-9a6c2be953b0/kube-rbac-proxy/0.log"
Jul 26 16:12:54.995187 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:54.995138    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkm75_545cbb6e-eb78-4fce-9532-9a6c2be953b0/exporter/0.log"
Jul 26 16:12:55.038811 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:55.038773    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkm75_545cbb6e-eb78-4fce-9532-9a6c2be953b0/extractor/0.log"
Jul 26 16:12:55.468077 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:55.468052    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jncg9/perf-node-gather-daemonset-r2q7d"
Jul 26 16:12:57.231261 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:57.231235    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qb5kh_05fe37b2-5c3c-414b-9d73-ddee8a68ee28/manager/0.log"
Jul 26 16:12:57.628294 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:57.628258    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cm45j_0d53616a-41be-49cf-9663-e5a4f0eca739/manager/0.log"
Jul 26 16:12:58.001054 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:58.001028    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vkzmx_383812c7-37de-4736-8798-6bada7a044aa/server/0.log"
Jul 26 16:12:58.145512 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:58.145482    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wrhz6_789931d7-a736-4c27-af1b-efb84411eb5e/manager/0.log"
Jul 26 16:12:58.376285 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:58.376247    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d786d858-qd2fl_cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd/manager/0.log"
Jul 26 16:12:58.396705 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:58.396677    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d786d858-qd2fl_cfe07d6c-5fb0-4258-a8fe-4eda8ab4c5bd/copy-manifests/0.log"
Jul 26 16:12:59.168261 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:59.168225    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b_defc65fa-1763-4d63-9e3c-9fdd44fa7bc3/istio-proxy/0.log"
Jul 26 16:12:59.349549 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:59.349521    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dc54b99bb-mgnn5_106ad561-9ff6-4cb6-90e0-efe29e446a38/kube-auth-proxy/0.log"
Jul 26 16:12:59.367781 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:59.367755    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/0.log"
Jul 26 16:12:59.419377 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:12:59.419291    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/1.log"
Jul 26 16:13:00.843656 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:00.843616    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s7n8b_defc65fa-1763-4d63-9e3c-9fdd44fa7bc3/istio-proxy/0.log"
Jul 26 16:13:01.022856 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:01.022831    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dc54b99bb-mgnn5_106ad561-9ff6-4cb6-90e0-efe29e446a38/kube-auth-proxy/0.log"
Jul 26 16:13:01.042589 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:01.042556    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/0.log"
Jul 26 16:13:01.095192 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:01.095097    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-744qj_92fce319-9687-490e-af0f-816c9045893d/istio-proxy/1.log"
Jul 26 16:13:04.446575 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:04.446538    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-phqcp_db22fd46-0a4a-4f62-aedb-add75aa332c7/migrator/0.log"
Jul 26 16:13:04.465411 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:04.465381    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-phqcp_db22fd46-0a4a-4f62-aedb-add75aa332c7/graceful-termination/0.log"
Jul 26 16:13:05.840124 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:05.840087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-57m67_2097d08e-f05c-4fd4-84d9-548d6ade8195/kube-multus/0.log"
Jul 26 16:13:06.036814 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.036787    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/kube-multus-additional-cni-plugins/0.log"
Jul 26 16:13:06.057241 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.057213    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/egress-router-binary-copy/0.log"
Jul 26 16:13:06.076631 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.076609    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/cni-plugins/0.log"
Jul 26 16:13:06.095135 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.095058    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/bond-cni-plugin/0.log"
Jul 26 16:13:06.113654 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.113622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/routeoverride-cni/0.log"
Jul 26 16:13:06.132469 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.132445    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/whereabouts-cni-bincopy/0.log"
Jul 26 16:13:06.151166 ip-10-0-137-96 kubenswrapper[2561]: I0726 16:13:06.151143    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gkk2x_d97b3f07-324b-4e65-b119-43905a95b3a9/whereabouts-cni/0.log"