Jul 24 17:03:17.165083 ip-10-0-139-244 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:03:17.588066 ip-10-0-139-244 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:17.588066 ip-10-0-139-244 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:03:17.588066 ip-10-0-139-244 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:17.588066 ip-10-0-139-244 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:03:17.588066 ip-10-0-139-244 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:03:17.588778 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.588124    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:03:17.593808 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593789    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:17.593808 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593807    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593812    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593816    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593819    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593822    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593825    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593830    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593833    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593836    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593839    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593842    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593853    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593856    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593859    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593861    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593864    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593867    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593871    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593876    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593879    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:17.593877 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593882    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593885    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593889    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593892    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593894    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593898    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593900    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593903    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593906    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593908    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593913    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593917    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593920    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593923    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593926    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593929    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593932    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593935    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593938    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593941    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:17.594371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593944    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593946    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593949    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593952    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593954    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593957    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593960    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593963    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593966    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593968    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593971    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593974    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593977    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593980    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593983    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593985    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593988    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593991    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593994    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593997    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:17.594905 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.593999    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594002    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594005    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594008    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594011    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594013    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594017    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594019    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594022    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594025    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594028    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594031    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594033    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594036    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594039    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594041    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594044    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594048    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594051    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594054    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:17.595416 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594058    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594060    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594063    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594066    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594069    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594073    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594077    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594079    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594082    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594085    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594088    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594091    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594093    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594097    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594100    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594102    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594105    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594108    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594864    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:17.595924 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594871    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594875    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594878    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594880    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594884    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594886    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594890    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594893    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594896    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594898    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594902    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594905    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594908    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594910    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594914    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594917    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594922    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594925    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594929    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:17.596453 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594932    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594936    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594938    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594941    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594944    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594947    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594949    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594952    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594957    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594961    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594965    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594967    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594970    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594973    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594976    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594979    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594981    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594984    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594988    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594991    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:17.596972 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594994    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594996    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.594999    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595003    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595006    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595008    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595012    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595016    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595019    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595022    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595025    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595028    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595030    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595033    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595036    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595038    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595041    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595044    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595047    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:17.597500 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595050    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595052    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595055    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595058    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595061    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595064    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595066    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595069    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595071    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595075    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595078    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595081    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595085    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595087    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595090    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595093    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595096    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595098    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595101    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595104    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:17.598068 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595107    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595109    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595112    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595115    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595117    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595120    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595122    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595125    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595128    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595130    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595133    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595136    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595139    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595141    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595144    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595146    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595149    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595152    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595155    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.595157    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:17.598585 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597224    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597231    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597235    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597238    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597242    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597245    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597247    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597250    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597253    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597256    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597259    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597263    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597267    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597278    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597281    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597284    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597287    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597290    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597293    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:17.599113 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597296    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597299    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597302    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597306    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597309    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597312    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597315    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597319    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597324    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597328    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597331    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597334    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597337    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597340    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597343    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597346    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597349    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597351    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597355    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:17.599606 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597357    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597360    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597363    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597366    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597369    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597372    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597374    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597378    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597381    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597384    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597386    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597389    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597392    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597394    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597397    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597400    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597402    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597405    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597408    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597410    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:17.600101 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597413    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597415    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597418    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597420    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597423    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597426    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597428    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597431    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597433    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597436    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597438    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597441    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597444    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597447    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597451    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597453    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597456    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597459    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597462    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597466    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:17.600613 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597468    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597471    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597473    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597476    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597479    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597481    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597484    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597486    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597489    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597492    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597494    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597497    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597499    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597502    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597505    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597508    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597510    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597513    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597516    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597519    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:17.601142 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.597522    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597592    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597599    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597606    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597611    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597616    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597620    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597625    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597629    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597633    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597637    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597642    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597648    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597651    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597656    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597659    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597664    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597668    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597671    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597675    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597678    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597681    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597685    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597688    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:03:17.601735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597692    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597695    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597699    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597702    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597705    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597708    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597711    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597715    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597718    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597723    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597726    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597729    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597732    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597735    2568 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597739    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597744    2568 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597748    2568 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597751    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597755    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597758    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597762    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597765    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597783    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597788    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597793    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:03:17.602376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597798    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597801    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597804    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597807    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597810    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597813    2568 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597817    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597821    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597824    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597827    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597830    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597833    2568 flags.go:64] FLAG: --help="false"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597836    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-139-244.ec2.internal"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597839    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597843    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597846    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597849    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597853    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597856    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597859    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597862    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597865    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597868    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597872    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:03:17.603048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597875    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597878    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597881    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597884    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597887    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597890    2568 flags.go:64] FLAG: --lock-file=""
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597893    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597896    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597899    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597905    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597907    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597910    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597913    2568 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597916    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597920    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597923    2568 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597926    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597931    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597934    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597938    2568 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597942    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597945    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597948    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597951    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597954    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:03:17.603667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597960    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597963    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597970    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597973    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597977    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597980    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597984    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597990    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597993    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.597997    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598000    2568 flags.go:64] FLAG: --port="10250"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598003    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598006    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d9207e2b0a0886b9"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598010    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598013    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598016    2568 flags.go:64] FLAG: --register-node="true"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598019    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598026    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598029    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598032    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598035    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598038    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598042    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598045    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598048    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:03:17.604352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598051    2568 flags.go:64] FLAG: --runonce="false"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598054    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598058    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598061    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598064    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598067    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598070    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598074    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598080    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598084    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598087    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598090    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598093    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598096    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598100    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598103    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598109    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598112    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598116    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598120    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598123    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598126    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598129    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598132    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598135    2568 flags.go:64] FLAG: --v="2"
Jul 24 17:03:17.605152 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598139    2568 flags.go:64] FLAG: --version="false"
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598143    2568 flags.go:64] FLAG: --vmodule=""
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598147    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598150    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598276    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598281    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598284    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598288    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598291    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598295    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598297    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598301    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598304    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598307    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598310    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598315    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598318    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598321    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598323    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598326    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:17.605809 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598329    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598332    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598335    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598338    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598341    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598343    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598346    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598349    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598351    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598354    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598357    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598359    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598362    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598365    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598367    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598370    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598374    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598376    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598379    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598382    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:17.606342 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598385    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598387    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598390    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598393    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598395    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598400    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598403    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598407    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598410    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598414    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598417    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598419    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598422    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598426    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598428    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598432    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598434    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598437    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598440    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:17.606902 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598444    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598448    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598451    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598453    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598456    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598459    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598461    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598464    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598467    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598471    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598474    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598476    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598479    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598482    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598486    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598489    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598492    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598495    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598497    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:17.607401 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598500    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598504    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598507    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598510    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598512    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598515    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598518    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598521    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598523    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598526    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598529    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598532    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598535    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598537    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598540    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598542    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598545    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598548    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598550    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598553    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:17.607900 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598556    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598558    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598566    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598569    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.598571    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.598580    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.605323    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.605339    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.605359    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.605365    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605424    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605429    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605434    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605438    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:17.608410 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605441    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605444    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605446    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605449    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605453    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605456    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605458    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605462    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605467    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605471    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605474    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605476    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605480    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605483    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605486    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605489    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605491    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605494    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605498    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605500    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:17.608794 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605503    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605506    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605509    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605511    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605515    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605518    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605521    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605524    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605527    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605529    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605533    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605535    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605538    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605541    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605543    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605546    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605549    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605551    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605554    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605557    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:17.609316 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605560    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605563    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605566    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605570    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605574    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605577    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605580    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605583    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605585    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605588    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605591    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605593    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605596    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605599    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605602    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605604    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605608    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605611    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605614    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605617    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:17.609849 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605619    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605622    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605624    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605627    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605630    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605632    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605635    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605637    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605640    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605643    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605645    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605648    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605651    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605653    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605657    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605659    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605662    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605665    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605667    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605670    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:17.610371 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605672    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605675    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605678    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605680    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605683    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605686    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605689    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605691    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605695    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605698    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605700    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605703    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605706    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605710    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:17.611052 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605713    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.605718    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605866    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605872    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605875    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605878    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605881    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605884    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605888    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605891    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605893    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605896    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605898    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605902    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605905    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:03:17.611424 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605907    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605910    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605912    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605915    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605918    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605922    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605925    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605928    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605932    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605935    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605938    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605942    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605945    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605948    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605951    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605954    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605957    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605960    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605963    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:03:17.611825 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605966    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605969    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605972    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605974    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605977    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605980    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605982    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605985    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605988    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605990    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605993    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605996    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.605999    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606002    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606005    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606007    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606010    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606013    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606015    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606018    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:03:17.612321 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606021    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606023    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606026    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606029    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606032    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606034    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606037    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606040    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606042    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606045    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606048    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606051    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606053    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606056    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606058    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606061    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606063    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606066    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606069    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606071    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:03:17.612847 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606074    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606076    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606079    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606082    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606084    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606087    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606090    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606092    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606095    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606098    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606101    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606104    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606107    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606110    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606113    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606116    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606119    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606121    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606124    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:03:17.613348 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606126    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606130    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606132    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606135    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606138    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606140    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606143    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:17.606145    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.606150    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.606260    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.608336    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.609586    2568 server.go:1019] "Starting client certificate rotation"
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.609689    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:17.613856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.609736    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:03:17.614327 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.612893    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:17.614417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.614396    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:03:17.624824 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.624801    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:03:17.626970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.626950    2568 log.go:25] "Validated CRI v1 image API"
Jul 24 17:03:17.629376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.629361    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:03:17.631809 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.631765    2568 fs.go:135] Filesystem UUIDs: map[4255941c-2750-4662-9956-39b0dcdd6950:/dev/nvme0n1p3 75b5604a-c5f9-4804-8bc8-e1b4570af0aa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 24 17:03:17.631877 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.631809    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:03:17.637599 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.637569    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:17.637835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.637692    2568 manager.go:216] Machine: {Timestamp:2026-07-24 17:03:17.636182355 +0000 UTC m=+0.351336134 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099699 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27dac4073187ff6e5c2d3206a38de3 SystemUUID:ec27dac4-0731-87ff-6e5c-2d3206a38de3 BootID:1992abc6-1f05-41ff-8118-60601cf5a1bb Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:8e:64:13:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:8e:64:13:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:73:95:f3:24:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:03:17.637835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.637831    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:03:17.637980 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.637965    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:03:17.639700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.639668    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:03:17.639908 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.639703    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:03:17.640510 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.640496    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:03:17.640572 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.640518    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:03:17.640572 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.640530    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:17.641360 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.641348    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:03:17.642198 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.642186    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:03:17.644052 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644037    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:17.644380 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644367    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:03:17.644446 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644418    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:03:17.644446 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644440    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:03:17.644545 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644462    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:03:17.644545 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644478    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:03:17.644545 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644494    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:03:17.644922 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644907    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:17.644987 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.644932    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:03:17.647259 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.647238    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:03:17.649007 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.648993    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:03:17.649050 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.649026    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:03:17.650554 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650539    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650557    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650564    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650570    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650579    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650586    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650594    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650600    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650607    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:03:17.650615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650613    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:03:17.650879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650623    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:03:17.650879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.650629    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:03:17.651439 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.651430    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:03:17.651439 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.651439    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:03:17.654930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.654915    2568 server.go:1268] "Started kubelet"
Jul 24 17:03:17.655024 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.654989    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:03:17.655833 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.655742    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:03:17.655915 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.655865    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:03:17.656005 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.655816    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:03:17.656123 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.656022    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:03:17.656123 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.655870    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:03:17.656177 ip-10-0-139-244 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:03:17.660904 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.660863    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:03:17.661692 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.661620    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2pjjl"
Jul 24 17:03:17.662546 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.662522    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:03:17.663537 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.663523    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:03:17.666239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.666220    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2pjjl"
Jul 24 17:03:17.668897 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.667900    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-244.ec2.internal.18c5488cfa56d0cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-244.ec2.internal,UID:ip-10-0-139-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-244.ec2.internal,},FirstTimestamp:2026-07-24 17:03:17.654884557 +0000 UTC m=+0.370038336,LastTimestamp:2026-07-24 17:03:17.654884557 +0000 UTC m=+0.370038336,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-244.ec2.internal,}"
Jul 24 17:03:17.677018 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.677003    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:03:17.677115 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.677023    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:17.677115 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.677094    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:17.677597 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.677579    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:03:17.677689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.677639    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:03:17.677689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.677662    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:03:17.678134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.678115    2568 factory.go:55] Registering systemd factory
Jul 24 17:03:17.678207 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.678137    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:03:17.678694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.678680    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:03:17.678772 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.678696    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:03:17.678977 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.678952    2568 factory.go:153] Registering CRI-O factory
Jul 24 17:03:17.678977 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.678973    2568 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:03:17.679114 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.679068    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:03:17.679151 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.679096    2568 factory.go:103] Registering Raw factory
Jul 24 17:03:17.679151 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.679131    2568 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:03:17.679449 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.679424    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:03:17.679563 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.679539    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:03:17.679642 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.679622    2568 manager.go:349] Starting recovery of all containers
Jul 24 17:03:17.690763 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.690617    2568 manager.go:354] Recovery completed
Jul 24 17:03:17.694982 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.694965    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:17.697003 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.696983    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:17.697079 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.697017    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:17.697079 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.697029    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:17.697665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.697643    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:03:17.697665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.697658    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:17.697665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.697662    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:03:17.697848 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.697684    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:03:17.698330 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.698314    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:17.698398 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.698347    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:17.698398 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.698362    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:17.699401 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.699388    2568 policy_none.go:49] "None policy: Start"
Jul 24 17:03:17.699471 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.699411    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:03:17.699471 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.699421    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:03:17.700435 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.700424    2568 policy_none.go:47] "Start"
Jul 24 17:03:17.741494 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.741465    2568 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:03:17.741657 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.741514    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:03:17.741657 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.741528    2568 server.go:87] "Starting device plugin registration server"
Jul 24 17:03:17.741909 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.741894    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:03:17.741986 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.741910    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:03:17.742060 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.741980    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:03:17.742158 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.742066    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:03:17.742158 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.742075    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:03:17.742794 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.742775    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:03:17.742899 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.742825    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:17.843596 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.843556    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:17.844831 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.844814    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:17.844914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.844851    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:17.844914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.844862    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:17.844914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.844896    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-244.ec2.internal"
Jul 24 17:03:17.853747 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.853727    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-244.ec2.internal"
Jul 24 17:03:17.853851 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.853753    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-244.ec2.internal\": node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:17.868060 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.868033    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:17.896900 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.896863    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:03:17.898193 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.898171    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:03:17.898288 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.898206    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:03:17.898288 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.898230    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:03:17.898288 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.898263    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:03:17.900355 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.900334    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:17.969118 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:17.969062    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:17.999217 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.999149    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"]
Jul 24 17:03:17.999297 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:17.999242    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:18.000942 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.000915    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:18.001069 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.000958    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:18.001069 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.000970    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:18.002388 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.002373    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:18.002575 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.002557    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.002637 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.002598    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:18.003183 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.003167    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:18.003260 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.003193    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:18.003260 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.003204    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:18.003260 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.003168    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:18.003359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.003271    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:18.003359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.003283    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:18.004358 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.004343    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.004411 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.004370    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:03:18.005056 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.005042    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:03:18.005128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.005064    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:03:18.005128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.005076    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:03:18.029674 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.029651    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-244.ec2.internal\" not found" node="ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.034364 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.034346    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-244.ec2.internal\" not found" node="ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.069768 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.069735    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.081197 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.081160    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6639406098908c30ae3f9b47e0ab666b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"6639406098908c30ae3f9b47e0ab666b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.081197 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.081194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6639406098908c30ae3f9b47e0ab666b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"6639406098908c30ae3f9b47e0ab666b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.081381 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.081214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d1c8ea34a92f47a9f2b52347e44f84a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-244.ec2.internal\" (UID: \"3d1c8ea34a92f47a9f2b52347e44f84a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.170959 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.170908    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.181944 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.181915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6639406098908c30ae3f9b47e0ab666b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"6639406098908c30ae3f9b47e0ab666b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.182011 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.181952    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6639406098908c30ae3f9b47e0ab666b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"6639406098908c30ae3f9b47e0ab666b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.182011 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.181971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d1c8ea34a92f47a9f2b52347e44f84a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-244.ec2.internal\" (UID: \"3d1c8ea34a92f47a9f2b52347e44f84a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.182105 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.182041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6639406098908c30ae3f9b47e0ab666b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"6639406098908c30ae3f9b47e0ab666b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.182105 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.182047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6639406098908c30ae3f9b47e0ab666b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal\" (UID: \"6639406098908c30ae3f9b47e0ab666b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.182105 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.182041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d1c8ea34a92f47a9f2b52347e44f84a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-244.ec2.internal\" (UID: \"3d1c8ea34a92f47a9f2b52347e44f84a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.276526 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.276456    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.333518 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.333480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.337851 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.337665    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.377501 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.377465    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.482759 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.482684    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.554688 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.554614    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:18.583797 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.583761    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.609066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.609045    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:03:18.609689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.609205    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:03:18.609689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.609228    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:03:18.676301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.676254    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:58:17 +0000 UTC" deadline="2028-03-17 12:42:20.482627706 +0000 UTC"
Jul 24 17:03:18.676301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.676290    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14443h39m1.80634099s"
Jul 24 17:03:18.684590 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.684571    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.785239 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:18.785208    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-244.ec2.internal\" not found"
Jul 24 17:03:18.787391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.787370    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:18.866195 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:18.866151    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1c8ea34a92f47a9f2b52347e44f84a.slice/crio-80338dfd4f5a9aba5898d5dba0fa8eb4e83ea01f0d949d076f743e8e94c99cb1 WatchSource:0}: Error finding container 80338dfd4f5a9aba5898d5dba0fa8eb4e83ea01f0d949d076f743e8e94c99cb1: Status 404 returned error can't find the container with id 80338dfd4f5a9aba5898d5dba0fa8eb4e83ea01f0d949d076f743e8e94c99cb1
Jul 24 17:03:18.866402 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:18.866384    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6639406098908c30ae3f9b47e0ab666b.slice/crio-ffea5f0f759fdfcc3930b78a75d5b514c1d32edd6ea530d53439f8d77fcb8584 WatchSource:0}: Error finding container ffea5f0f759fdfcc3930b78a75d5b514c1d32edd6ea530d53439f8d77fcb8584: Status 404 returned error can't find the container with id ffea5f0f759fdfcc3930b78a75d5b514c1d32edd6ea530d53439f8d77fcb8584
Jul 24 17:03:18.872137 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.872120    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:03:18.877839 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.877815    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.884404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.884385    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:18.885330 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.885302    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal"
Jul 24 17:03:18.895584 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.895564    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:03:18.901689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.901652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" event={"ID":"6639406098908c30ae3f9b47e0ab666b","Type":"ContainerStarted","Data":"ffea5f0f759fdfcc3930b78a75d5b514c1d32edd6ea530d53439f8d77fcb8584"}
Jul 24 17:03:18.902698 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:18.902682    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" event={"ID":"3d1c8ea34a92f47a9f2b52347e44f84a","Type":"ContainerStarted","Data":"80338dfd4f5a9aba5898d5dba0fa8eb4e83ea01f0d949d076f743e8e94c99cb1"}
Jul 24 17:03:19.150873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.150783    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:19.645792 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.645664    2568 apiserver.go:52] "Watching apiserver"
Jul 24 17:03:19.656226 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.656189    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:03:19.657308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.657274    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t","openshift-cluster-node-tuning-operator/tuned-b9bvt","openshift-image-registry/node-ca-v6bq9","openshift-multus/multus-additional-cni-plugins-zshxz","openshift-multus/network-metrics-daemon-276m8","openshift-network-diagnostics/network-check-target-xkrj8","kube-system/global-pull-secret-syncer-89hrh","openshift-dns/node-resolver-8jvkl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal","openshift-multus/multus-nhgxb","openshift-network-operator/iptables-alerter-zdb6w","openshift-ovn-kubernetes/ovnkube-node-bwkhv","kube-system/konnectivity-agent-pjfn2"]
Jul 24 17:03:19.658934 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.658809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:19.658934 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.658899    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:19.660303 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.660279    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.661981 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.661959    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.663190 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.662943    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:03:19.663190 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.662953    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.664134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.663525    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.664134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.664067    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:03:19.664134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.664094    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qxxlc\""
Jul 24 17:03:19.664134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.664101    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.664677 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.664659    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:03:19.664927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.664912    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.665193 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.665172    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:03:19.665284 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.665220    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.665344 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.665300    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.665454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.665408    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:03:19.665801 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.665781    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.665881 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.665846    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bsrkd\""
Jul 24 17:03:19.666037 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.666023    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:03:19.666331 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.666310    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.666417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.666337    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99kcv\""
Jul 24 17:03:19.666634 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.666616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:19.666727 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.666692    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:19.667929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.667465    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.667929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.667532    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dj8jg\""
Jul 24 17:03:19.668311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.668295    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:03:19.668311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.668306    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.668427 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.668312    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:03:19.668501 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.668485    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:03:19.668700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.668686    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.671316 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.671147    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5v2gv\""
Jul 24 17:03:19.671316 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.671163    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.671497 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.671343    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:03:19.672644 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.672624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.674189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.673247    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.674189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.673453    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.674189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.673487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fwdmt\""
Jul 24 17:03:19.674189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.673697    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:03:19.674510 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.674468    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.674912 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.674874    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xgzbb\""
Jul 24 17:03:19.675311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.675073    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.675311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.675101    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.675685 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.675551    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.675685 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.675618    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:19.677029 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.677005    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.677280 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.677243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5s8wd\""
Jul 24 17:03:19.677380 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.677365    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:03:19.677521 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.677503    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:03:19.677617 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.677582    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:03:19.678954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.678778    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p2jrb\""
Jul 24 17:03:19.678954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.678876    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:03:19.679495 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.679356    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:03:19.679495 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.679366    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:03:19.686129 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.686101    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klqpx\" (UniqueName: \"kubernetes.io/projected/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-kube-api-access-klqpx\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692259    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sls52\" (UniqueName: \"kubernetes.io/projected/b8d3657f-5c99-4011-8563-18a00a438252-kube-api-access-sls52\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692287    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-ovn\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692332    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwrm\" (UniqueName: \"kubernetes.io/projected/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-kube-api-access-lbwrm\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692356    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-netns\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-hostroot\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692397    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-os-release\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysctl-conf\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692462    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-kubelet\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-os-release\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-socket-dir-parent\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-sys\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692603    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-run-netns\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovnkube-config\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.692687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/534760f6-ef14-456f-bd3b-798234068cf6-serviceca\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-var-lib-kubelet\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-systemd-units\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-cni-binary-copy\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692846    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-device-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-system-cni-dir\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f27fd31-580b-4761-8a69-cc461697c7fb-agent-certs\") pod \"konnectivity-agent-pjfn2\" (UID: \"1f27fd31-580b-4761-8a69-cc461697c7fb\") " pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f27fd31-580b-4761-8a69-cc461697c7fb-konnectivity-ca\") pod \"konnectivity-agent-pjfn2\" (UID: \"1f27fd31-580b-4761-8a69-cc461697c7fb\") " pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.692985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-cni-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693013    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-cnibin\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693036    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-cni-bin\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86eba38d-538f-4515-b955-a2f67d965f63-hosts-file\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86eba38d-538f-4515-b955-a2f67d965f63-tmp-dir\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-iptables-alerter-script\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-kubernetes\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.693440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5ch\" (UniqueName: \"kubernetes.io/projected/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-kube-api-access-bf5ch\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-sys-fs\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693254    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n89f\" (UniqueName: \"kubernetes.io/projected/1f029edc-8754-4234-999b-5ee164590a3c-kube-api-access-4n89f\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5xj4\" (UniqueName: \"kubernetes.io/projected/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-kube-api-access-w5xj4\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-node-log\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693370    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovn-node-metrics-cert\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-kubelet\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-cni-binary-copy\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-multus-certs\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-socket-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-registration-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysctl-d\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-systemd\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-run\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693613    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-conf-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.694035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-modprobe-d\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693657    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-host\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fafc04bd-803f-4aed-93e5-a0a54bd0407e-kubelet-config\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-cni-netd\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-env-overrides\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovnkube-script-lib\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693804    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-etc-kubernetes\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-host-slash\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-var-lib-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693920    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-cni-bin\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693941    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fbe7acd-7193-431a-92f5-237bcae31331-etc-tuned\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693967    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.693988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-system-cni-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.694884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-cni-multus\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-lib-modules\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-k8s-cni-cncf-io\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysconfig\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-log-socket\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694174    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/534760f6-ef14-456f-bd3b-798234068cf6-host\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-cnibin\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-slash\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-run-ovn-kubernetes\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-daemon-config\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694289    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lgkc\" (UniqueName: \"kubernetes.io/projected/4fbe7acd-7193-431a-92f5-237bcae31331-kube-api-access-8lgkc\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fafc04bd-803f-4aed-93e5-a0a54bd0407e-dbus\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-systemd\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-etc-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.695638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694385    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.696359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzw2\" (UniqueName: \"kubernetes.io/projected/534760f6-ef14-456f-bd3b-798234068cf6-kube-api-access-bpzw2\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.696359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694437    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fbe7acd-7193-431a-92f5-237bcae31331-tmp\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.696359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.694466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmr62\" (UniqueName: \"kubernetes.io/projected/86eba38d-538f-4515-b955-a2f67d965f63-kube-api-access-wmr62\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.711998 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.711973    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n2f8k"
Jul 24 17:03:19.719315 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.719286    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n2f8k"
Jul 24 17:03:19.794789 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.794789 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794790    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-host-slash\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794805    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-var-lib-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794822    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-cni-bin\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-cni-bin\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794898    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-var-lib-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-host-slash\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fbe7acd-7193-431a-92f5-237bcae31331-etc-tuned\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-system-cni-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.794980    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-cni-multus\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-cni-multus\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.795045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-lib-modules\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795059    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-system-cni-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795098    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795076    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795179    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-lib-modules\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-k8s-cni-cncf-io\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-k8s-cni-cncf-io\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysconfig\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-log-socket\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysconfig\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795268    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.795316    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-log-socket\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/534760f6-ef14-456f-bd3b-798234068cf6-host\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/534760f6-ef14-456f-bd3b-798234068cf6-host\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-cnibin\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-slash\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.795535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795418    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-cnibin\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-run-ovn-kubernetes\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-run-ovn-kubernetes\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.795474    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:03:20.295436505 +0000 UTC m=+3.010590270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795503    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-slash\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-daemon-config\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgkc\" (UniqueName: \"kubernetes.io/projected/4fbe7acd-7193-431a-92f5-237bcae31331-kube-api-access-8lgkc\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fafc04bd-803f-4aed-93e5-a0a54bd0407e-dbus\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-systemd\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-etc-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795636    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzw2\" (UniqueName: \"kubernetes.io/projected/534760f6-ef14-456f-bd3b-798234068cf6-kube-api-access-bpzw2\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fbe7acd-7193-431a-92f5-237bcae31331-tmp\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795688    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fafc04bd-803f-4aed-93e5-a0a54bd0407e-dbus\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmr62\" (UniqueName: \"kubernetes.io/projected/86eba38d-538f-4515-b955-a2f67d965f63-kube-api-access-wmr62\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795734    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klqpx\" (UniqueName: \"kubernetes.io/projected/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-kube-api-access-klqpx\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.796342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sls52\" (UniqueName: \"kubernetes.io/projected/b8d3657f-5c99-4011-8563-18a00a438252-kube-api-access-sls52\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-etc-openvswitch\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-ovn\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwrm\" (UniqueName: \"kubernetes.io/projected/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-kube-api-access-lbwrm\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795880    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-systemd\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.795933    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-run-ovn\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-daemon-config\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796169    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-netns\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-hostroot\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-os-release\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-netns\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796323    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-hostroot\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysctl-conf\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-os-release\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-kubelet\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysctl-conf\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.797203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-os-release\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-socket-dir-parent\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-kubelet\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796549    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-sys\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-run-netns\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovnkube-config\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/534760f6-ef14-456f-bd3b-798234068cf6-serviceca\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-var-lib-kubelet\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-sys\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-var-lib-kubelet\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-systemd-units\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-cni-binary-copy\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-run-netns\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-device-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-system-cni-dir\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796923    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f27fd31-580b-4761-8a69-cc461697c7fb-agent-certs\") pod \"konnectivity-agent-pjfn2\" (UID: \"1f27fd31-580b-4761-8a69-cc461697c7fb\") " pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f27fd31-580b-4761-8a69-cc461697c7fb-konnectivity-ca\") pod \"konnectivity-agent-pjfn2\" (UID: \"1f27fd31-580b-4761-8a69-cc461697c7fb\") " pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.798128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.796992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-cni-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-cnibin\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797018    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-cni-bin\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86eba38d-538f-4515-b955-a2f67d965f63-hosts-file\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86eba38d-538f-4515-b955-a2f67d965f63-tmp-dir\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-iptables-alerter-script\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-kubernetes\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5ch\" (UniqueName: \"kubernetes.io/projected/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-kube-api-access-bf5ch\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-sys-fs\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n89f\" (UniqueName: \"kubernetes.io/projected/1f029edc-8754-4234-999b-5ee164590a3c-kube-api-access-4n89f\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797314    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5xj4\" (UniqueName: \"kubernetes.io/projected/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-kube-api-access-w5xj4\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797327    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-node-log\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovn-node-metrics-cert\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-kubelet\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-cni-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-cni-binary-copy\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.799203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovnkube-config\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-os-release\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-multus-certs\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797477    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/534760f6-ef14-456f-bd3b-798234068cf6-serviceca\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-socket-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-registration-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-socket-dir-parent\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-systemd-units\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysctl-d\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-systemd\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-run\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-conf-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-modprobe-d\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-host\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fafc04bd-803f-4aed-93e5-a0a54bd0407e-kubelet-config\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-cnibin\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-multus-conf-dir\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.800382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-run\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-cni-bin\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.797964    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797543    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-device-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797988    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797987    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86eba38d-538f-4515-b955-a2f67d965f63-hosts-file\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797774    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d3657f-5c99-4011-8563-18a00a438252-cni-binary-copy\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-modprobe-d\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798060    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-host\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.797823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798085    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fafc04bd-803f-4aed-93e5-a0a54bd0407e-kubelet-config\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798092    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-cni-binary-copy\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-cni-netd\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-env-overrides\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-systemd\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovnkube-script-lib\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86eba38d-538f-4515-b955-a2f67d965f63-tmp-dir\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.801195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798234    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-sysctl-d\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798334    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-var-lib-kubelet\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-etc-kubernetes\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-sys-fs\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-node-log\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798544    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-host-cni-netd\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-socket-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798673    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-host-run-multus-certs\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798701    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f029edc-8754-4234-999b-5ee164590a3c-registration-dir\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798704    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-etc-kubernetes\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798338    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fbe7acd-7193-431a-92f5-237bcae31331-etc-kubernetes\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.798804    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:03:20.298767933 +0000 UTC m=+3.013921697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.798804    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d3657f-5c99-4011-8563-18a00a438252-system-cni-dir\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.799072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovnkube-script-lib\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.799156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fbe7acd-7193-431a-92f5-237bcae31331-tmp\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.801956 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.799161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-iptables-alerter-script\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.799436    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f27fd31-580b-4761-8a69-cc461697c7fb-konnectivity-ca\") pod \"konnectivity-agent-pjfn2\" (UID: \"1f27fd31-580b-4761-8a69-cc461697c7fb\") " pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.799582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-env-overrides\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.800061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fbe7acd-7193-431a-92f5-237bcae31331-etc-tuned\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.801062    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.801087    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.801101    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:19.801244    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:20.301226087 +0000 UTC m=+3.016379872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:19.802759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.801474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-ovn-node-metrics-cert\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.803145 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.802891    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f27fd31-580b-4761-8a69-cc461697c7fb-agent-certs\") pod \"konnectivity-agent-pjfn2\" (UID: \"1f27fd31-580b-4761-8a69-cc461697c7fb\") " pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:19.804323 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.804298    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lgkc\" (UniqueName: \"kubernetes.io/projected/4fbe7acd-7193-431a-92f5-237bcae31331-kube-api-access-8lgkc\") pod \"tuned-b9bvt\" (UID: \"4fbe7acd-7193-431a-92f5-237bcae31331\") " pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:19.805151 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.805058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwrm\" (UniqueName: \"kubernetes.io/projected/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-kube-api-access-lbwrm\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:19.805323 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.805300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sls52\" (UniqueName: \"kubernetes.io/projected/b8d3657f-5c99-4011-8563-18a00a438252-kube-api-access-sls52\") pod \"multus-additional-cni-plugins-zshxz\" (UID: \"b8d3657f-5c99-4011-8563-18a00a438252\") " pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:19.806368 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.806151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzw2\" (UniqueName: \"kubernetes.io/projected/534760f6-ef14-456f-bd3b-798234068cf6-kube-api-access-bpzw2\") pod \"node-ca-v6bq9\" (UID: \"534760f6-ef14-456f-bd3b-798234068cf6\") " pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:19.806931 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.806897    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmr62\" (UniqueName: \"kubernetes.io/projected/86eba38d-538f-4515-b955-a2f67d965f63-kube-api-access-wmr62\") pod \"node-resolver-8jvkl\" (UID: \"86eba38d-538f-4515-b955-a2f67d965f63\") " pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:19.807414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.807389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5xj4\" (UniqueName: \"kubernetes.io/projected/d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4-kube-api-access-w5xj4\") pod \"ovnkube-node-bwkhv\" (UID: \"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.807414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.807408    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klqpx\" (UniqueName: \"kubernetes.io/projected/0b0d42a8-ed9e-4e0c-a322-d62240164c8e-kube-api-access-klqpx\") pod \"iptables-alerter-zdb6w\" (UID: \"0b0d42a8-ed9e-4e0c-a322-d62240164c8e\") " pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:19.807731 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.807698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n89f\" (UniqueName: \"kubernetes.io/projected/1f029edc-8754-4234-999b-5ee164590a3c-kube-api-access-4n89f\") pod \"aws-ebs-csi-driver-node-wb64t\" (UID: \"1f029edc-8754-4234-999b-5ee164590a3c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:19.808142 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.808113    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5ch\" (UniqueName: \"kubernetes.io/projected/72f1fe70-201c-4c76-a8d8-5aa7ea3922b6-kube-api-access-bf5ch\") pod \"multus-nhgxb\" (UID: \"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6\") " pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:19.975169 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.975089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:19.985303 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:19.985278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zdb6w"
Jul 24 17:03:20.000290 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.000259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v6bq9"
Jul 24 17:03:20.005685 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.005657    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zshxz"
Jul 24 17:03:20.013476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.013442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhgxb"
Jul 24 17:03:20.022178 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.022157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t"
Jul 24 17:03:20.029125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.029100    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8jvkl"
Jul 24 17:03:20.037921 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.037895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b9bvt"
Jul 24 17:03:20.042958 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.042931    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:20.302184 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.302098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:20.302184 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.302144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.302210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302289    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302306    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302315    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302333    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302306    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302379    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:03:21.302356169 +0000 UTC m=+4.017509978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:20.302405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302401    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:21.302390543 +0000 UTC m=+4.017544312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:20.302660 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.302416    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:03:21.302409934 +0000 UTC m=+4.017563698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:20.713195 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.713170    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f029edc_8754_4234_999b_5ee164590a3c.slice/crio-cfc06b0f5f33157c26f9004867cc0e309a59185e7ebd3f581516dd330f6c2454 WatchSource:0}: Error finding container cfc06b0f5f33157c26f9004867cc0e309a59185e7ebd3f581516dd330f6c2454: Status 404 returned error can't find the container with id cfc06b0f5f33157c26f9004867cc0e309a59185e7ebd3f581516dd330f6c2454
Jul 24 17:03:20.722274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.722245    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:19 +0000 UTC" deadline="2028-01-19 08:43:46.458640941 +0000 UTC"
Jul 24 17:03:20.722274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.722273    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13047h40m25.736371975s"
Jul 24 17:03:20.730943 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.730910    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbe7acd_7193_431a_92f5_237bcae31331.slice/crio-4774f96c8bd91b7def6e459d560be2f965d7dca15661dd6c08a0f558a5be970c WatchSource:0}: Error finding container 4774f96c8bd91b7def6e459d560be2f965d7dca15661dd6c08a0f558a5be970c: Status 404 returned error can't find the container with id 4774f96c8bd91b7def6e459d560be2f965d7dca15661dd6c08a0f558a5be970c
Jul 24 17:03:20.732065 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.732037    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0d42a8_ed9e_4e0c_a322_d62240164c8e.slice/crio-f20ef8c6e131c95a4946d03b4ebf6353f42f6d3c4d918818cd0be7db8552f833 WatchSource:0}: Error finding container f20ef8c6e131c95a4946d03b4ebf6353f42f6d3c4d918818cd0be7db8552f833: Status 404 returned error can't find the container with id f20ef8c6e131c95a4946d03b4ebf6353f42f6d3c4d918818cd0be7db8552f833
Jul 24 17:03:20.733380 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.732751    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86eba38d_538f_4515_b955_a2f67d965f63.slice/crio-a504adccde11539658a8fff034c6474d381e289c28feabd076729f240de6c2ca WatchSource:0}: Error finding container a504adccde11539658a8fff034c6474d381e289c28feabd076729f240de6c2ca: Status 404 returned error can't find the container with id a504adccde11539658a8fff034c6474d381e289c28feabd076729f240de6c2ca
Jul 24 17:03:20.733699 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.733678    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f27fd31_580b_4761_8a69_cc461697c7fb.slice/crio-13d246d06187ad10112848bc6de129a85885a19ccb7bc570be41ab505d805d06 WatchSource:0}: Error finding container 13d246d06187ad10112848bc6de129a85885a19ccb7bc570be41ab505d805d06: Status 404 returned error can't find the container with id 13d246d06187ad10112848bc6de129a85885a19ccb7bc570be41ab505d805d06
Jul 24 17:03:20.734994 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.734514    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d3657f_5c99_4011_8563_18a00a438252.slice/crio-5124f71d560254cc6155255cfe15331ef4e9ce14cd358c0b2212a5a19b8e0d39 WatchSource:0}: Error finding container 5124f71d560254cc6155255cfe15331ef4e9ce14cd358c0b2212a5a19b8e0d39: Status 404 returned error can't find the container with id 5124f71d560254cc6155255cfe15331ef4e9ce14cd358c0b2212a5a19b8e0d39
Jul 24 17:03:20.737064 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:20.737041    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f1fe70_201c_4c76_a8d8_5aa7ea3922b6.slice/crio-cd98f1b2a795b0228305309ac2701f8e7d7c9eb987314402e95f27942eb840b6 WatchSource:0}: Error finding container cd98f1b2a795b0228305309ac2701f8e7d7c9eb987314402e95f27942eb840b6: Status 404 returned error can't find the container with id cd98f1b2a795b0228305309ac2701f8e7d7c9eb987314402e95f27942eb840b6
Jul 24 17:03:20.899001 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.898828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:20.899090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.898831    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:20.899127 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.899109    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:20.899245 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:20.899222    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:20.906818 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.906788    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" event={"ID":"3d1c8ea34a92f47a9f2b52347e44f84a","Type":"ContainerStarted","Data":"153f0f52aa1812c28b2042a005dd7fadff4edcb454ada8836aac79a94b343045"}
Jul 24 17:03:20.907850 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.907828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhgxb" event={"ID":"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6","Type":"ContainerStarted","Data":"cd98f1b2a795b0228305309ac2701f8e7d7c9eb987314402e95f27942eb840b6"}
Jul 24 17:03:20.908867 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.908817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"22c9c591daa98b3add9be6ba293553edea772f4a32fbc7d2eb6759b2271ba970"}
Jul 24 17:03:20.909803 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.909779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pjfn2" event={"ID":"1f27fd31-580b-4761-8a69-cc461697c7fb","Type":"ContainerStarted","Data":"13d246d06187ad10112848bc6de129a85885a19ccb7bc570be41ab505d805d06"}
Jul 24 17:03:20.910814 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.910795    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v6bq9" event={"ID":"534760f6-ef14-456f-bd3b-798234068cf6","Type":"ContainerStarted","Data":"c2eabec853c31d5780185051325c34ed692fc24125ea27840c2db5d16ac69604"}
Jul 24 17:03:20.911651 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.911633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerStarted","Data":"5124f71d560254cc6155255cfe15331ef4e9ce14cd358c0b2212a5a19b8e0d39"}
Jul 24 17:03:20.912595 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.912576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8jvkl" event={"ID":"86eba38d-538f-4515-b955-a2f67d965f63","Type":"ContainerStarted","Data":"a504adccde11539658a8fff034c6474d381e289c28feabd076729f240de6c2ca"}
Jul 24 17:03:20.913679 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.913657    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zdb6w" event={"ID":"0b0d42a8-ed9e-4e0c-a322-d62240164c8e","Type":"ContainerStarted","Data":"f20ef8c6e131c95a4946d03b4ebf6353f42f6d3c4d918818cd0be7db8552f833"}
Jul 24 17:03:20.914600 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.914572    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b9bvt" event={"ID":"4fbe7acd-7193-431a-92f5-237bcae31331","Type":"ContainerStarted","Data":"4774f96c8bd91b7def6e459d560be2f965d7dca15661dd6c08a0f558a5be970c"}
Jul 24 17:03:20.915558 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.915539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t" event={"ID":"1f029edc-8754-4234-999b-5ee164590a3c","Type":"ContainerStarted","Data":"cfc06b0f5f33157c26f9004867cc0e309a59185e7ebd3f581516dd330f6c2454"}
Jul 24 17:03:20.918737 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:20.918680    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-244.ec2.internal" podStartSLOduration=2.918666734 podStartE2EDuration="2.918666734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:20.918426118 +0000 UTC m=+3.633579908" watchObservedRunningTime="2026-07-24 17:03:20.918666734 +0000 UTC m=+3.633820520"
Jul 24 17:03:21.308394 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.308304    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:21.308394 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.308379    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:21.308611 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.308408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:21.308611 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.308532    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:21.308611 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.308595    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:03:23.308575465 +0000 UTC m=+6.023729234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:21.309041 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.309020    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:21.309134 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.309078    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:03:23.309063053 +0000 UTC m=+6.024216817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:21.309202 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.309158    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:21.309202 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.309174    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:21.309202 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.309187    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:21.309339 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.309224    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:23.309212865 +0000 UTC m=+6.024366629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:21.657437 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.657409    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:03:21.723047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.722978    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:58:19 +0000 UTC" deadline="2027-12-29 20:09:24.762300925 +0000 UTC"
Jul 24 17:03:21.723047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.723045    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12555h6m3.039260775s"
Jul 24 17:03:21.902178 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.901576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:21.902178 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:21.901727    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:21.934769 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.933769    2568 generic.go:356] "Generic (PLEG): container finished" podID="6639406098908c30ae3f9b47e0ab666b" containerID="f38331a131ff7c8e617fedfad86309faf22241581ae6da0fc69d297bbb3f473c" exitCode=0
Jul 24 17:03:21.934769 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:21.934414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" event={"ID":"6639406098908c30ae3f9b47e0ab666b","Type":"ContainerDied","Data":"f38331a131ff7c8e617fedfad86309faf22241581ae6da0fc69d297bbb3f473c"}
Jul 24 17:03:22.898845 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:22.898811    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:22.899280 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:22.898958    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:22.899280 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:22.899033    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:22.899280 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:22.899100    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:22.944049 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:22.943984    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" event={"ID":"6639406098908c30ae3f9b47e0ab666b","Type":"ContainerStarted","Data":"b3eb2605003573d6f5f8f972d39ef22c2bf3670fe4b9d440b8370e0f5498a1fc"}
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:23.329220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:23.329280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:23.329311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.329473    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.329538    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:03:27.329518441 +0000 UTC m=+10.044672208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.329932    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.329986    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:03:27.329969792 +0000 UTC m=+10.045123559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.330079    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.330097    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.330110    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:23.330231 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.330147    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:27.330134849 +0000 UTC m=+10.045288617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:23.901640 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:23.901581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:23.902113 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:23.901733    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:24.898699 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:24.898655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:24.898907 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:24.898810    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:24.898907 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:24.898876    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:24.899019 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:24.898954    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:25.898831 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:25.898752    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:25.899280 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:25.898887    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:26.899222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:26.899183    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:26.899763 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:26.899332    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:26.899763 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:26.899383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:26.899763 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:26.899506    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:27.367557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:27.367618    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:27.367646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367791    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367859    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:03:35.367841484 +0000 UTC m=+18.082995252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367863    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367877    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367888    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367791    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:27.367991 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.367924    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:35.367912953 +0000 UTC m=+18.083066732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:27.368552 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.368022    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:03:35.36799895 +0000 UTC m=+18.083152728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:27.899871 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:27.899838    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:27.900349 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:27.899952    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:28.899357 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:28.899264    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:28.899521 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:28.899416    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:28.899521 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:28.899467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:28.899654 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:28.899583    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:29.898706 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:29.898673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:29.899128 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:29.898825    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:30.899133 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:30.899095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:30.899510 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:30.899095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:30.899510 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:30.899207    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:30.899510 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:30.899274    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:31.901690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:31.901661    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:31.902158 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:31.901800    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:32.898455 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:32.898420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:32.898628 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:32.898471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:32.898628 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:32.898564    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:32.898741 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:32.898634    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:33.899485 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:33.899440    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:33.899910 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:33.899585    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:34.898786 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:34.898747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:34.898786 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:34.898769    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:34.899059 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:34.898912    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:34.899059 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:34.899032    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:35.428859 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:35.428815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:35.428875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:35.428908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.428972    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.428989    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.429017    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.429037    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:03:51.429017757 +0000 UTC m=+34.144171535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.429047    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.429056    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:03:51.429046224 +0000 UTC m=+34.144199990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.429064    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:35.429444 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.429120    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:03:51.42910569 +0000 UTC m=+34.144259477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:35.899414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:35.899332    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:35.899583 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:35.899485    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:36.898434 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:36.898401    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:36.898911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:36.898449    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:36.898911 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:36.898534    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:36.898911 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:36.898642    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:37.899417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:37.899384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:37.899854 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:37.899495    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:38.898757 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:38.898709    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:38.898884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:38.898769    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:38.898884 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:38.898845    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:38.898960 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:38.898904    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:39.899452 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.899069    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:39.900447 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:39.899517    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:39.977726 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.977675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhgxb" event={"ID":"72f1fe70-201c-4c76-a8d8-5aa7ea3922b6","Type":"ContainerStarted","Data":"3994b09b4548e411eada9776d9f2617f0fa76da8208927cfb78bb8c30d426456"}
Jul 24 17:03:39.983106 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983082    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:03:39.983403 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983383    2568 generic.go:356] "Generic (PLEG): container finished" podID="d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4" containerID="5bfd1e901e05f81a95d4ff3085ec7dd1c8f539eab81ecd854129cce5ab45320f" exitCode=1
Jul 24 17:03:39.983482 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"820cc445d59d75b5a96060138650880ebd4f54bb5454362ec0001b7f21daf824"}
Jul 24 17:03:39.983532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983517    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"f50b04ef20c7652eb3360fef3f6a9e05635c9db7363eed10e828d20de067cf62"}
Jul 24 17:03:39.983579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983548    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"b75b423f7e0c1987869f587385c2df3203f87e4bef486ae130463b0282575927"}
Jul 24 17:03:39.983622 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"1564e3ce9ec1477b15e85c5fc36897f626c1f4aa0ef823ddb051308f2fc047e7"}
Jul 24 17:03:39.983622 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerDied","Data":"5bfd1e901e05f81a95d4ff3085ec7dd1c8f539eab81ecd854129cce5ab45320f"}
Jul 24 17:03:39.983700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.983638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"53116ad5b8da6bc766c5672a19e0108b0eb4517bd69c77bfffad016492e46360"}
Jul 24 17:03:39.984772 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.984748    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pjfn2" event={"ID":"1f27fd31-580b-4761-8a69-cc461697c7fb","Type":"ContainerStarted","Data":"43c40e1ae276364b1afba934984d8722b8f6504ab0aa9eb60c67a3af420d76da"}
Jul 24 17:03:39.986103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.986079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v6bq9" event={"ID":"534760f6-ef14-456f-bd3b-798234068cf6","Type":"ContainerStarted","Data":"67349bcd80a5a1367be578307b5fa4def82195b99fc852d84d034562d85e9052"}
Jul 24 17:03:39.987838 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.987811    2568 generic.go:356] "Generic (PLEG): container finished" podID="b8d3657f-5c99-4011-8563-18a00a438252" containerID="17d7f8d7605fc19089c45adac108641cbe9c6bcdb29265a1c0a4aaa37fb31b9a" exitCode=0
Jul 24 17:03:39.987973 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.987900    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerDied","Data":"17d7f8d7605fc19089c45adac108641cbe9c6bcdb29265a1c0a4aaa37fb31b9a"}
Jul 24 17:03:39.989576 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.989431    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8jvkl" event={"ID":"86eba38d-538f-4515-b955-a2f67d965f63","Type":"ContainerStarted","Data":"61887139adf2effade0bff86cd2fd325573119b0e5e823f0a5fa8a2bf54c1d5c"}
Jul 24 17:03:39.991070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.991032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b9bvt" event={"ID":"4fbe7acd-7193-431a-92f5-237bcae31331","Type":"ContainerStarted","Data":"81868db2752d3c5bb6880a26fa7b63c2af5a18b58cac73caf8a946eafb61b2d4"}
Jul 24 17:03:39.992576 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:39.992552    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t" event={"ID":"1f029edc-8754-4234-999b-5ee164590a3c","Type":"ContainerStarted","Data":"aefc2f783ecc3e467e7c30869eae4f7460313e98616ab36eaa15475433387943"}
Jul 24 17:03:40.003555 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.003509    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-244.ec2.internal" podStartSLOduration=22.003494719 podStartE2EDuration="22.003494719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:22.958760101 +0000 UTC m=+5.673913888" watchObservedRunningTime="2026-07-24 17:03:40.003494719 +0000 UTC m=+22.718648504"
Jul 24 17:03:40.003730 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.003584    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nhgxb" podStartSLOduration=4.413085344 podStartE2EDuration="23.00357927s" totalImagesPullingTime="18.590493926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:40.003376414 +0000 UTC m=+22.718530200" watchObservedRunningTime="2026-07-24 17:03:40.00357927 +0000 UTC m=+22.718733056"
Jul 24 17:03:40.021527 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.021476    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v6bq9" podStartSLOduration=4.804475443 podStartE2EDuration="23.021460228s" totalImagesPullingTime="18.216984785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:40.021020719 +0000 UTC m=+22.736174504" watchObservedRunningTime="2026-07-24 17:03:40.021460228 +0000 UTC m=+22.736614013"
Jul 24 17:03:40.037926 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.037861    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pjfn2" podStartSLOduration=11.695954637 podStartE2EDuration="22.037843032s" totalImagesPullingTime="10.341888395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:40.037327588 +0000 UTC m=+22.752481376" watchObservedRunningTime="2026-07-24 17:03:40.037843032 +0000 UTC m=+22.752996819"
Jul 24 17:03:40.087895 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.087821    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8jvkl" podStartSLOduration=3.8818440770000002 podStartE2EDuration="22.087800925s" totalImagesPullingTime="18.205956848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:40.087364677 +0000 UTC m=+22.802518469" watchObservedRunningTime="2026-07-24 17:03:40.087800925 +0000 UTC m=+22.802954712"
Jul 24 17:03:40.105544 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.105488    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b9bvt" podStartSLOduration=3.879566852 podStartE2EDuration="22.105470372s" totalImagesPullingTime="18.22590352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:40.104904463 +0000 UTC m=+22.820058250" watchObservedRunningTime="2026-07-24 17:03:40.105470372 +0000 UTC m=+22.820624161"
Jul 24 17:03:40.613277 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.613244    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:03:40.754226 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.754128    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:03:40.613271121Z","UUID":"26dd2963-2b26-4e09-a9cb-4aeee0e5e50b","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:03:40.757499 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.757474    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:03:40.757645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.757513    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:03:40.899143 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.899056    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:40.899303 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.899069    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:40.899303 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:40.899192    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:40.899303 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:40.899242    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:40.997213 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.996919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zdb6w" event={"ID":"0b0d42a8-ed9e-4e0c-a322-d62240164c8e","Type":"ContainerStarted","Data":"f2639870fae046203a3fbd717341f15a30564ab737ea0a3057ed3100f617d68c"}
Jul 24 17:03:40.999097 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:40.999064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t" event={"ID":"1f029edc-8754-4234-999b-5ee164590a3c","Type":"ContainerStarted","Data":"414876e6ba04f0bc3cbf1559e30b1ec8f31d0b814da96801c5df1f100b57a84f"}
Jul 24 17:03:41.012564 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:41.012513    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zdb6w" podStartSLOduration=5.789902111 podStartE2EDuration="24.012494704s" totalImagesPullingTime="18.222592593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:41.012180392 +0000 UTC m=+23.727334178" watchObservedRunningTime="2026-07-24 17:03:41.012494704 +0000 UTC m=+23.727648489"
Jul 24 17:03:41.899507 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:41.899471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:41.899641 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:41.899617    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:42.005767 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:42.005737    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:03:42.006246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:42.006211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"f1d4d5de77e0ca0a6706b319d47e82e1b9f060bd4fab015c00f774ad8ff99dce"}
Jul 24 17:03:42.812926 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:42.812891    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:42.813528 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:42.813507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:42.899207 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:42.899175    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:42.899207 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:42.899197    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:42.899449 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:42.899318    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:42.899503 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:42.899467    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:43.011556 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:43.011521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t" event={"ID":"1f029edc-8754-4234-999b-5ee164590a3c","Type":"ContainerStarted","Data":"9fdbd6c6aece2adcc3c38349d1285fd77df28dbd8b968e1593549e980f2797df"}
Jul 24 17:03:43.012108 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:43.011671    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:43.012333 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:43.012318    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pjfn2"
Jul 24 17:03:43.031454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:43.031403    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wb64t" podStartSLOduration=5.098274065 podStartE2EDuration="26.031383446s" totalImagesPullingTime="20.933109381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:43.030976856 +0000 UTC m=+25.746130656" watchObservedRunningTime="2026-07-24 17:03:43.031383446 +0000 UTC m=+25.746537233"
Jul 24 17:03:43.898934 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:43.898899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:43.899124 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:43.899029    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:44.898966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:44.898727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:44.899532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:44.898774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:44.899532 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:44.899007    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:44.899532 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:44.899069    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:45.019182 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.019157    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:03:45.019542 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.019517    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"34d91c76011b58b997d98ca74212a6a561fa48cae71de1d2fb59c5680415da29"}
Jul 24 17:03:45.019823 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.019797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:45.019925 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.019879    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:45.020025 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.020005    2568 scope.go:117] "RemoveContainer" containerID="5bfd1e901e05f81a95d4ff3085ec7dd1c8f539eab81ecd854129cce5ab45320f"
Jul 24 17:03:45.023778 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.023753    2568 generic.go:356] "Generic (PLEG): container finished" podID="b8d3657f-5c99-4011-8563-18a00a438252" containerID="d2381933eab8a3a5a553df46c1f38d47dfbc451074174eedb6af8f6beebe9113" exitCode=0
Jul 24 17:03:45.023984 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.023849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerDied","Data":"d2381933eab8a3a5a553df46c1f38d47dfbc451074174eedb6af8f6beebe9113"}
Jul 24 17:03:45.037424 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.037405    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:45.898982 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:45.898956    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:45.899373 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:45.899076    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:46.030441 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.030245    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:03:46.030811 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.030786    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" event={"ID":"d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4","Type":"ContainerStarted","Data":"b6cde4cf9edb3d771bfb1049046acc29ab880e2dfca89531c04980d9ddcfdc9b"}
Jul 24 17:03:46.031177 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.031158    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:46.046936 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.046915    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:03:46.068623 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.068581    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv" podStartSLOduration=10.801990031999999 podStartE2EDuration="29.068566078s" totalImagesPullingTime="18.266576046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:46.068046063 +0000 UTC m=+28.783199863" watchObservedRunningTime="2026-07-24 17:03:46.068566078 +0000 UTC m=+28.783719864"
Jul 24 17:03:46.146374 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.146342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-276m8"]
Jul 24 17:03:46.146594 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.146478    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:46.146663 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:46.146591    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:46.154702 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.154672    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89hrh"]
Jul 24 17:03:46.154871 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.154821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:46.154953 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:46.154932    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:46.157869 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.157843    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xkrj8"]
Jul 24 17:03:46.157982 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:46.157957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:46.158049 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:46.158031    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:47.034843 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:47.034809    2568 generic.go:356] "Generic (PLEG): container finished" podID="b8d3657f-5c99-4011-8563-18a00a438252" containerID="9d7fff9956f1a9ce640e401d58c8588503b87c9c25361ea07dba44dfb21ec3e6" exitCode=0
Jul 24 17:03:47.035291 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:47.034898    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerDied","Data":"9d7fff9956f1a9ce640e401d58c8588503b87c9c25361ea07dba44dfb21ec3e6"}
Jul 24 17:03:47.903254 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:47.903222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:47.903435 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:47.903263    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:47.903435 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:47.903319    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:47.903435 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:47.903347    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:47.903435 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:47.903390    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:47.903630 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:47.903466    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:49.042519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:49.042431    2568 generic.go:356] "Generic (PLEG): container finished" podID="b8d3657f-5c99-4011-8563-18a00a438252" containerID="24662ccebb5a091e35ff54e25cd84c580104cd590ec16d382bc215bec06f8d08" exitCode=0
Jul 24 17:03:49.042519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:49.042474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerDied","Data":"24662ccebb5a091e35ff54e25cd84c580104cd590ec16d382bc215bec06f8d08"}
Jul 24 17:03:49.901927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:49.901902    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:49.902122 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:49.902029    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:49.902189 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:49.902140    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:49.902189 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:49.902028    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:49.902282 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:49.902190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:49.902282 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:49.902257    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:51.432708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:51.432676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:51.432733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:51.432751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432849    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432867    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432873    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432889    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432903    2568 projected.go:196] Error preparing data for projected volume kube-api-access-2m4nk for pod openshift-network-diagnostics/network-check-target-xkrj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432916    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:04:23.432901653 +0000 UTC m=+66.148055417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432950    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk podName:3e720ec3-90e7-4c9b-aad3-d0e79047cc6c nodeName:}" failed. No retries permitted until 2026-07-24 17:04:23.432933869 +0000 UTC m=+66.148087651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m4nk" (UniqueName: "kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk") pod "network-check-target-xkrj8" (UID: "3e720ec3-90e7-4c9b-aad3-d0e79047cc6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:03:51.433203 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.432969    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret podName:fafc04bd-803f-4aed-93e5-a0a54bd0407e nodeName:}" failed. No retries permitted until 2026-07-24 17:04:23.432959733 +0000 UTC m=+66.148113502 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret") pod "global-pull-secret-syncer-89hrh" (UID: "fafc04bd-803f-4aed-93e5-a0a54bd0407e") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:03:51.902954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:51.902922    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:51.902954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:51.902953    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:51.903192 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:51.903055    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:51.903192 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.903051    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89hrh" podUID="fafc04bd-803f-4aed-93e5-a0a54bd0407e"
Jul 24 17:03:51.903307 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.903184    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkrj8" podUID="3e720ec3-90e7-4c9b-aad3-d0e79047cc6c"
Jul 24 17:03:51.903307 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:51.903283    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:03:52.137771 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.137684    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-244.ec2.internal" event="NodeReady"
Jul 24 17:03:52.137910 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.137833    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:03:52.187759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.187706    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zj2fs"]
Jul 24 17:03:52.190725 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.190694    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.193185 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.193071    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:03:52.193185 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.193128    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-57f2l\""
Jul 24 17:03:52.193351 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.193315    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:03:52.193598 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.193578    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2grtk"]
Jul 24 17:03:52.195297 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.195278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.197638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.197424    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:03:52.197638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.197459    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c58hb\""
Jul 24 17:03:52.197638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.197584    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:03:52.197906 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.197847    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:03:52.202373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.202176    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zj2fs"]
Jul 24 17:03:52.207466 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.207405    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2grtk"]
Jul 24 17:03:52.337530 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.337496    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-config-volume\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.337735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.337540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-tmp-dir\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.337735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.337623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhzkz\" (UniqueName: \"kubernetes.io/projected/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-kube-api-access-bhzkz\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.337735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.337696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5c52a0b-3e52-47d5-a8ab-934c2c353316-cert\") pod \"ingress-canary-2grtk\" (UID: \"f5c52a0b-3e52-47d5-a8ab-934c2c353316\") " pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.337894 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.337763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmctf\" (UniqueName: \"kubernetes.io/projected/f5c52a0b-3e52-47d5-a8ab-934c2c353316-kube-api-access-nmctf\") pod \"ingress-canary-2grtk\" (UID: \"f5c52a0b-3e52-47d5-a8ab-934c2c353316\") " pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.337894 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.337807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.438948 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.438855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-config-volume\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.438948 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.438906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-tmp-dir\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.439459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.438972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhzkz\" (UniqueName: \"kubernetes.io/projected/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-kube-api-access-bhzkz\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.439459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.439035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5c52a0b-3e52-47d5-a8ab-934c2c353316-cert\") pod \"ingress-canary-2grtk\" (UID: \"f5c52a0b-3e52-47d5-a8ab-934c2c353316\") " pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.439459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.439075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmctf\" (UniqueName: \"kubernetes.io/projected/f5c52a0b-3e52-47d5-a8ab-934c2c353316-kube-api-access-nmctf\") pod \"ingress-canary-2grtk\" (UID: \"f5c52a0b-3e52-47d5-a8ab-934c2c353316\") " pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.439459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.439117    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.439459 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:52.439240    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:52.439459 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:52.439292    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:03:52.939273863 +0000 UTC m=+35.654427638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:52.439749 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.439508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-tmp-dir\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.439749 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.439605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-config-volume\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.444168 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.444118    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5c52a0b-3e52-47d5-a8ab-934c2c353316-cert\") pod \"ingress-canary-2grtk\" (UID: \"f5c52a0b-3e52-47d5-a8ab-934c2c353316\") " pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.451037 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.451013    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmctf\" (UniqueName: \"kubernetes.io/projected/f5c52a0b-3e52-47d5-a8ab-934c2c353316-kube-api-access-nmctf\") pod \"ingress-canary-2grtk\" (UID: \"f5c52a0b-3e52-47d5-a8ab-934c2c353316\") " pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.451371 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.451340    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhzkz\" (UniqueName: \"kubernetes.io/projected/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-kube-api-access-bhzkz\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.510507 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.510472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2grtk"
Jul 24 17:03:52.942650 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:52.942623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:52.942824 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:52.942796    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:52.942879 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:52.942873    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:03:53.942853979 +0000 UTC m=+36.658007759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:53.241242 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.241213    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2grtk"]
Jul 24 17:03:53.245255 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:03:53.245224    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c52a0b_3e52_47d5_a8ab_934c2c353316.slice/crio-4945b72c40065a3b2dfddea5bc37fbc21d189bfe03ce73c3c3be21cbd3cbc44c WatchSource:0}: Error finding container 4945b72c40065a3b2dfddea5bc37fbc21d189bfe03ce73c3c3be21cbd3cbc44c: Status 404 returned error can't find the container with id 4945b72c40065a3b2dfddea5bc37fbc21d189bfe03ce73c3c3be21cbd3cbc44c
Jul 24 17:03:53.902837 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.902804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:03:53.902837 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.902826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:03:53.903347 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.902804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:03:53.906450 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.906426    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:03:53.906580 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.906447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgbn9\""
Jul 24 17:03:53.906580 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.906494    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:03:53.906580 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.906447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2xn4k\""
Jul 24 17:03:53.906729 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.906666    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:03:53.906774 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.906757    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:03:53.950556 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:53.950519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:53.950768 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:53.950690    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:53.950814 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:53.950784    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:03:55.950761873 +0000 UTC m=+38.665915655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:54.055522 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:54.055485    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2grtk" event={"ID":"f5c52a0b-3e52-47d5-a8ab-934c2c353316","Type":"ContainerStarted","Data":"4945b72c40065a3b2dfddea5bc37fbc21d189bfe03ce73c3c3be21cbd3cbc44c"}
Jul 24 17:03:54.058746 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:54.058699    2568 generic.go:356] "Generic (PLEG): container finished" podID="b8d3657f-5c99-4011-8563-18a00a438252" containerID="a5a96a76c4688bfbb730b7ccfd89b92d726e4285960b874b7d64b01f080163f3" exitCode=0
Jul 24 17:03:54.058905 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:54.058752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerDied","Data":"a5a96a76c4688bfbb730b7ccfd89b92d726e4285960b874b7d64b01f080163f3"}
Jul 24 17:03:55.065772 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:55.065482    2568 generic.go:356] "Generic (PLEG): container finished" podID="b8d3657f-5c99-4011-8563-18a00a438252" containerID="2d94543e637fa4058cddc1111105185ebe1c3740cb9b01bcfcbbc6dc7e7013ca" exitCode=0
Jul 24 17:03:55.065772 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:55.065563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerDied","Data":"2d94543e637fa4058cddc1111105185ebe1c3740cb9b01bcfcbbc6dc7e7013ca"}
Jul 24 17:03:55.968807 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:55.968702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:55.968961 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:55.968858    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:55.968961 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:55.968928    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:03:59.968911949 +0000 UTC m=+42.684065714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:03:56.072246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:56.072205    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2grtk" event={"ID":"f5c52a0b-3e52-47d5-a8ab-934c2c353316","Type":"ContainerStarted","Data":"75ee133f5cb27ec6dc7858edaa5f0d9abeb4f371e4681d2f479f4447b98e176e"}
Jul 24 17:03:56.075483 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:56.075440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zshxz" event={"ID":"b8d3657f-5c99-4011-8563-18a00a438252","Type":"ContainerStarted","Data":"64cd254834384b503177c8e97f3f8949da9e6f615990ce1e71f0b6c3da7a0800"}
Jul 24 17:03:56.087616 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:56.087574    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2grtk" podStartSLOduration=1.7251939379999999 podStartE2EDuration="4.08755972s" totalImagesPullingTime="2.362365782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:56.087117481 +0000 UTC m=+38.802271267" watchObservedRunningTime="2026-07-24 17:03:56.08755972 +0000 UTC m=+38.802713506"
Jul 24 17:03:56.110395 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:56.110345    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zshxz" podStartSLOduration=10.618280347 podStartE2EDuration="39.110328151s" totalImagesPullingTime="28.492047804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:03:56.109165746 +0000 UTC m=+38.824319531" watchObservedRunningTime="2026-07-24 17:03:56.110328151 +0000 UTC m=+38.825481936"
Jul 24 17:03:59.997073 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:03:59.997036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:03:59.997460 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:59.997168    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:03:59.997460 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:03:59.997224    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:04:07.997208474 +0000 UTC m=+50.712362239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:04:08.053657 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:08.053611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:04:08.054137 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:08.053747    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:04:08.054137 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:08.053808    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:04:24.053793972 +0000 UTC m=+66.768947736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:04:18.048638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.048604    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bwkhv"
Jul 24 17:04:18.200174 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.200145    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"]
Jul 24 17:04:18.202627 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.202605    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.206586 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.206565    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 17:04:18.207066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.207052    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-s4r8z\""
Jul 24 17:04:18.207370 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.207355    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 17:04:18.207417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.207356    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 17:04:18.212532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.212511    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 17:04:18.218299 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.218273    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"]
Jul 24 17:04:18.330269 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.330168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8t92\" (UniqueName: \"kubernetes.io/projected/d0061a57-df11-4f2b-8da7-a940b8c42802-kube-api-access-s8t92\") pod \"managed-serviceaccount-addon-agent-5bb85b998-nktx9\" (UID: \"d0061a57-df11-4f2b-8da7-a940b8c42802\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.330269 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.330221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0061a57-df11-4f2b-8da7-a940b8c42802-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bb85b998-nktx9\" (UID: \"d0061a57-df11-4f2b-8da7-a940b8c42802\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.431041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.431007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8t92\" (UniqueName: \"kubernetes.io/projected/d0061a57-df11-4f2b-8da7-a940b8c42802-kube-api-access-s8t92\") pod \"managed-serviceaccount-addon-agent-5bb85b998-nktx9\" (UID: \"d0061a57-df11-4f2b-8da7-a940b8c42802\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.431168 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.431045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0061a57-df11-4f2b-8da7-a940b8c42802-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bb85b998-nktx9\" (UID: \"d0061a57-df11-4f2b-8da7-a940b8c42802\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.434741 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.434696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0061a57-df11-4f2b-8da7-a940b8c42802-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bb85b998-nktx9\" (UID: \"d0061a57-df11-4f2b-8da7-a940b8c42802\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.438937 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.438904    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8t92\" (UniqueName: \"kubernetes.io/projected/d0061a57-df11-4f2b-8da7-a940b8c42802-kube-api-access-s8t92\") pod \"managed-serviceaccount-addon-agent-5bb85b998-nktx9\" (UID: \"d0061a57-df11-4f2b-8da7-a940b8c42802\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.523474 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.523420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"
Jul 24 17:04:18.642533 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:18.642505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9"]
Jul 24 17:04:18.646207 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:04:18.646184    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0061a57_df11_4f2b_8da7_a940b8c42802.slice/crio-154f26b11c505db97f8c43097781a23373abd4181f188aa4bcda98b5ad1834d9 WatchSource:0}: Error finding container 154f26b11c505db97f8c43097781a23373abd4181f188aa4bcda98b5ad1834d9: Status 404 returned error can't find the container with id 154f26b11c505db97f8c43097781a23373abd4181f188aa4bcda98b5ad1834d9
Jul 24 17:04:19.129178 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:19.129143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9" event={"ID":"d0061a57-df11-4f2b-8da7-a940b8c42802","Type":"ContainerStarted","Data":"154f26b11c505db97f8c43097781a23373abd4181f188aa4bcda98b5ad1834d9"}
Jul 24 17:04:22.137648 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:22.137600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9" event={"ID":"d0061a57-df11-4f2b-8da7-a940b8c42802","Type":"ContainerStarted","Data":"cbb9f2db1e321df6279f3b5010274b53a196c41ccb29f15dfc4ebb0c2ac90c02"}
Jul 24 17:04:22.153072 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:22.153023    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9" podStartSLOduration=1.692951496 podStartE2EDuration="4.153007942s" totalImagesPullingTime="2.460056446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:22.152449684 +0000 UTC m=+64.867603472" watchObservedRunningTime="2026-07-24 17:04:22.153007942 +0000 UTC m=+64.868161728"
Jul 24 17:04:23.466414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.466373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:04:23.466414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.466415    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:04:23.466911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.466479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:04:23.469170 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.469153    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:04:23.469228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.469190    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:04:23.469265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.469249    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:04:23.477222 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:23.477197    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:04:23.477358 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:23.477288    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:05:27.477264491 +0000 UTC m=+130.192418272 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : secret "metrics-daemon-secret" not found
Jul 24 17:04:23.479348 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.479328    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:04:23.479400 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.479355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fafc04bd-803f-4aed-93e5-a0a54bd0407e-original-pull-secret\") pod \"global-pull-secret-syncer-89hrh\" (UID: \"fafc04bd-803f-4aed-93e5-a0a54bd0407e\") " pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:04:23.490532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.490503    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m4nk\" (UniqueName: \"kubernetes.io/projected/3e720ec3-90e7-4c9b-aad3-d0e79047cc6c-kube-api-access-2m4nk\") pod \"network-check-target-xkrj8\" (UID: \"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c\") " pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:04:23.615281 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.615241    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89hrh"
Jul 24 17:04:23.629998 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.629969    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2xn4k\""
Jul 24 17:04:23.637769 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.637743    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:04:23.794206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.794173    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89hrh"]
Jul 24 17:04:23.797574 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:04:23.797542    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafc04bd_803f_4aed_93e5_a0a54bd0407e.slice/crio-613565e075f025b2da0ee7df68bb42dff77f084becd00d904535159a573028a2 WatchSource:0}: Error finding container 613565e075f025b2da0ee7df68bb42dff77f084becd00d904535159a573028a2: Status 404 returned error can't find the container with id 613565e075f025b2da0ee7df68bb42dff77f084becd00d904535159a573028a2
Jul 24 17:04:23.816527 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:23.816497    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xkrj8"]
Jul 24 17:04:23.819506 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:04:23.819475    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e720ec3_90e7_4c9b_aad3_d0e79047cc6c.slice/crio-dd3b1c1145d0dcc344e030b6b2dd8df5a080f8e70e6a07f174d2f4e3702c2f15 WatchSource:0}: Error finding container dd3b1c1145d0dcc344e030b6b2dd8df5a080f8e70e6a07f174d2f4e3702c2f15: Status 404 returned error can't find the container with id dd3b1c1145d0dcc344e030b6b2dd8df5a080f8e70e6a07f174d2f4e3702c2f15
Jul 24 17:04:24.070523 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:24.070430    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:04:24.070667 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:24.070587    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:04:24.070667 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:24.070648    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:04:56.070629844 +0000 UTC m=+98.785783618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:04:24.142426 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:24.142394    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xkrj8" event={"ID":"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c","Type":"ContainerStarted","Data":"dd3b1c1145d0dcc344e030b6b2dd8df5a080f8e70e6a07f174d2f4e3702c2f15"}
Jul 24 17:04:24.143466 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:24.143444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89hrh" event={"ID":"fafc04bd-803f-4aed-93e5-a0a54bd0407e","Type":"ContainerStarted","Data":"613565e075f025b2da0ee7df68bb42dff77f084becd00d904535159a573028a2"}
Jul 24 17:04:29.159725 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:29.159673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xkrj8" event={"ID":"3e720ec3-90e7-4c9b-aad3-d0e79047cc6c","Type":"ContainerStarted","Data":"06726999707a05c2b23e37d47497227753d9eba9a28ca279c21359a5ddd52066"}
Jul 24 17:04:29.160183 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:29.159790    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:04:29.161153 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:29.161130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89hrh" event={"ID":"fafc04bd-803f-4aed-93e5-a0a54bd0407e","Type":"ContainerStarted","Data":"b22ab8012058dcca2c54be959b9143a3cbaa2ac51ef30bd4c622c0e7951667f2"}
Jul 24 17:04:29.176107 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:29.176058    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xkrj8" podStartSLOduration=67.722300387 podStartE2EDuration="1m12.17604352s" totalImagesPullingTime="4.453743133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:29.175387545 +0000 UTC m=+71.890541331" watchObservedRunningTime="2026-07-24 17:04:29.17604352 +0000 UTC m=+71.891197284"
Jul 24 17:04:29.190282 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:29.190212    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-89hrh" podStartSLOduration=66.710991583 podStartE2EDuration="1m11.190185611s" totalImagesPullingTime="4.479194028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:04:29.189692169 +0000 UTC m=+71.904845954" watchObservedRunningTime="2026-07-24 17:04:29.190185611 +0000 UTC m=+71.905339398"
Jul 24 17:04:56.167981 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:04:56.167946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:04:56.168423 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:56.168093    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:04:56.168423 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:04:56.168188    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:06:00.168172794 +0000 UTC m=+162.883326558 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:05:00.165467 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:05:00.165430    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xkrj8"
Jul 24 17:05:27.564058 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:05:27.564017    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:05:27.564543 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:05:27.564134    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:05:27.564543 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:05:27.564211    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:07:29.564196131 +0000 UTC m=+252.279349894 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : secret "metrics-daemon-secret" not found
Jul 24 17:05:55.202874 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:05:55.202824    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zj2fs" podUID="9d2e535b-c7ea-49fb-8a57-1dc047fffd4f"
Jul 24 17:05:55.362225 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:05:55.362197    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:05:56.922313 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:05:56.922273    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:06:00.186779 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:06:00.186729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:06:00.187405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:06:00.186882    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:06:00.187405 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:06:00.186980    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls podName:9d2e535b-c7ea-49fb-8a57-1dc047fffd4f nodeName:}" failed. No retries permitted until 2026-07-24 17:08:02.186958882 +0000 UTC m=+284.902112663 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls") pod "dns-default-zj2fs" (UID: "9d2e535b-c7ea-49fb-8a57-1dc047fffd4f") : secret "dns-default-metrics-tls" not found
Jul 24 17:06:08.899320 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:06:08.899228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:06:21.422478 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:06:21.422442    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0061a57-df11-4f2b-8da7-a940b8c42802" containerID="cbb9f2db1e321df6279f3b5010274b53a196c41ccb29f15dfc4ebb0c2ac90c02" exitCode=255
Jul 24 17:06:21.422966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:06:21.422522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9" event={"ID":"d0061a57-df11-4f2b-8da7-a940b8c42802","Type":"ContainerDied","Data":"cbb9f2db1e321df6279f3b5010274b53a196c41ccb29f15dfc4ebb0c2ac90c02"}
Jul 24 17:06:21.428432 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:06:21.428417    2568 scope.go:117] "RemoveContainer" containerID="cbb9f2db1e321df6279f3b5010274b53a196c41ccb29f15dfc4ebb0c2ac90c02"
Jul 24 17:06:22.427554 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:06:22.427520    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bb85b998-nktx9" event={"ID":"d0061a57-df11-4f2b-8da7-a940b8c42802","Type":"ContainerStarted","Data":"d96df54bee7ff2b6ba03418ef2793eb36a9b84abe565c3e0ceb1ba307d95c42f"}
Jul 24 17:07:15.175101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.175065    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"]
Jul 24 17:07:15.176812 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.176787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.193906 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.193884    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 17:07:15.194030 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.193965    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 17:07:15.194304 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.194284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74wxh\" (UniqueName: \"kubernetes.io/projected/4b96a049-5c8a-4ebf-8894-2a55d7391acf-kube-api-access-74wxh\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.194341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.194320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b96a049-5c8a-4ebf-8894-2a55d7391acf-config\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.194398 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.194338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b96a049-5c8a-4ebf-8894-2a55d7391acf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.194803 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.194786    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.194903 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.194786    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vgdmd\""
Jul 24 17:07:15.194988 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.194974    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.201089 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.201062    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"]
Jul 24 17:07:15.202917 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.202894    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"]
Jul 24 17:07:15.203039 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.203022    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.204633 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.204617    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"]
Jul 24 17:07:15.204758 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.204743    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.206243 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.206221    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"]
Jul 24 17:07:15.206340 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.206291    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"
Jul 24 17:07:15.208848 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.208827    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.208963 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.208852    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2zcvv\""
Jul 24 17:07:15.208963 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.208878    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 17:07:15.208963 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.208838    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.210824 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.210804    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.211979 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.211962    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.212087 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.211992    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bj87c\""
Jul 24 17:07:15.212087 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.212017    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 17:07:15.218826 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.218796    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.219386 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.219367    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bzwql\""
Jul 24 17:07:15.219820 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.219806    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b44f658b-nd6cg"]
Jul 24 17:07:15.220584 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.220567    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.221626 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.221526    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.225289 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.225275    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 17:07:15.233684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.233669    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 17:07:15.233782 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.233710    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pst72\""
Jul 24 17:07:15.234372 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.234339    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 17:07:15.235027 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.235011    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 17:07:15.235911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.235893    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"]
Jul 24 17:07:15.240376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.240358    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 17:07:15.244122 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.244095    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"]
Jul 24 17:07:15.250263 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.250241    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"]
Jul 24 17:07:15.269064 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.269031    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b44f658b-nd6cg"]
Jul 24 17:07:15.295222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74wxh\" (UniqueName: \"kubernetes.io/projected/4b96a049-5c8a-4ebf-8894-2a55d7391acf-kube-api-access-74wxh\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.295222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-trusted-ca\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295269    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b96a049-5c8a-4ebf-8894-2a55d7391acf-config\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.295462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-image-registry-private-configuration\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh8p6\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-kube-api-access-dh8p6\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b96a049-5c8a-4ebf-8894-2a55d7391acf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.295462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295399    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l44d4\" (UniqueName: \"kubernetes.io/projected/fa384732-3787-4bd9-b0e3-e17e45d960e6-kube-api-access-l44d4\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295485    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-installation-pull-secrets\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-ca-trust-extracted\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a53f4531-7c23-4e5a-8dfd-688c73b21926-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295598    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twds\" (UniqueName: \"kubernetes.io/projected/9e64a2e2-dd0b-438b-9943-bb93d9df62e3-kube-api-access-5twds\") pod \"volume-data-source-validator-549c6d54cf-gn7nm\" (UID: \"9e64a2e2-dd0b-438b-9943-bb93d9df62e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-certificates\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-bound-sa-token\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.295770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp4n9\" (UniqueName: \"kubernetes.io/projected/a53f4531-7c23-4e5a-8dfd-688c73b21926-kube-api-access-qp4n9\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.296041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.296041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.295956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b96a049-5c8a-4ebf-8894-2a55d7391acf-config\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.297837 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.297815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b96a049-5c8a-4ebf-8894-2a55d7391acf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.297997 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.297982    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h4ftz"]
Jul 24 17:07:15.299960 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.299942    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.318776 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.318746    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-j7k57\""
Jul 24 17:07:15.318915 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.318832    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 17:07:15.318915 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.318895    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:07:15.318915 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.318913    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:07:15.319070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.318838    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 17:07:15.321021 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.321003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74wxh\" (UniqueName: \"kubernetes.io/projected/4b96a049-5c8a-4ebf-8894-2a55d7391acf-kube-api-access-74wxh\") pod \"service-ca-operator-5d6c75f84f-2ffdw\" (UID: \"4b96a049-5c8a-4ebf-8894-2a55d7391acf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.330178 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.330149    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 17:07:15.335109 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.335084    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h4ftz"]
Jul 24 17:07:15.395996 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.395961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-trusted-ca\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.395996 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.395995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-installation-pull-secrets\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.396261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh8p6\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-kube-api-access-dh8p6\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.396261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l44d4\" (UniqueName: \"kubernetes.io/projected/fa384732-3787-4bd9-b0e3-e17e45d960e6-kube-api-access-l44d4\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.396261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e81dffed-6bda-49da-878c-ac256e5c437e-snapshots\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.396261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a53f4531-7c23-4e5a-8dfd-688c73b21926-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.396261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396176    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-bound-sa-token\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.396261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-image-registry-private-configuration\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.396702 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-ca-trust-extracted\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.396847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396677    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e81dffed-6bda-49da-878c-ac256e5c437e-tmp\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.396847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81dffed-6bda-49da-878c-ac256e5c437e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.396955 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5twds\" (UniqueName: \"kubernetes.io/projected/9e64a2e2-dd0b-438b-9943-bb93d9df62e3-kube-api-access-5twds\") pod \"volume-data-source-validator-549c6d54cf-gn7nm\" (UID: \"9e64a2e2-dd0b-438b-9943-bb93d9df62e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"
Jul 24 17:07:15.396955 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-certificates\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.397057 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.396978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81dffed-6bda-49da-878c-ac256e5c437e-service-ca-bundle\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.397057 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.397411 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397384    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-ca-trust-extracted\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.397537 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp4n9\" (UniqueName: \"kubernetes.io/projected/a53f4531-7c23-4e5a-8dfd-688c73b21926-kube-api-access-qp4n9\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.397604 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.397681 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.397750 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njn8t\" (UniqueName: \"kubernetes.io/projected/e81dffed-6bda-49da-878c-ac256e5c437e-kube-api-access-njn8t\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.397858 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.397841    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:07:15.397920 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.397764    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81dffed-6bda-49da-878c-ac256e5c437e-serving-cert\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.398419 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.398399    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:15.398497 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.398424    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls podName:fa384732-3787-4bd9-b0e3-e17e45d960e6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:15.898402144 +0000 UTC m=+238.613555921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls") pod "cluster-samples-operator-6748489656-lqjkn" (UID: "fa384732-3787-4bd9-b0e3-e17e45d960e6") : secret "samples-operator-tls" not found
Jul 24 17:07:15.398749 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.398706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a53f4531-7c23-4e5a-8dfd-688c73b21926-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.398879 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.398864    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:07:15.398940 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.398883    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b44f658b-nd6cg: secret "image-registry-tls" not found
Jul 24 17:07:15.399003 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.398950    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls podName:9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:15.898932784 +0000 UTC m=+238.614086555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls") pod "image-registry-68b44f658b-nd6cg" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1") : secret "image-registry-tls" not found
Jul 24 17:07:15.399252 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.399229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-certificates\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.399325 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.399240    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls podName:a53f4531-7c23-4e5a-8dfd-688c73b21926 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:15.899219841 +0000 UTC m=+238.614373610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-r5wvh" (UID: "a53f4531-7c23-4e5a-8dfd-688c73b21926") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:15.399391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.399332    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-installation-pull-secrets\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.401708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.399614    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-trusted-ca\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.401708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.399697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-image-registry-private-configuration\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.411970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.411939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l44d4\" (UniqueName: \"kubernetes.io/projected/fa384732-3787-4bd9-b0e3-e17e45d960e6-kube-api-access-l44d4\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.412965 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.412940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-bound-sa-token\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.413102 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.413017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh8p6\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-kube-api-access-dh8p6\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.415052 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.415028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp4n9\" (UniqueName: \"kubernetes.io/projected/a53f4531-7c23-4e5a-8dfd-688c73b21926-kube-api-access-qp4n9\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.422021 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.421997    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twds\" (UniqueName: \"kubernetes.io/projected/9e64a2e2-dd0b-438b-9943-bb93d9df62e3-kube-api-access-5twds\") pod \"volume-data-source-validator-549c6d54cf-gn7nm\" (UID: \"9e64a2e2-dd0b-438b-9943-bb93d9df62e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"
Jul 24 17:07:15.485563 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.485475    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"
Jul 24 17:07:15.498447 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498415    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e81dffed-6bda-49da-878c-ac256e5c437e-tmp\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.498579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81dffed-6bda-49da-878c-ac256e5c437e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.498579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81dffed-6bda-49da-878c-ac256e5c437e-service-ca-bundle\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.498579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njn8t\" (UniqueName: \"kubernetes.io/projected/e81dffed-6bda-49da-878c-ac256e5c437e-kube-api-access-njn8t\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.498579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81dffed-6bda-49da-878c-ac256e5c437e-serving-cert\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.498800 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e81dffed-6bda-49da-878c-ac256e5c437e-snapshots\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.498861 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.498838    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e81dffed-6bda-49da-878c-ac256e5c437e-tmp\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.499145 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.499121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81dffed-6bda-49da-878c-ac256e5c437e-service-ca-bundle\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.499236 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.499183    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e81dffed-6bda-49da-878c-ac256e5c437e-snapshots\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.499508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.499486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81dffed-6bda-49da-878c-ac256e5c437e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.501007 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.500985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e81dffed-6bda-49da-878c-ac256e5c437e-serving-cert\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.512995 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.512968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njn8t\" (UniqueName: \"kubernetes.io/projected/e81dffed-6bda-49da-878c-ac256e5c437e-kube-api-access-njn8t\") pod \"insights-operator-5885fdb759-h4ftz\" (UID: \"e81dffed-6bda-49da-878c-ac256e5c437e\") " pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.523905 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.523874    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"
Jul 24 17:07:15.610352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.610321    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-h4ftz"
Jul 24 17:07:15.626482 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.626454    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw"]
Jul 24 17:07:15.629931 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:15.629897    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b96a049_5c8a_4ebf_8894_2a55d7391acf.slice/crio-c33d49eab97d925d52878feb4df144f480a14a86b347ffe3080bf6fd4b708943 WatchSource:0}: Error finding container c33d49eab97d925d52878feb4df144f480a14a86b347ffe3080bf6fd4b708943: Status 404 returned error can't find the container with id c33d49eab97d925d52878feb4df144f480a14a86b347ffe3080bf6fd4b708943
Jul 24 17:07:15.667676 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.667603    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm"]
Jul 24 17:07:15.671367 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:15.671334    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e64a2e2_dd0b_438b_9943_bb93d9df62e3.slice/crio-ebce8885572ccbe8e4e7a12346a65f56c206453598e91977d16391c245d28206 WatchSource:0}: Error finding container ebce8885572ccbe8e4e7a12346a65f56c206453598e91977d16391c245d28206: Status 404 returned error can't find the container with id ebce8885572ccbe8e4e7a12346a65f56c206453598e91977d16391c245d28206
Jul 24 17:07:15.750514 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.750432    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-h4ftz"]
Jul 24 17:07:15.754087 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:15.754059    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81dffed_6bda_49da_878c_ac256e5c437e.slice/crio-b0c3a129a5d0f0cbd0bf476549967da0805aa597bc2885047c1a77fb05768583 WatchSource:0}: Error finding container b0c3a129a5d0f0cbd0bf476549967da0805aa597bc2885047c1a77fb05768583: Status 404 returned error can't find the container with id b0c3a129a5d0f0cbd0bf476549967da0805aa597bc2885047c1a77fb05768583
Jul 24 17:07:15.901991 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.901960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:15.902172 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.902006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:15.902172 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:15.902040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:15.902172 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902100    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:07:15.902172 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902154    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls podName:fa384732-3787-4bd9-b0e3-e17e45d960e6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:16.902140027 +0000 UTC m=+239.617293794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls") pod "cluster-samples-operator-6748489656-lqjkn" (UID: "fa384732-3787-4bd9-b0e3-e17e45d960e6") : secret "samples-operator-tls" not found
Jul 24 17:07:15.902372 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902209    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:15.902372 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902258    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls podName:a53f4531-7c23-4e5a-8dfd-688c73b21926 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:16.902242303 +0000 UTC m=+239.617396072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-r5wvh" (UID: "a53f4531-7c23-4e5a-8dfd-688c73b21926") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:15.902372 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902315    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:07:15.902372 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902335    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b44f658b-nd6cg: secret "image-registry-tls" not found
Jul 24 17:07:15.902513 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:15.902401    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls podName:9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:16.902385931 +0000 UTC m=+239.617539714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls") pod "image-registry-68b44f658b-nd6cg" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1") : secret "image-registry-tls" not found
Jul 24 17:07:16.576779 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:16.576671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h4ftz" event={"ID":"e81dffed-6bda-49da-878c-ac256e5c437e","Type":"ContainerStarted","Data":"b0c3a129a5d0f0cbd0bf476549967da0805aa597bc2885047c1a77fb05768583"}
Jul 24 17:07:16.578659 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:16.578604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw" event={"ID":"4b96a049-5c8a-4ebf-8894-2a55d7391acf","Type":"ContainerStarted","Data":"c33d49eab97d925d52878feb4df144f480a14a86b347ffe3080bf6fd4b708943"}
Jul 24 17:07:16.580059 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:16.580033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm" event={"ID":"9e64a2e2-dd0b-438b-9943-bb93d9df62e3","Type":"ContainerStarted","Data":"ebce8885572ccbe8e4e7a12346a65f56c206453598e91977d16391c245d28206"}
Jul 24 17:07:16.911515 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:16.911469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:16.911731 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:16.911531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:16.911731 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:16.911565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:16.911731 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911641    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:07:16.911731 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911700    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:16.911731 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911733    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls podName:fa384732-3787-4bd9-b0e3-e17e45d960e6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:18.911696702 +0000 UTC m=+241.626850469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls") pod "cluster-samples-operator-6748489656-lqjkn" (UID: "fa384732-3787-4bd9-b0e3-e17e45d960e6") : secret "samples-operator-tls" not found
Jul 24 17:07:16.912021 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911743    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:07:16.912021 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911758    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls podName:a53f4531-7c23-4e5a-8dfd-688c73b21926 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:18.911747761 +0000 UTC m=+241.626901532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-r5wvh" (UID: "a53f4531-7c23-4e5a-8dfd-688c73b21926") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:16.912021 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911759    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b44f658b-nd6cg: secret "image-registry-tls" not found
Jul 24 17:07:16.912021 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:16.911792    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls podName:9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:18.911783858 +0000 UTC m=+241.626937623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls") pod "image-registry-68b44f658b-nd6cg" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1") : secret "image-registry-tls" not found
Jul 24 17:07:17.584836 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:17.584753    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm" event={"ID":"9e64a2e2-dd0b-438b-9943-bb93d9df62e3","Type":"ContainerStarted","Data":"ac17824ca5396e81500f9b009065b17187d60e199cf72d20637d45723b2ddc3c"}
Jul 24 17:07:17.600261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:17.600209    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-gn7nm" podStartSLOduration=1.050348852 podStartE2EDuration="2.600191996s" totalImagesPullingTime="1.549843144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:17.600043375 +0000 UTC m=+240.315197186" watchObservedRunningTime="2026-07-24 17:07:17.600191996 +0000 UTC m=+240.315345783"
Jul 24 17:07:18.589550 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.589449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h4ftz" event={"ID":"e81dffed-6bda-49da-878c-ac256e5c437e","Type":"ContainerStarted","Data":"121ec339d05942e767772fe0e4d25f7653f0dad51eb3546380a313392920c944"}
Jul 24 17:07:18.591024 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.590998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw" event={"ID":"4b96a049-5c8a-4ebf-8894-2a55d7391acf","Type":"ContainerStarted","Data":"55dfcdbe81cdb3bd59034613846bfd6e74c476001d898f719392599416e15112"}
Jul 24 17:07:18.606332 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.606280    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-h4ftz" podStartSLOduration=1.051049522 podStartE2EDuration="3.606264691s" totalImagesPullingTime="2.555215169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:18.605337166 +0000 UTC m=+241.320490951" watchObservedRunningTime="2026-07-24 17:07:18.606264691 +0000 UTC m=+241.321418477"
Jul 24 17:07:18.620348 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.620289    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw" podStartSLOduration=0.942510494 podStartE2EDuration="3.620269533s" totalImagesPullingTime="2.677759039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:18.620230743 +0000 UTC m=+241.335384530" watchObservedRunningTime="2026-07-24 17:07:18.620269533 +0000 UTC m=+241.335423320"
Jul 24 17:07:18.927890 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.927848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.927896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:18.927915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928008    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928021    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928050    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928062    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b44f658b-nd6cg: secret "image-registry-tls" not found
Jul 24 17:07:18.928090 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928091    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls podName:a53f4531-7c23-4e5a-8dfd-688c73b21926 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:22.928072169 +0000 UTC m=+245.643225939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-r5wvh" (UID: "a53f4531-7c23-4e5a-8dfd-688c73b21926") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:18.928428 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928108    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls podName:9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:22.928100294 +0000 UTC m=+245.643254063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls") pod "image-registry-68b44f658b-nd6cg" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1") : secret "image-registry-tls" not found
Jul 24 17:07:18.928428 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:18.928120    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls podName:fa384732-3787-4bd9-b0e3-e17e45d960e6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:22.928114863 +0000 UTC m=+245.643268627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls") pod "cluster-samples-operator-6748489656-lqjkn" (UID: "fa384732-3787-4bd9-b0e3-e17e45d960e6") : secret "samples-operator-tls" not found
Jul 24 17:07:19.378577 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.378489    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pdfhf"]
Jul 24 17:07:19.380751 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.380734    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.383296 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.383265    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:07:19.383296 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.383276    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2qh5k\""
Jul 24 17:07:19.383474 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.383334    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:07:19.398687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.398664    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdfhf"]
Jul 24 17:07:19.431785 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.431729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.431962 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.431851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.431962 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.431924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8hr9\" (UniqueName: \"kubernetes.io/projected/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-api-access-c8hr9\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.432070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.431967    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/136f67ed-9779-4ebf-aa28-585f5278a1a6-data-volume\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.432070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.432042    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/136f67ed-9779-4ebf-aa28-585f5278a1a6-crio-socket\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533133 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533143    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8hr9\" (UniqueName: \"kubernetes.io/projected/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-api-access-c8hr9\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/136f67ed-9779-4ebf-aa28-585f5278a1a6-data-volume\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533308 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:19.533250    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:19.533308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/136f67ed-9779-4ebf-aa28-585f5278a1a6-crio-socket\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533502 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:19.533320    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:20.03329936 +0000 UTC m=+242.748453125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:19.533502 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533502 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/136f67ed-9779-4ebf-aa28-585f5278a1a6-crio-socket\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.533502 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:19.533469    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:19.533691 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:19.533517    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:20.033503796 +0000 UTC m=+242.748657561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:19.533691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.533595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/136f67ed-9779-4ebf-aa28-585f5278a1a6-data-volume\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:19.541696 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:19.541675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8hr9\" (UniqueName: \"kubernetes.io/projected/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-api-access-c8hr9\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:20.038640 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:20.038595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:20.039122 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:20.038661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:20.039122 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:20.038750    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:20.039122 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:20.038782    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:20.039122 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:20.038818    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:21.038799574 +0000 UTC m=+243.753953354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:20.039122 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:20.038834    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:21.038828355 +0000 UTC m=+243.753982122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:21.047514 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:21.047478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:21.048007 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:21.047542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:21.048007 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:21.047611    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:21.048007 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:21.047630    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:21.048007 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:21.047671    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:23.047656033 +0000 UTC m=+245.762809797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:21.048007 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:21.047684    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:23.047678226 +0000 UTC m=+245.762831989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:21.133689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:21.133661    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8jvkl_86eba38d-538f-4515-b955-a2f67d965f63/dns-node-resolver/0.log"
Jul 24 17:07:22.335106 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.335079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v6bq9_534760f6-ef14-456f-bd3b-798234068cf6/node-ca/0.log"
Jul 24 17:07:22.942799 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.942775    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2grtk_f5c52a0b-3e52-47d5-a8ab-934c2c353316/serve-healthcheck-canary/0.log"
Jul 24 17:07:22.958360 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.958322    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rtlrp"]
Jul 24 17:07:22.961645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.961621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:22.963799 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.963767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.963814    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.963778    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.963858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.963865    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.963920    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls podName:fa384732-3787-4bd9-b0e3-e17e45d960e6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:30.963903777 +0000 UTC m=+253.679057555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls") pod "cluster-samples-operator-6748489656-lqjkn" (UID: "fa384732-3787-4bd9-b0e3-e17e45d960e6") : secret "samples-operator-tls" not found
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.963915    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4q4fc\""
Jul 24 17:07:22.963938 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.963934    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 24 17:07:22.964222 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.963971    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 17:07:22.964222 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.963975    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:22.964222 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.963983    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b44f658b-nd6cg: secret "image-registry-tls" not found
Jul 24 17:07:22.964222 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.964019    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls podName:9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:30.964006802 +0000 UTC m=+253.679160588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls") pod "image-registry-68b44f658b-nd6cg" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1") : secret "image-registry-tls" not found
Jul 24 17:07:22.964222 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:22.964035    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls podName:a53f4531-7c23-4e5a-8dfd-688c73b21926 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:30.964026958 +0000 UTC m=+253.679180728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-r5wvh" (UID: "a53f4531-7c23-4e5a-8dfd-688c73b21926") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:22.964222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.964145    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 24 17:07:22.964514 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.964499    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 24 17:07:22.970299 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:22.970266    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rtlrp"]
Jul 24 17:07:23.064691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.064648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:23.064691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.064691    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ztt7\" (UniqueName: \"kubernetes.io/projected/a8be059c-4b9e-4606-9878-24e9c293a841-kube-api-access-4ztt7\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.064933 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.064787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:23.064933 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:23.064815    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:23.064933 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:23.064860    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:23.064933 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:23.064880    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:27.06486588 +0000 UTC m=+249.780019644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:23.064933 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.064893    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a8be059c-4b9e-4606-9878-24e9c293a841-signing-cabundle\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.064933 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:23.064916    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:27.06490316 +0000 UTC m=+249.780056924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:23.065153 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.064969    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a8be059c-4b9e-4606-9878-24e9c293a841-signing-key\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.165473 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.165441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a8be059c-4b9e-4606-9878-24e9c293a841-signing-key\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.165646 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.165496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ztt7\" (UniqueName: \"kubernetes.io/projected/a8be059c-4b9e-4606-9878-24e9c293a841-kube-api-access-4ztt7\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.165646 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.165560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a8be059c-4b9e-4606-9878-24e9c293a841-signing-cabundle\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.166157 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.166140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a8be059c-4b9e-4606-9878-24e9c293a841-signing-cabundle\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.167829 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.167810    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a8be059c-4b9e-4606-9878-24e9c293a841-signing-key\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.173697 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.173676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ztt7\" (UniqueName: \"kubernetes.io/projected/a8be059c-4b9e-4606-9878-24e9c293a841-kube-api-access-4ztt7\") pod \"service-ca-658d7b7c78-rtlrp\" (UID: \"a8be059c-4b9e-4606-9878-24e9c293a841\") " pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.272086 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.271999    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp"
Jul 24 17:07:23.394479 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.394447    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-rtlrp"]
Jul 24 17:07:23.397746 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:23.397693    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8be059c_4b9e_4606_9878_24e9c293a841.slice/crio-a209ca5ece7dbe386b5db6168b7879202d71a554b226eb1bc101aba42bf31e1d WatchSource:0}: Error finding container a209ca5ece7dbe386b5db6168b7879202d71a554b226eb1bc101aba42bf31e1d: Status 404 returned error can't find the container with id a209ca5ece7dbe386b5db6168b7879202d71a554b226eb1bc101aba42bf31e1d
Jul 24 17:07:23.608178 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.608096    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp" event={"ID":"a8be059c-4b9e-4606-9878-24e9c293a841","Type":"ContainerStarted","Data":"88edd133a5d63db3239b3b66100f510afd7331219d561a383f074bfbf02c26ef"}
Jul 24 17:07:23.608178 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.608147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp" event={"ID":"a8be059c-4b9e-4606-9878-24e9c293a841","Type":"ContainerStarted","Data":"a209ca5ece7dbe386b5db6168b7879202d71a554b226eb1bc101aba42bf31e1d"}
Jul 24 17:07:23.622826 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:23.622781    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-rtlrp" podStartSLOduration=1.622766766 podStartE2EDuration="1.622766766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:23.622197298 +0000 UTC m=+246.337351084" watchObservedRunningTime="2026-07-24 17:07:23.622766766 +0000 UTC m=+246.337920552"
Jul 24 17:07:27.098500 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:27.098462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:27.098943 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:27.098537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:27.098943 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:27.098583    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:07:27.098943 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:27.098660    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:35.098644247 +0000 UTC m=+257.813798012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : configmap "kube-rbac-proxy" not found
Jul 24 17:07:27.098943 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:27.098690    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:27.098943 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:27.098762    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls podName:136f67ed-9779-4ebf-aa28-585f5278a1a6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:35.09874951 +0000 UTC m=+257.813903274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdfhf" (UID: "136f67ed-9779-4ebf-aa28-585f5278a1a6") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:07:29.618149 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:29.618107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:07:29.618512 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:29.618265    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:07:29.618512 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:29.618334    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs podName:caf3a3bf-ed48-4a40-9585-5ebb8adac3af nodeName:}" failed. No retries permitted until 2026-07-24 17:09:31.618316724 +0000 UTC m=+374.333470489 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs") pod "network-metrics-daemon-276m8" (UID: "caf3a3bf-ed48-4a40-9585-5ebb8adac3af") : secret "metrics-daemon-secret" not found
Jul 24 17:07:31.031951 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.031908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:31.031951 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.031951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:31.032399 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.031969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:31.032399 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:31.032060    2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:31.032399 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:31.032125    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls podName:a53f4531-7c23-4e5a-8dfd-688c73b21926 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:47.032109275 +0000 UTC m=+269.747263041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-r5wvh" (UID: "a53f4531-7c23-4e5a-8dfd-688c73b21926") : secret "cluster-monitoring-operator-tls" not found
Jul 24 17:07:31.034316 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.034297    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"image-registry-68b44f658b-nd6cg\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") " pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:31.034382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.034312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa384732-3787-4bd9-b0e3-e17e45d960e6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lqjkn\" (UID: \"fa384732-3787-4bd9-b0e3-e17e45d960e6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:31.121205 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.121174    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2zcvv\""
Jul 24 17:07:31.130092 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.130063    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"
Jul 24 17:07:31.132022 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.132003    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pst72\""
Jul 24 17:07:31.141273 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.141168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:31.271703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.271669    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn"]
Jul 24 17:07:31.292096 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.292070    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b44f658b-nd6cg"]
Jul 24 17:07:31.294834 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:31.294806    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f52b8e2_2f51_45fd_8bc9_d0fdc99a2ae1.slice/crio-5bcead5980d38eff8b0b48418193c1fb99c39e5a221cbdf47ceced0a7c4e29d8 WatchSource:0}: Error finding container 5bcead5980d38eff8b0b48418193c1fb99c39e5a221cbdf47ceced0a7c4e29d8: Status 404 returned error can't find the container with id 5bcead5980d38eff8b0b48418193c1fb99c39e5a221cbdf47ceced0a7c4e29d8
Jul 24 17:07:31.634816 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.634728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" event={"ID":"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1","Type":"ContainerStarted","Data":"4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917"}
Jul 24 17:07:31.634988 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.634931    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:07:31.634988 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.634974    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" event={"ID":"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1","Type":"ContainerStarted","Data":"5bcead5980d38eff8b0b48418193c1fb99c39e5a221cbdf47ceced0a7c4e29d8"}
Jul 24 17:07:31.636134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.636109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn" event={"ID":"fa384732-3787-4bd9-b0e3-e17e45d960e6","Type":"ContainerStarted","Data":"57f6a455d11a9606a76e2d8c8375e1877a30846a0913a31cb9b51e0eb49789f6"}
Jul 24 17:07:31.657141 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:31.657090    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" podStartSLOduration=16.657074641 podStartE2EDuration="16.657074641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:31.65676298 +0000 UTC m=+254.371916766" watchObservedRunningTime="2026-07-24 17:07:31.657074641 +0000 UTC m=+254.372228427"
Jul 24 17:07:33.648678 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:33.648643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn" event={"ID":"fa384732-3787-4bd9-b0e3-e17e45d960e6","Type":"ContainerStarted","Data":"997c2109ad6788b1507fcdb76fe880e50539e565264f3d106f1e8c81140503f0"}
Jul 24 17:07:33.649160 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:33.648736    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn" event={"ID":"fa384732-3787-4bd9-b0e3-e17e45d960e6","Type":"ContainerStarted","Data":"8e6eb96a066737f764a7cee261577b4f1e9736bdcc9b3f599b92b3730dbe037a"}
Jul 24 17:07:33.666893 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:33.666843    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lqjkn" podStartSLOduration=16.665832841 podStartE2EDuration="18.666827621s" totalImagesPullingTime="2.00099478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:33.666801432 +0000 UTC m=+256.381955218" watchObservedRunningTime="2026-07-24 17:07:33.666827621 +0000 UTC m=+256.381981406"
Jul 24 17:07:35.172548 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.172507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:35.173054 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.172692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:35.173218 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.173200    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/136f67ed-9779-4ebf-aa28-585f5278a1a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:35.174863 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.174843    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/136f67ed-9779-4ebf-aa28-585f5278a1a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdfhf\" (UID: \"136f67ed-9779-4ebf-aa28-585f5278a1a6\") " pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:35.289632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.289587    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdfhf"
Jul 24 17:07:35.422949 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.422873    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdfhf"]
Jul 24 17:07:35.427448 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:35.427423    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136f67ed_9779_4ebf_aa28_585f5278a1a6.slice/crio-130d3e6412ff2b59143c3c3e5b55c518380a004d60e16789eaeee05d40536ed7 WatchSource:0}: Error finding container 130d3e6412ff2b59143c3c3e5b55c518380a004d60e16789eaeee05d40536ed7: Status 404 returned error can't find the container with id 130d3e6412ff2b59143c3c3e5b55c518380a004d60e16789eaeee05d40536ed7
Jul 24 17:07:35.655942 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:35.655908    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdfhf" event={"ID":"136f67ed-9779-4ebf-aa28-585f5278a1a6","Type":"ContainerStarted","Data":"130d3e6412ff2b59143c3c3e5b55c518380a004d60e16789eaeee05d40536ed7"}
Jul 24 17:07:40.678421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:40.678360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdfhf" event={"ID":"136f67ed-9779-4ebf-aa28-585f5278a1a6","Type":"ContainerStarted","Data":"f57fde93bf9498d118eece9b30cb6fb219404b77c45555b57edf9ec6fd5883ae"}
Jul 24 17:07:43.690505 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:43.690472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdfhf" event={"ID":"136f67ed-9779-4ebf-aa28-585f5278a1a6","Type":"ContainerStarted","Data":"982bd2045b46516b1ba2d3eaa2e3960c2b09f2a7fc25b9c709cbe2ca0a4a35c8"}
Jul 24 17:07:47.072776 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.072735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:47.075059 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.075031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53f4531-7c23-4e5a-8dfd-688c73b21926-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-r5wvh\" (UID: \"a53f4531-7c23-4e5a-8dfd-688c73b21926\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:47.129327 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.129298    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b44f658b-nd6cg"]
Jul 24 17:07:47.134708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.134676    2568 patch_prober.go:28] interesting pod/image-registry-68b44f658b-nd6cg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:07:47.134872 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.134739    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:07:47.230369 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.230333    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"]
Jul 24 17:07:47.233445 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.233427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.247226 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.247199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"]
Jul 24 17:07:47.314826 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.314792    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bj87c\""
Jul 24 17:07:47.323897 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.323824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"
Jul 24 17:07:47.375755 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.375708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9795cd-88f0-47f8-8706-77d9e280b978-trusted-ca\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.375883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.375778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-bound-sa-token\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.375883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.375836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9795cd-88f0-47f8-8706-77d9e280b978-installation-pull-secrets\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.375970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.375880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9795cd-88f0-47f8-8706-77d9e280b978-ca-trust-extracted\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.376020 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.375994    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9795cd-88f0-47f8-8706-77d9e280b978-registry-certificates\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.376068 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.376036    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4kt\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-kube-api-access-bn4kt\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.376161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.376144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9795cd-88f0-47f8-8706-77d9e280b978-image-registry-private-configuration\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.376200 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.376188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-registry-tls\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.453535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.453502    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh"]
Jul 24 17:07:47.457563 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:47.457536    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53f4531_7c23_4e5a_8dfd_688c73b21926.slice/crio-11b8acf48990e35c1f6f451f153107cb8f0c7c274e4a92d07bf8fb64588f6bf0 WatchSource:0}: Error finding container 11b8acf48990e35c1f6f451f153107cb8f0c7c274e4a92d07bf8fb64588f6bf0: Status 404 returned error can't find the container with id 11b8acf48990e35c1f6f451f153107cb8f0c7c274e4a92d07bf8fb64588f6bf0
Jul 24 17:07:47.477208 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9795cd-88f0-47f8-8706-77d9e280b978-ca-trust-extracted\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477316 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477222    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9795cd-88f0-47f8-8706-77d9e280b978-registry-certificates\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477371 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4kt\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-kube-api-access-bn4kt\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9795cd-88f0-47f8-8706-77d9e280b978-image-registry-private-configuration\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477512 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477463    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-registry-tls\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477571 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477551    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9795cd-88f0-47f8-8706-77d9e280b978-ca-trust-extracted\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477642 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9795cd-88f0-47f8-8706-77d9e280b978-trusted-ca\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-bound-sa-token\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.477791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.477768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9795cd-88f0-47f8-8706-77d9e280b978-installation-pull-secrets\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.478284 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.478241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9795cd-88f0-47f8-8706-77d9e280b978-registry-certificates\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.478491 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.478476    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9795cd-88f0-47f8-8706-77d9e280b978-trusted-ca\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.480038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.480017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9795cd-88f0-47f8-8706-77d9e280b978-installation-pull-secrets\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.480121 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.480027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-registry-tls\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.480197 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.480178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9795cd-88f0-47f8-8706-77d9e280b978-image-registry-private-configuration\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.486257 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.486233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4kt\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-kube-api-access-bn4kt\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.486324 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.486268    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9795cd-88f0-47f8-8706-77d9e280b978-bound-sa-token\") pod \"image-registry-7bb4f87d8f-xcgkq\" (UID: \"ae9795cd-88f0-47f8-8706-77d9e280b978\") " pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.542099 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.542067    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:47.681391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.681361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"]
Jul 24 17:07:47.684474 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:47.684442    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9795cd_88f0_47f8_8706_77d9e280b978.slice/crio-16d419d442e11e887a7c46247ffd346ecb5c383105e579dced86f189b4e0bd93 WatchSource:0}: Error finding container 16d419d442e11e887a7c46247ffd346ecb5c383105e579dced86f189b4e0bd93: Status 404 returned error can't find the container with id 16d419d442e11e887a7c46247ffd346ecb5c383105e579dced86f189b4e0bd93
Jul 24 17:07:47.706513 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.706489    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdfhf" event={"ID":"136f67ed-9779-4ebf-aa28-585f5278a1a6","Type":"ContainerStarted","Data":"0afe505bd20c8a1e11c3f32b3d6f371a712c062433fb3293bdf78179cc4a293f"}
Jul 24 17:07:47.707573 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.707549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh" event={"ID":"a53f4531-7c23-4e5a-8dfd-688c73b21926","Type":"ContainerStarted","Data":"11b8acf48990e35c1f6f451f153107cb8f0c7c274e4a92d07bf8fb64588f6bf0"}
Jul 24 17:07:47.708574 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.708554    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq" event={"ID":"ae9795cd-88f0-47f8-8706-77d9e280b978","Type":"ContainerStarted","Data":"16d419d442e11e887a7c46247ffd346ecb5c383105e579dced86f189b4e0bd93"}
Jul 24 17:07:47.723252 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:47.723210    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pdfhf" podStartSLOduration=17.180407767 podStartE2EDuration="28.723195463s" totalImagesPullingTime="11.542787696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:07:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:47.721849445 +0000 UTC m=+270.437003232" watchObservedRunningTime="2026-07-24 17:07:47.723195463 +0000 UTC m=+270.438349227"
Jul 24 17:07:48.714236 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:48.714198    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq" event={"ID":"ae9795cd-88f0-47f8-8706-77d9e280b978","Type":"ContainerStarted","Data":"f054630b559d8e9fa4df04fe3b3778b56d9be6bd8006d2415cf335521100095a"}
Jul 24 17:07:48.734293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:48.734225    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq" podStartSLOduration=1.7342039059999999 podStartE2EDuration="1.734203906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:48.733013119 +0000 UTC m=+271.448166928" watchObservedRunningTime="2026-07-24 17:07:48.734203906 +0000 UTC m=+271.449357694"
Jul 24 17:07:49.718417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:49.718381    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh" event={"ID":"a53f4531-7c23-4e5a-8dfd-688c73b21926","Type":"ContainerStarted","Data":"56b29dc0df85ac8053f8761b71c6789ca4185650b675a98bad8f87792ddbdd53"}
Jul 24 17:07:49.718906 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:49.718526    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:07:49.734827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:49.734770    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-r5wvh" podStartSLOduration=32.588420718 podStartE2EDuration="34.734750056s" totalImagesPullingTime="2.146329338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:07:49.733548809 +0000 UTC m=+272.448702593" watchObservedRunningTime="2026-07-24 17:07:49.734750056 +0000 UTC m=+272.449903845"
Jul 24 17:07:57.134594 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.134557    2568 patch_prober.go:28] interesting pod/image-registry-68b44f658b-nd6cg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:07:57.135075 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.134621    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:07:57.617958 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.617922    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"]
Jul 24 17:07:57.621565 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.621542    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.624063 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.624039    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t2lqv\""
Jul 24 17:07:57.624585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.624567    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 17:07:57.624879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.624593    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:07:57.624986 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.624606    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 17:07:57.624986 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.624647    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 17:07:57.631391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.631371    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9q6z9"]
Jul 24 17:07:57.633480 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.633464    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.636274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.636254    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:07:57.636739 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.636694    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:07:57.637056 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.637041    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:07:57.637368 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.637351    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dktwt\""
Jul 24 17:07:57.638006 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.637985    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"]
Jul 24 17:07:57.764102 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764067    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-root\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764102 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764101    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-tls\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-sys\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2ccb4105-c942-4992-9d67-6c6ac724ae08-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764261    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-wtmp\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764329    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/571334db-fe24-4494-97ad-75e1414d71b6-metrics-client-ca\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764356    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk6jx\" (UniqueName: \"kubernetes.io/projected/571334db-fe24-4494-97ad-75e1414d71b6-kube-api-access-nk6jx\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-textfile\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.764689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ccb4105-c942-4992-9d67-6c6ac724ae08-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.764689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764461    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.764689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.764689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.764497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxgf\" (UniqueName: \"kubernetes.io/projected/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-api-access-tkxgf\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.865949 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.865910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.865962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxgf\" (UniqueName: \"kubernetes.io/projected/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-api-access-tkxgf\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-root\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866338 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-tls\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866338 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-sys\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866338 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2ccb4105-c942-4992-9d67-6c6ac724ae08-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866338 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866338 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866582 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-wtmp\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866582 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/571334db-fe24-4494-97ad-75e1414d71b6-metrics-client-ca\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866582 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866582 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk6jx\" (UniqueName: \"kubernetes.io/projected/571334db-fe24-4494-97ad-75e1414d71b6-kube-api-access-nk6jx\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866582 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-textfile\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.866582 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ccb4105-c942-4992-9d67-6c6ac724ae08-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866897 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866681    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2ccb4105-c942-4992-9d67-6c6ac724ae08-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.866897 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.866750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.867051 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.867028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-root\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.867138 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:57.867119    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 17:07:57.867196 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:57.867174    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-tls podName:571334db-fe24-4494-97ad-75e1414d71b6 nodeName:}" failed. No retries permitted until 2026-07-24 17:07:58.367157303 +0000 UTC m=+281.082311073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-tls") pod "node-exporter-9q6z9" (UID: "571334db-fe24-4494-97ad-75e1414d71b6") : secret "node-exporter-tls" not found
Jul 24 17:07:57.867262 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.867221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ccb4105-c942-4992-9d67-6c6ac724ae08-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.867324 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.867296    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/571334db-fe24-4494-97ad-75e1414d71b6-metrics-client-ca\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.867385 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.867338    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-sys\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.867801 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.867439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-wtmp\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.867801 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.867662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-textfile\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.868194 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.868137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.869550 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.869528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.869776 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.869754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.870068 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.870047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.875890 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.875860    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk6jx\" (UniqueName: \"kubernetes.io/projected/571334db-fe24-4494-97ad-75e1414d71b6-kube-api-access-nk6jx\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:57.875890 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.875871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxgf\" (UniqueName: \"kubernetes.io/projected/2ccb4105-c942-4992-9d67-6c6ac724ae08-kube-api-access-tkxgf\") pod \"kube-state-metrics-56d9f944b4-rmlq2\" (UID: \"2ccb4105-c942-4992-9d67-6c6ac724ae08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:57.931816 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:57.931781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"
Jul 24 17:07:58.066243 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.066211    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2"]
Jul 24 17:07:58.069785 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:58.069755    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccb4105_c942_4992_9d67_6c6ac724ae08.slice/crio-e66141e71ac7806b2f740057e21dfbf95b17d9d1c48c35dfae598f58db299d52 WatchSource:0}: Error finding container e66141e71ac7806b2f740057e21dfbf95b17d9d1c48c35dfae598f58db299d52: Status 404 returned error can't find the container with id e66141e71ac7806b2f740057e21dfbf95b17d9d1c48c35dfae598f58db299d52
Jul 24 17:07:58.362673 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:07:58.362637    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zj2fs" podUID="9d2e535b-c7ea-49fb-8a57-1dc047fffd4f"
Jul 24 17:07:58.372193 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.372162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-tls\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:58.374404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.374387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/571334db-fe24-4494-97ad-75e1414d71b6-node-exporter-tls\") pod \"node-exporter-9q6z9\" (UID: \"571334db-fe24-4494-97ad-75e1414d71b6\") " pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:58.544567 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.544523    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9q6z9"
Jul 24 17:07:58.556651 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:07:58.556619    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571334db_fe24_4494_97ad_75e1414d71b6.slice/crio-a5be4eb18d67681aec75cc7caca8e6e0dfafa13357350abe503d070820ba202d WatchSource:0}: Error finding container a5be4eb18d67681aec75cc7caca8e6e0dfafa13357350abe503d070820ba202d: Status 404 returned error can't find the container with id a5be4eb18d67681aec75cc7caca8e6e0dfafa13357350abe503d070820ba202d
Jul 24 17:07:58.750873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.750831    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9q6z9" event={"ID":"571334db-fe24-4494-97ad-75e1414d71b6","Type":"ContainerStarted","Data":"a5be4eb18d67681aec75cc7caca8e6e0dfafa13357350abe503d070820ba202d"}
Jul 24 17:07:58.752528 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.752505    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:07:58.752691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:58.752525    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2" event={"ID":"2ccb4105-c942-4992-9d67-6c6ac724ae08","Type":"ContainerStarted","Data":"e66141e71ac7806b2f740057e21dfbf95b17d9d1c48c35dfae598f58db299d52"}
Jul 24 17:07:59.759450 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:59.759400    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2" event={"ID":"2ccb4105-c942-4992-9d67-6c6ac724ae08","Type":"ContainerStarted","Data":"91b1bfdbabc9ee026d4fa789f8ecf439b1f0feec22bd3b9696cd1818e5028000"}
Jul 24 17:07:59.759886 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:59.759519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2" event={"ID":"2ccb4105-c942-4992-9d67-6c6ac724ae08","Type":"ContainerStarted","Data":"d3c1e2423844212e9cffc70e34759669769e581bfd63cab5452e7a1725212373"}
Jul 24 17:07:59.761731 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:59.761626    2568 generic.go:356] "Generic (PLEG): container finished" podID="571334db-fe24-4494-97ad-75e1414d71b6" containerID="556e712c75a1b5143a07dc88713d8cd3859d6e60c45d20c9fe98422ca61d39b6" exitCode=0
Jul 24 17:07:59.761731 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:07:59.761668    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9q6z9" event={"ID":"571334db-fe24-4494-97ad-75e1414d71b6","Type":"ContainerDied","Data":"556e712c75a1b5143a07dc88713d8cd3859d6e60c45d20c9fe98422ca61d39b6"}
Jul 24 17:08:00.624623 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.624588    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-648c9c8698-mp2vm"]
Jul 24 17:08:00.628562 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.628533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.630599 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.630576    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 17:08:00.630852 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.630831    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d95fx\""
Jul 24 17:08:00.631063 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.631047    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 17:08:00.631063 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.631054    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 17:08:00.631187 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.631060    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 17:08:00.631187 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.631081    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 17:08:00.631493 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.631480    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-qvvoqd24bnf4\""
Jul 24 17:08:00.639226 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.639203    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-648c9c8698-mp2vm"]
Jul 24 17:08:00.767942 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.767908    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9q6z9" event={"ID":"571334db-fe24-4494-97ad-75e1414d71b6","Type":"ContainerStarted","Data":"9f140fe8f59ea777c8efd804d72beb280a4fc88c3e3a778eb6b629cf85970aad"}
Jul 24 17:08:00.768420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.767961    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9q6z9" event={"ID":"571334db-fe24-4494-97ad-75e1414d71b6","Type":"ContainerStarted","Data":"b865d961f21cf2140ff8b43e48df5daf17cc616e2e4340f47c1895eca203415f"}
Jul 24 17:08:00.769927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.769908    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2" event={"ID":"2ccb4105-c942-4992-9d67-6c6ac724ae08","Type":"ContainerStarted","Data":"5968789b14fb7e7a8342b7226faf9447eb21c7ad918e6eeafa676ca23e9b3938"}
Jul 24 17:08:00.787020 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.786971    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9q6z9" podStartSLOduration=2.728874409 podStartE2EDuration="3.78695675s" totalImagesPullingTime="972.431362ms" totalInitContainerRuntime="85.650979ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:00.785200819 +0000 UTC m=+283.500354615" watchObservedRunningTime="2026-07-24 17:08:00.78695675 +0000 UTC m=+283.502110535"
Jul 24 17:08:00.792096 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792173 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792173 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792151    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee6cb250-120c-48da-ba44-641ce2dd262c-metrics-client-ca\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792173 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792169    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792271 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792271 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzwx\" (UniqueName: \"kubernetes.io/projected/ee6cb250-120c-48da-ba44-641ce2dd262c-kube-api-access-2wzwx\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792331 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-grpc-tls\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.792364 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.792333    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-tls\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.803181 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.803137    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rmlq2" podStartSLOduration=2.346379505 podStartE2EDuration="3.803121736s" totalImagesPullingTime="1.456742231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:00.802800949 +0000 UTC m=+283.517954735" watchObservedRunningTime="2026-07-24 17:08:00.803121736 +0000 UTC m=+283.518275579"
Jul 24 17:08:00.893668 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.893638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.893888 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.893675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.893955 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.893908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee6cb250-120c-48da-ba44-641ce2dd262c-metrics-client-ca\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.894002 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.893964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.894070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.894052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.894123 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.894111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzwx\" (UniqueName: \"kubernetes.io/projected/ee6cb250-120c-48da-ba44-641ce2dd262c-kube-api-access-2wzwx\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.894213 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.894195    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-grpc-tls\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.894333 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.894302    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-tls\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.895390 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.894742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee6cb250-120c-48da-ba44-641ce2dd262c-metrics-client-ca\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.896765 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.896736    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.896859 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.896834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.896977 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.896960    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-grpc-tls\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.897027 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.897008    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-tls\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.897063 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.897041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.897097 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.897045    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee6cb250-120c-48da-ba44-641ce2dd262c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.902833 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.902815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzwx\" (UniqueName: \"kubernetes.io/projected/ee6cb250-120c-48da-ba44-641ce2dd262c-kube-api-access-2wzwx\") pod \"thanos-querier-648c9c8698-mp2vm\" (UID: \"ee6cb250-120c-48da-ba44-641ce2dd262c\") " pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:00.937954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:00.937921    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:01.071212 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.071070    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-648c9c8698-mp2vm"]
Jul 24 17:08:01.077020 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:08:01.076992    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6cb250_120c_48da_ba44_641ce2dd262c.slice/crio-d022f6144ac36e7dfcffcdd7213b4cd3fb1e9e8f76b5c9377d105b9d89af55ac WatchSource:0}: Error finding container d022f6144ac36e7dfcffcdd7213b4cd3fb1e9e8f76b5c9377d105b9d89af55ac: Status 404 returned error can't find the container with id d022f6144ac36e7dfcffcdd7213b4cd3fb1e9e8f76b5c9377d105b9d89af55ac
Jul 24 17:08:01.775574 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.775538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"d022f6144ac36e7dfcffcdd7213b4cd3fb1e9e8f76b5c9377d105b9d89af55ac"}
Jul 24 17:08:01.882558 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.882520    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bdc76bf-gg2tq"]
Jul 24 17:08:01.886121 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.886098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:01.888487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.888461    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 17:08:01.888688 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.888664    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 17:08:01.889436 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.889397    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 17:08:01.889534 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.889487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c7r7x\""
Jul 24 17:08:01.889534 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.889513    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eks9ve7sdgn8e\""
Jul 24 17:08:01.889662 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.889398    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 17:08:01.895253 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:01.895111    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bdc76bf-gg2tq"]
Jul 24 17:08:02.008651 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-secret-metrics-server-tls\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.008651 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008657    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aac036a-de6f-49be-a520-35b0d0b6bd89-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.009010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008775    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-client-ca-bundle\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.009010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z65lh\" (UniqueName: \"kubernetes.io/projected/4aac036a-de6f-49be-a520-35b0d0b6bd89-kube-api-access-z65lh\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.009010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4aac036a-de6f-49be-a520-35b0d0b6bd89-metrics-server-audit-profiles\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.009010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4aac036a-de6f-49be-a520-35b0d0b6bd89-audit-log\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.009010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.008961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-secret-metrics-server-client-certs\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-secret-metrics-server-tls\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110361 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aac036a-de6f-49be-a520-35b0d0b6bd89-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-client-ca-bundle\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65lh\" (UniqueName: \"kubernetes.io/projected/4aac036a-de6f-49be-a520-35b0d0b6bd89-kube-api-access-z65lh\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4aac036a-de6f-49be-a520-35b0d0b6bd89-metrics-server-audit-profiles\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4aac036a-de6f-49be-a520-35b0d0b6bd89-audit-log\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.110566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.110528    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-secret-metrics-server-client-certs\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.111217 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.111185    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4aac036a-de6f-49be-a520-35b0d0b6bd89-audit-log\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.111324 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.111211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aac036a-de6f-49be-a520-35b0d0b6bd89-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.111640 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.111617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4aac036a-de6f-49be-a520-35b0d0b6bd89-metrics-server-audit-profiles\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.113407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.113382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-secret-metrics-server-tls\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.113407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.113402    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-client-ca-bundle\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.114316 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.114289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4aac036a-de6f-49be-a520-35b0d0b6bd89-secret-metrics-server-client-certs\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.120640 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.120582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z65lh\" (UniqueName: \"kubernetes.io/projected/4aac036a-de6f-49be-a520-35b0d0b6bd89-kube-api-access-z65lh\") pod \"metrics-server-bdc76bf-gg2tq\" (UID: \"4aac036a-de6f-49be-a520-35b0d0b6bd89\") " pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.199330 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.199294    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:02.211902 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.211871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:08:02.214420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.214396    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d2e535b-c7ea-49fb-8a57-1dc047fffd4f-metrics-tls\") pod \"dns-default-zj2fs\" (UID: \"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f\") " pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:08:02.349290 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.349249    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bdc76bf-gg2tq"]
Jul 24 17:08:02.352845 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:08:02.352811    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aac036a_de6f_49be_a520_35b0d0b6bd89.slice/crio-707287f96037894d35be64e557b4b5e37cf606a87b6069f90aa37dd5bf362290 WatchSource:0}: Error finding container 707287f96037894d35be64e557b4b5e37cf606a87b6069f90aa37dd5bf362290: Status 404 returned error can't find the container with id 707287f96037894d35be64e557b4b5e37cf606a87b6069f90aa37dd5bf362290
Jul 24 17:08:02.356235 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.356108    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-57f2l\""
Jul 24 17:08:02.363382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.363321    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:08:02.516099 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.516064    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zj2fs"]
Jul 24 17:08:02.781039 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:02.781004    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq" event={"ID":"4aac036a-de6f-49be-a520-35b0d0b6bd89","Type":"ContainerStarted","Data":"707287f96037894d35be64e557b4b5e37cf606a87b6069f90aa37dd5bf362290"}
Jul 24 17:08:03.014214 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:08:03.014180    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2e535b_c7ea_49fb_8a57_1dc047fffd4f.slice/crio-1ae2bcd6a3e145f97ad82e8e069c812828cd967ce65ad38c9647d5ff0614c601 WatchSource:0}: Error finding container 1ae2bcd6a3e145f97ad82e8e069c812828cd967ce65ad38c9647d5ff0614c601: Status 404 returned error can't find the container with id 1ae2bcd6a3e145f97ad82e8e069c812828cd967ce65ad38c9647d5ff0614c601
Jul 24 17:08:03.787755 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:03.787586    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zj2fs" event={"ID":"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f","Type":"ContainerStarted","Data":"1ae2bcd6a3e145f97ad82e8e069c812828cd967ce65ad38c9647d5ff0614c601"}
Jul 24 17:08:03.790537 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:03.790508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"3c8f95856e71d6391cbae7d105234c40692c217b4380aa4ba539c9e07e4ad12c"}
Jul 24 17:08:03.790683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:03.790584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"4fd27e1658e385bba2e251d31b727710c1679df9655e89e82af127e3da56dc18"}
Jul 24 17:08:03.790683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:03.790622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"b8cf6c994055702650e837d7ff94fca74fdeada523853522470fd5afb4ac7e78"}
Jul 24 17:08:05.802649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.802609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zj2fs" event={"ID":"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f","Type":"ContainerStarted","Data":"0010597529d1ddbcd8ceee19e2011a735c633b3e5d8dce0b063e78cc6e0ff8c1"}
Jul 24 17:08:05.803096 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.802707    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:08:05.803096 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.802754    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zj2fs" event={"ID":"9d2e535b-c7ea-49fb-8a57-1dc047fffd4f","Type":"ContainerStarted","Data":"dfe3a9bc90fe93c4b00ef88a265117dafb46d4fc408a7654f748b561e637f067"}
Jul 24 17:08:05.805198 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.805171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"cc62777b9a7d546e2b65f213e6a0de2f3d4cfb52213684631004a48ac4f7557c"}
Jul 24 17:08:05.805308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.805237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"3647377df30d99522a6c2e112be7859878f10e9b24a89b79dc1ae450c2eef617"}
Jul 24 17:08:05.805308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.805278    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" event={"ID":"ee6cb250-120c-48da-ba44-641ce2dd262c","Type":"ContainerStarted","Data":"ee6181af934f4b99153219c7a2f98d8cd63f4e6e17396ec329f93257777cd86d"}
Jul 24 17:08:05.805418 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.805317    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:05.806559 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.806537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq" event={"ID":"4aac036a-de6f-49be-a520-35b0d0b6bd89","Type":"ContainerStarted","Data":"a353065f83cf7d03ae285543221d6e664b40cbb631dcb1426af0c40b4d499e39"}
Jul 24 17:08:05.820366 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.820324    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zj2fs" podStartSLOduration=252.012865186 podStartE2EDuration="4m13.820308958s" totalImagesPullingTime="1.807443772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:05.81898287 +0000 UTC m=+288.534136658" watchObservedRunningTime="2026-07-24 17:08:05.820308958 +0000 UTC m=+288.535462744"
Jul 24 17:08:05.839888 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.839843    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm" podStartSLOduration=2.365916265 podStartE2EDuration="5.839825992s" totalImagesPullingTime="3.473909727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:05.838249854 +0000 UTC m=+288.553403653" watchObservedRunningTime="2026-07-24 17:08:05.839825992 +0000 UTC m=+288.554979777"
Jul 24 17:08:05.858047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:05.857976    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq" podStartSLOduration=2.925222374 podStartE2EDuration="4.85795835s" totalImagesPullingTime="1.932735976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:08:05.856480451 +0000 UTC m=+288.571634237" watchObservedRunningTime="2026-07-24 17:08:05.85795835 +0000 UTC m=+288.573112135"
Jul 24 17:08:07.134705 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:07.134678    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:08:07.546997 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:07.546966    2568 patch_prober.go:28] interesting pod/image-registry-7bb4f87d8f-xcgkq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 24 17:08:07.547158 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:07.547022    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq" podUID="ae9795cd-88f0-47f8-8706-77d9e280b978" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:08:10.727133 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:10.727105    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bb4f87d8f-xcgkq"
Jul 24 17:08:11.817098 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:11.817069    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-648c9c8698-mp2vm"
Jul 24 17:08:11.900200 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:08:11.900162    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-276m8" podUID="caf3a3bf-ed48-4a40-9585-5ebb8adac3af"
Jul 24 17:08:12.148786 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.148711    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerName="registry" containerID="cri-o://4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917" gracePeriod=30
Jul 24 17:08:12.393239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.393215    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:08:12.507952 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.507867    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-image-registry-private-configuration\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.507952 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.507902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.507952 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.507923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-ca-trust-extracted\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.507952 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.507939    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-certificates\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.508246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.507999    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh8p6\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-kube-api-access-dh8p6\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.508246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.508042    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-trusted-ca\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.508246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.508066    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-installation-pull-secrets\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.508246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.508097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-bound-sa-token\") pod \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\" (UID: \"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1\") "
Jul 24 17:08:12.508462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.508442    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:12.508518 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.508463    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:08:12.510445 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.510404    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-kube-api-access-dh8p6" (OuterVolumeSpecName: "kube-api-access-dh8p6") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "kube-api-access-dh8p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:12.510600 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.510580    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:12.510672 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.510631    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:08:12.510893 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.510875    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:08:12.510959 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.510875    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:08:12.518770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.518744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" (UID: "9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:08:12.609036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609002    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609030    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-ca-trust-extracted\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609039    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-registry-certificates\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609048    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh8p6\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-kube-api-access-dh8p6\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609059    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-trusted-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609067    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-installation-pull-secrets\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609074    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-bound-sa-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.609265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.609083    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1-image-registry-private-configuration\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:08:12.832660 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.832576    2568 generic.go:356] "Generic (PLEG): container finished" podID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerID="4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917" exitCode=0
Jul 24 17:08:12.832660 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.832623    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg"
Jul 24 17:08:12.832660 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.832640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" event={"ID":"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1","Type":"ContainerDied","Data":"4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917"}
Jul 24 17:08:12.833216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.832677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b44f658b-nd6cg" event={"ID":"9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1","Type":"ContainerDied","Data":"5bcead5980d38eff8b0b48418193c1fb99c39e5a221cbdf47ceced0a7c4e29d8"}
Jul 24 17:08:12.833216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.832708    2568 scope.go:117] "RemoveContainer" containerID="4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917"
Jul 24 17:08:12.841532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.841511    2568 scope.go:117] "RemoveContainer" containerID="4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917"
Jul 24 17:08:12.841864 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:08:12.841837    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917\": container with ID starting with 4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917 not found: ID does not exist" containerID="4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917"
Jul 24 17:08:12.841928 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.841873    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917"} err="failed to get container status \"4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917\": rpc error: code = NotFound desc = could not find container \"4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917\": container with ID starting with 4badea0db3c23fcdbb1144bcf232a80e845e1e7395f944f50585ff3cac694917 not found: ID does not exist"
Jul 24 17:08:12.858308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.858283    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b44f658b-nd6cg"]
Jul 24 17:08:12.865694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:12.865670    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68b44f658b-nd6cg"]
Jul 24 17:08:13.903828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:13.903799    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" path="/var/lib/kubelet/pods/9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1/volumes"
Jul 24 17:08:15.813441 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:15.813408    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zj2fs"
Jul 24 17:08:17.689656 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:17.689628    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:08:17.697563 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:17.697541    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:08:17.699024 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:17.698989    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:08:22.199519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:22.199477    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:22.209063 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:22.199549    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:24.879579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:24.879545    2568 generic.go:356] "Generic (PLEG): container finished" podID="e81dffed-6bda-49da-878c-ac256e5c437e" containerID="121ec339d05942e767772fe0e4d25f7653f0dad51eb3546380a313392920c944" exitCode=0
Jul 24 17:08:24.879977 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:24.879619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h4ftz" event={"ID":"e81dffed-6bda-49da-878c-ac256e5c437e","Type":"ContainerDied","Data":"121ec339d05942e767772fe0e4d25f7653f0dad51eb3546380a313392920c944"}
Jul 24 17:08:24.880019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:24.879977    2568 scope.go:117] "RemoveContainer" containerID="121ec339d05942e767772fe0e4d25f7653f0dad51eb3546380a313392920c944"
Jul 24 17:08:25.775284 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:25.775254    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-lqjkn_fa384732-3787-4bd9-b0e3-e17e45d960e6/cluster-samples-operator/0.log"
Jul 24 17:08:25.782224 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:25.782193    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-lqjkn_fa384732-3787-4bd9-b0e3-e17e45d960e6/cluster-samples-operator-watch/0.log"
Jul 24 17:08:25.884507 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:25.884475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-h4ftz" event={"ID":"e81dffed-6bda-49da-878c-ac256e5c437e","Type":"ContainerStarted","Data":"5ffba50f8b72feefef3bbad994f0d87516ec82beb884eb27bff6aafa2e2ffe4c"}
Jul 24 17:08:25.898934 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:25.898911    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:08:34.917039 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:34.917007    2568 generic.go:356] "Generic (PLEG): container finished" podID="4b96a049-5c8a-4ebf-8894-2a55d7391acf" containerID="55dfcdbe81cdb3bd59034613846bfd6e74c476001d898f719392599416e15112" exitCode=0
Jul 24 17:08:34.917487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:34.917080    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw" event={"ID":"4b96a049-5c8a-4ebf-8894-2a55d7391acf","Type":"ContainerDied","Data":"55dfcdbe81cdb3bd59034613846bfd6e74c476001d898f719392599416e15112"}
Jul 24 17:08:34.917487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:34.917358    2568 scope.go:117] "RemoveContainer" containerID="55dfcdbe81cdb3bd59034613846bfd6e74c476001d898f719392599416e15112"
Jul 24 17:08:35.922205 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:35.922174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-2ffdw" event={"ID":"4b96a049-5c8a-4ebf-8894-2a55d7391acf","Type":"ContainerStarted","Data":"112b0b21f0ce3169350fa8f57234c6dba271aa9a03e0406726cf20509ed73070"}
Jul 24 17:08:42.204444 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:42.204411    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:08:42.208663 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:08:42.208639    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bdc76bf-gg2tq"
Jul 24 17:09:31.693388 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:31.693296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:09:31.695543 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:31.695520    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf3a3bf-ed48-4a40-9585-5ebb8adac3af-metrics-certs\") pod \"network-metrics-daemon-276m8\" (UID: \"caf3a3bf-ed48-4a40-9585-5ebb8adac3af\") " pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:09:31.901734 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:31.901681    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgbn9\""
Jul 24 17:09:31.910403 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:31.910379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-276m8"
Jul 24 17:09:32.044855 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:32.044832    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-276m8"]
Jul 24 17:09:32.047413 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:09:32.047387    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf3a3bf_ed48_4a40_9585_5ebb8adac3af.slice/crio-fecc7b9c2f01276315144e40b56f11c84e2e79ae6bd47d480815eb3b8a146de9 WatchSource:0}: Error finding container fecc7b9c2f01276315144e40b56f11c84e2e79ae6bd47d480815eb3b8a146de9: Status 404 returned error can't find the container with id fecc7b9c2f01276315144e40b56f11c84e2e79ae6bd47d480815eb3b8a146de9
Jul 24 17:09:32.049421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:32.049404    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:09:32.124028 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:32.123991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-276m8" event={"ID":"caf3a3bf-ed48-4a40-9585-5ebb8adac3af","Type":"ContainerStarted","Data":"fecc7b9c2f01276315144e40b56f11c84e2e79ae6bd47d480815eb3b8a146de9"}
Jul 24 17:09:33.129675 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:33.129577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-276m8" event={"ID":"caf3a3bf-ed48-4a40-9585-5ebb8adac3af","Type":"ContainerStarted","Data":"adf607054f174b1cf0e84a358e7f87659d0b763277d113ca441a219e3c12caf9"}
Jul 24 17:09:33.129675 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:33.129629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-276m8" event={"ID":"caf3a3bf-ed48-4a40-9585-5ebb8adac3af","Type":"ContainerStarted","Data":"4fa8208c7a4afbed64dbfae732832d92311a33d19f2f3acd1f28d17fc5d7f3d0"}
Jul 24 17:09:33.145677 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:09:33.145635    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-276m8" podStartSLOduration=375.343712036 podStartE2EDuration="6m16.145620124s" totalImagesPullingTime="801.908088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:09:33.145061575 +0000 UTC m=+375.860215361" watchObservedRunningTime="2026-07-24 17:09:33.145620124 +0000 UTC m=+375.860773904"
Jul 24 17:11:00.774914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.774882    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"]
Jul 24 17:11:00.775404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.775283    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerName="registry"
Jul 24 17:11:00.775404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.775301    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerName="registry"
Jul 24 17:11:00.775404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.775353    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f52b8e2-2f51-45fd-8bc9-d0fdc99a2ae1" containerName="registry"
Jul 24 17:11:00.778195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.778178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:00.780632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.780608    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cd644\""
Jul 24 17:11:00.780828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.780663    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 17:11:00.780828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.780663    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 17:11:00.787227 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.787200    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"]
Jul 24 17:11:00.817595 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.817562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e007bd96-80a0-4cd6-8246-31b26cfde559-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66pm6\" (UID: \"e007bd96-80a0-4cd6-8246-31b26cfde559\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:00.817777 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.817613    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47dl\" (UniqueName: \"kubernetes.io/projected/e007bd96-80a0-4cd6-8246-31b26cfde559-kube-api-access-h47dl\") pod \"cert-manager-cainjector-559cdd8c87-66pm6\" (UID: \"e007bd96-80a0-4cd6-8246-31b26cfde559\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:00.919043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.919008    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e007bd96-80a0-4cd6-8246-31b26cfde559-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66pm6\" (UID: \"e007bd96-80a0-4cd6-8246-31b26cfde559\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:00.919181 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.919057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47dl\" (UniqueName: \"kubernetes.io/projected/e007bd96-80a0-4cd6-8246-31b26cfde559-kube-api-access-h47dl\") pod \"cert-manager-cainjector-559cdd8c87-66pm6\" (UID: \"e007bd96-80a0-4cd6-8246-31b26cfde559\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:00.929172 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.929136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e007bd96-80a0-4cd6-8246-31b26cfde559-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66pm6\" (UID: \"e007bd96-80a0-4cd6-8246-31b26cfde559\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:00.929289 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:00.929191    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47dl\" (UniqueName: \"kubernetes.io/projected/e007bd96-80a0-4cd6-8246-31b26cfde559-kube-api-access-h47dl\") pod \"cert-manager-cainjector-559cdd8c87-66pm6\" (UID: \"e007bd96-80a0-4cd6-8246-31b26cfde559\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:01.087945 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:01.087855    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"
Jul 24 17:11:01.228921 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:01.228882    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66pm6"]
Jul 24 17:11:01.232664 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:11:01.232641    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode007bd96_80a0_4cd6_8246_31b26cfde559.slice/crio-503c60011be8e581f73f93d8a254eaed915e48c5e14a23a21e2b835c99f2373a WatchSource:0}: Error finding container 503c60011be8e581f73f93d8a254eaed915e48c5e14a23a21e2b835c99f2373a: Status 404 returned error can't find the container with id 503c60011be8e581f73f93d8a254eaed915e48c5e14a23a21e2b835c99f2373a
Jul 24 17:11:01.452037 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:01.452004    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6" event={"ID":"e007bd96-80a0-4cd6-8246-31b26cfde559","Type":"ContainerStarted","Data":"503c60011be8e581f73f93d8a254eaed915e48c5e14a23a21e2b835c99f2373a"}
Jul 24 17:11:04.467441 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:04.467408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6" event={"ID":"e007bd96-80a0-4cd6-8246-31b26cfde559","Type":"ContainerStarted","Data":"3c8ac529164be987b10d543330424f7441dcb2550de4d72afef2d8430dbe6d60"}
Jul 24 17:11:04.481820 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:04.481770    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pm6" podStartSLOduration=1.345234349 podStartE2EDuration="4.481753041s" totalImagesPullingTime="3.136518692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:04.481447005 +0000 UTC m=+467.196600792" watchObservedRunningTime="2026-07-24 17:11:04.481753041 +0000 UTC m=+467.196906827"
Jul 24 17:11:05.002526 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.002490    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"]
Jul 24 17:11:05.005689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.005672    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.008216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.008185    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fxxzq\""
Jul 24 17:11:05.008374 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.008222    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 17:11:05.008996 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.008980    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:11:05.015827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.015804    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"]
Jul 24 17:11:05.053791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.053758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a983b229-20bb-4243-825d-9a4c30ef9795-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88qdm\" (UID: \"a983b229-20bb-4243-825d-9a4c30ef9795\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.053965 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.053820    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjzgp\" (UniqueName: \"kubernetes.io/projected/a983b229-20bb-4243-825d-9a4c30ef9795-kube-api-access-mjzgp\") pod \"openshift-lws-operator-fd8ccff4c-88qdm\" (UID: \"a983b229-20bb-4243-825d-9a4c30ef9795\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.154467 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.154426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a983b229-20bb-4243-825d-9a4c30ef9795-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88qdm\" (UID: \"a983b229-20bb-4243-825d-9a4c30ef9795\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.154631 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.154477    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjzgp\" (UniqueName: \"kubernetes.io/projected/a983b229-20bb-4243-825d-9a4c30ef9795-kube-api-access-mjzgp\") pod \"openshift-lws-operator-fd8ccff4c-88qdm\" (UID: \"a983b229-20bb-4243-825d-9a4c30ef9795\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.154864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.154844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a983b229-20bb-4243-825d-9a4c30ef9795-tmp\") pod \"openshift-lws-operator-fd8ccff4c-88qdm\" (UID: \"a983b229-20bb-4243-825d-9a4c30ef9795\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.162966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.162938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjzgp\" (UniqueName: \"kubernetes.io/projected/a983b229-20bb-4243-825d-9a4c30ef9795-kube-api-access-mjzgp\") pod \"openshift-lws-operator-fd8ccff4c-88qdm\" (UID: \"a983b229-20bb-4243-825d-9a4c30ef9795\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.314664 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.314583    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"
Jul 24 17:11:05.447266 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.447235    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm"]
Jul 24 17:11:05.450020 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:11:05.449992    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda983b229_20bb_4243_825d_9a4c30ef9795.slice/crio-d09c2a289d42ed6217d9f6f098bacceeaa52582dc3e6e462681a9c35c076d7b5 WatchSource:0}: Error finding container d09c2a289d42ed6217d9f6f098bacceeaa52582dc3e6e462681a9c35c076d7b5: Status 404 returned error can't find the container with id d09c2a289d42ed6217d9f6f098bacceeaa52582dc3e6e462681a9c35c076d7b5
Jul 24 17:11:05.472741 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:05.472697    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm" event={"ID":"a983b229-20bb-4243-825d-9a4c30ef9795","Type":"ContainerStarted","Data":"d09c2a289d42ed6217d9f6f098bacceeaa52582dc3e6e462681a9c35c076d7b5"}
Jul 24 17:11:08.488000 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:08.487955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm" event={"ID":"a983b229-20bb-4243-825d-9a4c30ef9795","Type":"ContainerStarted","Data":"f2d6f5c9c53afcab6d5c7f851be85d87eddaf595c0ba9b855d2c5e80c150cb5a"}
Jul 24 17:11:08.503858 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:08.503788    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-88qdm" podStartSLOduration=1.647545074 podStartE2EDuration="4.503766729s" totalImagesPullingTime="2.856221655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:08.501761538 +0000 UTC m=+471.216915323" watchObservedRunningTime="2026-07-24 17:11:08.503766729 +0000 UTC m=+471.218920516"
Jul 24 17:11:26.744795 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.744758    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"]
Jul 24 17:11:26.747371 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.747349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.751213 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.751187    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:11:26.751598 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.751581    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:11:26.751709 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.751692    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:11:26.752249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.752231    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:11:26.754632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.754613    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pksz9\""
Jul 24 17:11:26.778099 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.778060    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"]
Jul 24 17:11:26.852913 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.852869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc537c19-a3a3-4398-9a83-b2b728e5a842-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.853062 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.852940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc537c19-a3a3-4398-9a83-b2b728e5a842-manifests\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.853062 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.852969    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc537c19-a3a3-4398-9a83-b2b728e5a842-webhook-cert\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.853062 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.852987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxgx6\" (UniqueName: \"kubernetes.io/projected/dc537c19-a3a3-4398-9a83-b2b728e5a842-kube-api-access-fxgx6\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.853187 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.853107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc537c19-a3a3-4398-9a83-b2b728e5a842-tmp\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.954533 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.954491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc537c19-a3a3-4398-9a83-b2b728e5a842-manifests\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.954753 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.954540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc537c19-a3a3-4398-9a83-b2b728e5a842-webhook-cert\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.954753 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.954566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxgx6\" (UniqueName: \"kubernetes.io/projected/dc537c19-a3a3-4398-9a83-b2b728e5a842-kube-api-access-fxgx6\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.954873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.954766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc537c19-a3a3-4398-9a83-b2b728e5a842-tmp\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.954873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.954820    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc537c19-a3a3-4398-9a83-b2b728e5a842-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.954966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.954943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc537c19-a3a3-4398-9a83-b2b728e5a842-manifests\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.956964 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.956933    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc537c19-a3a3-4398-9a83-b2b728e5a842-tmp\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.957090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.957032    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc537c19-a3a3-4398-9a83-b2b728e5a842-webhook-cert\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.957282 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.957262    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc537c19-a3a3-4398-9a83-b2b728e5a842-apiservice-cert\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:26.971770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:26.971739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxgx6\" (UniqueName: \"kubernetes.io/projected/dc537c19-a3a3-4398-9a83-b2b728e5a842-kube-api-access-fxgx6\") pod \"opendatahub-operator-controller-manager-645867896-65qv5\" (UID: \"dc537c19-a3a3-4398-9a83-b2b728e5a842\") " pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:27.059588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:27.059493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:27.221245 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:27.221219    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"]
Jul 24 17:11:27.223244 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:11:27.223215    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc537c19_a3a3_4398_9a83_b2b728e5a842.slice/crio-0d92ad8aed5b5aa585b16a0bb7339952ef156cbbf5fd2522b499c8101b879307 WatchSource:0}: Error finding container 0d92ad8aed5b5aa585b16a0bb7339952ef156cbbf5fd2522b499c8101b879307: Status 404 returned error can't find the container with id 0d92ad8aed5b5aa585b16a0bb7339952ef156cbbf5fd2522b499c8101b879307
Jul 24 17:11:27.563423 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:27.563387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5" event={"ID":"dc537c19-a3a3-4398-9a83-b2b728e5a842","Type":"ContainerStarted","Data":"0d92ad8aed5b5aa585b16a0bb7339952ef156cbbf5fd2522b499c8101b879307"}
Jul 24 17:11:30.581205 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:30.581120    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5" event={"ID":"dc537c19-a3a3-4398-9a83-b2b728e5a842","Type":"ContainerStarted","Data":"ca93cdcb0bca0cc8604496c9dc4d73ca8a94533c7643655d4e87e041d5dd0f11"}
Jul 24 17:11:31.586991 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:31.586900    2568 generic.go:356] "Generic (PLEG): container finished" podID="dc537c19-a3a3-4398-9a83-b2b728e5a842" containerID="ca93cdcb0bca0cc8604496c9dc4d73ca8a94533c7643655d4e87e041d5dd0f11" exitCode=0
Jul 24 17:11:31.587352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:31.586983    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5" event={"ID":"dc537c19-a3a3-4398-9a83-b2b728e5a842","Type":"ContainerDied","Data":"ca93cdcb0bca0cc8604496c9dc4d73ca8a94533c7643655d4e87e041d5dd0f11"}
Jul 24 17:11:32.592338 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:32.592300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5" event={"ID":"dc537c19-a3a3-4398-9a83-b2b728e5a842","Type":"ContainerStarted","Data":"c8efe2e099c7dd907f5b32b5de7f5d42e3141a491e70db0d728edbc02311ea84"}
Jul 24 17:11:32.592778 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:32.592384    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:32.634509 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:32.634458    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5" podStartSLOduration=2.305719854 podStartE2EDuration="6.63441655s" totalImagesPullingTime="3.3239901s" totalInitContainerRuntime="1.004706596s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:32.63296553 +0000 UTC m=+495.348119316" watchObservedRunningTime="2026-07-24 17:11:32.63441655 +0000 UTC m=+495.349570336"
Jul 24 17:11:43.598680 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:43.598649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-645867896-65qv5"
Jul 24 17:11:45.763001 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.762965    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"]
Jul 24 17:11:45.765238 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.765220    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.769845 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.769818    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 17:11:45.769845 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.769832    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 17:11:45.769845 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.769817    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pnpsn\""
Jul 24 17:11:45.770039 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.769817    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 17:11:45.786937 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.786907    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"]
Jul 24 17:11:45.802009 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.801982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a730b6f6-35fe-40ec-a050-dafa5ab961a9-cert\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.802164 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.802039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzjmr\" (UniqueName: \"kubernetes.io/projected/a730b6f6-35fe-40ec-a050-dafa5ab961a9-kube-api-access-qzjmr\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.802164 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.802105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a730b6f6-35fe-40ec-a050-dafa5ab961a9-manager-config\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.802427 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.802176    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a730b6f6-35fe-40ec-a050-dafa5ab961a9-metrics-cert\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.903003 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.902972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzjmr\" (UniqueName: \"kubernetes.io/projected/a730b6f6-35fe-40ec-a050-dafa5ab961a9-kube-api-access-qzjmr\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.903199 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.903013    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a730b6f6-35fe-40ec-a050-dafa5ab961a9-manager-config\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.903199 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.903068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a730b6f6-35fe-40ec-a050-dafa5ab961a9-metrics-cert\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.903199 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.903091    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a730b6f6-35fe-40ec-a050-dafa5ab961a9-cert\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.903846 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.903822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a730b6f6-35fe-40ec-a050-dafa5ab961a9-manager-config\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.905596 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.905569    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a730b6f6-35fe-40ec-a050-dafa5ab961a9-cert\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.905700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.905603    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a730b6f6-35fe-40ec-a050-dafa5ab961a9-metrics-cert\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:45.918874 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:45.918849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzjmr\" (UniqueName: \"kubernetes.io/projected/a730b6f6-35fe-40ec-a050-dafa5ab961a9-kube-api-access-qzjmr\") pod \"lws-controller-manager-6f7bfdc884-zrxm9\" (UID: \"a730b6f6-35fe-40ec-a050-dafa5ab961a9\") " pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:46.074608 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:46.074516    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:46.233556 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:46.233430    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"]
Jul 24 17:11:46.236857 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:11:46.236833    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda730b6f6_35fe_40ec_a050_dafa5ab961a9.slice/crio-2b2a17ff76e80d8a6c1e979b76ce01d03ca88648b0d094b28925895e18e66041 WatchSource:0}: Error finding container 2b2a17ff76e80d8a6c1e979b76ce01d03ca88648b0d094b28925895e18e66041: Status 404 returned error can't find the container with id 2b2a17ff76e80d8a6c1e979b76ce01d03ca88648b0d094b28925895e18e66041
Jul 24 17:11:46.659041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:46.659008    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9" event={"ID":"a730b6f6-35fe-40ec-a050-dafa5ab961a9","Type":"ContainerStarted","Data":"2b2a17ff76e80d8a6c1e979b76ce01d03ca88648b0d094b28925895e18e66041"}
Jul 24 17:11:48.670785 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:48.670748    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9" event={"ID":"a730b6f6-35fe-40ec-a050-dafa5ab961a9","Type":"ContainerStarted","Data":"4625dd674eea30edb089d25166efef44bfd972d50051f3effa3acdd0e600718c"}
Jul 24 17:11:48.671223 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:48.670858    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:48.687914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:48.687746    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9" podStartSLOduration=2.212659512 podStartE2EDuration="3.687705094s" totalImagesPullingTime="1.475045582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:48.687484245 +0000 UTC m=+511.402638030" watchObservedRunningTime="2026-07-24 17:11:48.687705094 +0000 UTC m=+511.402858879"
Jul 24 17:11:54.140345 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.140284    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"]
Jul 24 17:11:54.142708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.142687    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.146096 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.146075    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:11:54.146294 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.146274    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5jwhs\""
Jul 24 17:11:54.146380 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.146326    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:11:54.146817 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.146797    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:11:54.160102 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.160070    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"]
Jul 24 17:11:54.162196 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.162181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.166116 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.166097    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 17:11:54.166228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.166187    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 17:11:54.166929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.166910    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l95pf\""
Jul 24 17:11:54.168642 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.168625    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 17:11:54.178075 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64472884-47d9-45ae-b5d1-89fe043ed810-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178169 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64472884-47d9-45ae-b5d1-89fe043ed810-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178169 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178241 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178291 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178277    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178326 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmblh\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-kube-api-access-mmblh\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178365 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178422 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.178463 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.178445    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.185322 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.185298    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"]
Jul 24 17:11:54.199571 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.199529    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"]
Jul 24 17:11:54.279869 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.279833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280055 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.279890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280055 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.279951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280055 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280009    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280055 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64472884-47d9-45ae-b5d1-89fe043ed810-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64472884-47d9-45ae-b5d1-89fe043ed810-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwtx8\" (UniqueName: \"kubernetes.io/projected/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-kube-api-access-wwtx8\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmblh\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-kube-api-access-mmblh\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280359    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280443    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.280632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.281013 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.281013 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280785    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.281013 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.280809    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64472884-47d9-45ae-b5d1-89fe043ed810-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.282960 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.282932    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.283076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.282971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64472884-47d9-45ae-b5d1-89fe043ed810-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.305155 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.305115    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.305998 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.305976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmblh\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-kube-api-access-mmblh\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.381101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwtx8\" (UniqueName: \"kubernetes.io/projected/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-kube-api-access-wwtx8\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381240    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381592 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.381871 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.381850    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.383861 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.383841    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.383948 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.383882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.384061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.384044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.384219 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.384201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.390980 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.390959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.391602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.391579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwtx8\" (UniqueName: \"kubernetes.io/projected/9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db-kube-api-access-wwtx8\") pod \"istiod-openshift-gateway-5677ccb49b-dx52n\" (UID: \"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.453462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.453428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:54.471650 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.471622    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:54.633787 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.633756    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"]
Jul 24 17:11:54.636667 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:11:54.636638    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64472884_47d9_45ae_b5d1_89fe043ed810.slice/crio-8c452bf96e295b2e300f11b13b7d5aeb04678e3381d9dc4db0dc1cab8920ff84 WatchSource:0}: Error finding container 8c452bf96e295b2e300f11b13b7d5aeb04678e3381d9dc4db0dc1cab8920ff84: Status 404 returned error can't find the container with id 8c452bf96e295b2e300f11b13b7d5aeb04678e3381d9dc4db0dc1cab8920ff84
Jul 24 17:11:54.654018 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.653980    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"]
Jul 24 17:11:54.656779 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:11:54.656752    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2b5ae1_775c_4e66_9d33_14b5cdb2b6db.slice/crio-3353ed2ed744caccd53a7a9ba05e22940da43a4986c35d6b58e4f36b2fdc746e WatchSource:0}: Error finding container 3353ed2ed744caccd53a7a9ba05e22940da43a4986c35d6b58e4f36b2fdc746e: Status 404 returned error can't find the container with id 3353ed2ed744caccd53a7a9ba05e22940da43a4986c35d6b58e4f36b2fdc746e
Jul 24 17:11:54.703012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.702981    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n" event={"ID":"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db","Type":"ContainerStarted","Data":"3353ed2ed744caccd53a7a9ba05e22940da43a4986c35d6b58e4f36b2fdc746e"}
Jul 24 17:11:54.704179 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:54.704156    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" event={"ID":"64472884-47d9-45ae-b5d1-89fe043ed810","Type":"ContainerStarted","Data":"8c452bf96e295b2e300f11b13b7d5aeb04678e3381d9dc4db0dc1cab8920ff84"}
Jul 24 17:11:58.451290 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.451245    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:11:58.451703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.451302    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:11:58.451703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.451327    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:11:58.451703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.451372    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:11:58.451703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.451406    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:11:58.734544 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.734432    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" event={"ID":"64472884-47d9-45ae-b5d1-89fe043ed810","Type":"ContainerStarted","Data":"d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a"}
Jul 24 17:11:58.736765 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.736736    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n" event={"ID":"9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db","Type":"ContainerStarted","Data":"902b6d0ee3d63f9c26cf63e0c46e8d325306a41baf0cd7aa667381c7f22f742f"}
Jul 24 17:11:58.736919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.736857    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:11:58.757580 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.757524    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" podStartSLOduration=0.945228202 podStartE2EDuration="4.757508905s" totalImagesPullingTime="3.812280703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:58.755406801 +0000 UTC m=+521.470560611" watchObservedRunningTime="2026-07-24 17:11:58.757508905 +0000 UTC m=+521.472662691"
Jul 24 17:11:58.777167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:58.777119    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n" podStartSLOduration=0.984807081 podStartE2EDuration="4.777103987s" totalImagesPullingTime="3.792296906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:11:58.775176047 +0000 UTC m=+521.490329869" watchObservedRunningTime="2026-07-24 17:11:58.777103987 +0000 UTC m=+521.492257772"
Jul 24 17:11:59.453779 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:59.453704    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:11:59.455423 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:59.455394    2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 24 17:11:59.455544 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:59.455442    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 24 17:11:59.677570 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:59.677541    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f7bfdc884-zrxm9"
Jul 24 17:11:59.750828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:11:59.750743    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dx52n"
Jul 24 17:12:00.158695 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:00.158657    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"]
Jul 24 17:12:00.454203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:00.454118    2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 24 17:12:00.454203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:00.454180    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 24 17:12:01.454496 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:01.454457    2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 24 17:12:01.454926 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:01.454513    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 24 17:12:01.757176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:01.757057    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy" containerID="cri-o://d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a" gracePeriod=30
Jul 24 17:12:07.007426 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.007400    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:12:07.100373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100278    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-envoy\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100318    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64472884-47d9-45ae-b5d1-89fe043ed810-istiod-ca-cert\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100344    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-credential-socket\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100365    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64472884-47d9-45ae-b5d1-89fe043ed810-istio-podinfo\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100383    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmblh\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-kube-api-access-mmblh\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100415    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-certs\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100450    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-istio-token\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100499    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-data\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100525    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-socket\") pod \"64472884-47d9-45ae-b5d1-89fe043ed810\" (UID: \"64472884-47d9-45ae-b5d1-89fe043ed810\") "
Jul 24 17:12:07.100687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100622    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:12:07.101088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100835    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:12:07.101088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100850    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:12:07.101088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100865    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.101088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.100863    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64472884-47d9-45ae-b5d1-89fe043ed810-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:12:07.101088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.101010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-data" (OuterVolumeSpecName: "istio-data") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:12:07.102643 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.102619    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:12:07.102773 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.102707    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-istio-token" (OuterVolumeSpecName: "istio-token") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:12:07.102919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.102896    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64472884-47d9-45ae-b5d1-89fe043ed810-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:12:07.103023 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.102998    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-kube-api-access-mmblh" (OuterVolumeSpecName: "kube-api-access-mmblh") pod "64472884-47d9-45ae-b5d1-89fe043ed810" (UID: "64472884-47d9-45ae-b5d1-89fe043ed810"). InnerVolumeSpecName "kube-api-access-mmblh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:12:07.201617 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201582    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201617 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201609    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64472884-47d9-45ae-b5d1-89fe043ed810-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201617 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201621    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64472884-47d9-45ae-b5d1-89fe043ed810-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201629    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmblh\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-kube-api-access-mmblh\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201639    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201647    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64472884-47d9-45ae-b5d1-89fe043ed810-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201654    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.201883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.201661    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64472884-47d9-45ae-b5d1-89fe043ed810-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:12:07.784288 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.784252    2568 generic.go:356] "Generic (PLEG): container finished" podID="64472884-47d9-45ae-b5d1-89fe043ed810" containerID="d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a" exitCode=0
Jul 24 17:12:07.784461 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.784299    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"
Jul 24 17:12:07.784461 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.784343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" event={"ID":"64472884-47d9-45ae-b5d1-89fe043ed810","Type":"ContainerDied","Data":"d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a"}
Jul 24 17:12:07.784461 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.784399    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn" event={"ID":"64472884-47d9-45ae-b5d1-89fe043ed810","Type":"ContainerDied","Data":"8c452bf96e295b2e300f11b13b7d5aeb04678e3381d9dc4db0dc1cab8920ff84"}
Jul 24 17:12:07.784461 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.784422    2568 scope.go:117] "RemoveContainer" containerID="d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a"
Jul 24 17:12:07.793669 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.793649    2568 scope.go:117] "RemoveContainer" containerID="d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a"
Jul 24 17:12:07.793963 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:12:07.793943    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a\": container with ID starting with d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a not found: ID does not exist" containerID="d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a"
Jul 24 17:12:07.794063 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.793970    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a"} err="failed to get container status \"d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a\": rpc error: code = NotFound desc = could not find container \"d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a\": container with ID starting with d88f914c7c317a62ff9fe2ec39fe8f380606431fb5329902b9b9bd858604973a not found: ID does not exist"
Jul 24 17:12:07.804861 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.804837    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"]
Jul 24 17:12:07.807487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.807465    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjgcpn"]
Jul 24 17:12:07.903928 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:12:07.903897    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" path="/var/lib/kubelet/pods/64472884-47d9-45ae-b5d1-89fe043ed810/volumes"
Jul 24 17:13:17.734358 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:13:17.734332    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:13:17.737462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:13:17.737429    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:14:22.448873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.448838    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:14:22.449301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.449161    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy"
Jul 24 17:14:22.449301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.449173    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy"
Jul 24 17:14:22.449301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.449257    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="64472884-47d9-45ae-b5d1-89fe043ed810" containerName="istio-proxy"
Jul 24 17:14:22.451293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.451273    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.453977 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.453947    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:14:22.453977 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.453953    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 17:14:22.454180 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.454010    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:14:22.454799 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.454785    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gttwz\""
Jul 24 17:14:22.465306 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.465279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:14:22.504396 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.504316    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:14:22.592506 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.592471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10a7af83-1c46-427b-96b0-8e9e05bb3bf6-config-file\") pod \"limitador-limitador-54d6d988d5-vck9n\" (UID: \"10a7af83-1c46-427b-96b0-8e9e05bb3bf6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.592697 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.592549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtj2k\" (UniqueName: \"kubernetes.io/projected/10a7af83-1c46-427b-96b0-8e9e05bb3bf6-kube-api-access-xtj2k\") pod \"limitador-limitador-54d6d988d5-vck9n\" (UID: \"10a7af83-1c46-427b-96b0-8e9e05bb3bf6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.693870 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.693833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtj2k\" (UniqueName: \"kubernetes.io/projected/10a7af83-1c46-427b-96b0-8e9e05bb3bf6-kube-api-access-xtj2k\") pod \"limitador-limitador-54d6d988d5-vck9n\" (UID: \"10a7af83-1c46-427b-96b0-8e9e05bb3bf6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.694080 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.693905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10a7af83-1c46-427b-96b0-8e9e05bb3bf6-config-file\") pod \"limitador-limitador-54d6d988d5-vck9n\" (UID: \"10a7af83-1c46-427b-96b0-8e9e05bb3bf6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.694533 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.694512    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10a7af83-1c46-427b-96b0-8e9e05bb3bf6-config-file\") pod \"limitador-limitador-54d6d988d5-vck9n\" (UID: \"10a7af83-1c46-427b-96b0-8e9e05bb3bf6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.703265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.703205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtj2k\" (UniqueName: \"kubernetes.io/projected/10a7af83-1c46-427b-96b0-8e9e05bb3bf6-kube-api-access-xtj2k\") pod \"limitador-limitador-54d6d988d5-vck9n\" (UID: \"10a7af83-1c46-427b-96b0-8e9e05bb3bf6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.761856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.761817    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:22.901462 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:22.901423    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:14:22.905015 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:14:22.904990    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a7af83_1c46_427b_96b0_8e9e05bb3bf6.slice/crio-ee1b70282506e800537a165eb150e305008b4e89c4865241ae9f9c4cf9f800cc WatchSource:0}: Error finding container ee1b70282506e800537a165eb150e305008b4e89c4865241ae9f9c4cf9f800cc: Status 404 returned error can't find the container with id ee1b70282506e800537a165eb150e305008b4e89c4865241ae9f9c4cf9f800cc
Jul 24 17:14:23.403794 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:23.403757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n" event={"ID":"10a7af83-1c46-427b-96b0-8e9e05bb3bf6","Type":"ContainerStarted","Data":"ee1b70282506e800537a165eb150e305008b4e89c4865241ae9f9c4cf9f800cc"}
Jul 24 17:14:25.413768 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:25.413740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n" event={"ID":"10a7af83-1c46-427b-96b0-8e9e05bb3bf6","Type":"ContainerStarted","Data":"2c6944616ceda512bf66898d399f078700a3f24f0b365d3d607bb5f59f429034"}
Jul 24 17:14:25.414145 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:25.413886    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:14:25.434875 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:25.434824    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n" podStartSLOduration=0.996641003 podStartE2EDuration="3.43480782s" totalImagesPullingTime="2.438166817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:14:25.432212877 +0000 UTC m=+668.147366663" watchObservedRunningTime="2026-07-24 17:14:25.43480782 +0000 UTC m=+668.149961607"
Jul 24 17:14:36.425165 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:14:36.425135    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vck9n"
Jul 24 17:15:33.926685 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:15:33.926608    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:16:05.566284 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:16:05.566250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:16:28.845864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:16:28.845826    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:16:44.748729 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:16:44.748634    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:16:53.645867 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:16:53.645832    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:17:04.548457 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.548423    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"]
Jul 24 17:17:04.552131 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.552115    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.555469 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.555439    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:17:04.555612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.555476    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 24 17:17:04.555612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.555485    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6kmdn\""
Jul 24 17:17:04.555612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.555554    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:17:04.561958 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.561937    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"]
Jul 24 17:17:04.685576 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.685534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.685576 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.685571    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqx6k\" (UniqueName: \"kubernetes.io/projected/545cf848-00b3-4654-adfa-a5a4620fc0bd-kube-api-access-zqx6k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.685847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.685598    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545cf848-00b3-4654-adfa-a5a4620fc0bd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.685847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.685645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.685847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.685743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.685847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.685782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.786958 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.786920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqx6k\" (UniqueName: \"kubernetes.io/projected/545cf848-00b3-4654-adfa-a5a4620fc0bd-kube-api-access-zqx6k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545cf848-00b3-4654-adfa-a5a4620fc0bd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787583 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.787622 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.787578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.789212 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.789188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545cf848-00b3-4654-adfa-a5a4620fc0bd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.789489 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.789470    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545cf848-00b3-4654-adfa-a5a4620fc0bd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.795539 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.795511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqx6k\" (UniqueName: \"kubernetes.io/projected/545cf848-00b3-4654-adfa-a5a4620fc0bd-kube-api-access-zqx6k\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-74h9f\" (UID: \"545cf848-00b3-4654-adfa-a5a4620fc0bd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:04.862255 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:04.862150    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:05.002149 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:05.002005    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"]
Jul 24 17:17:05.004485 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:17:05.004457    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545cf848_00b3_4654_adfa_a5a4620fc0bd.slice/crio-eb6b1816796e979d3c168166a8108dbb50117b35c37a5c52afb89475273fd85c WatchSource:0}: Error finding container eb6b1816796e979d3c168166a8108dbb50117b35c37a5c52afb89475273fd85c: Status 404 returned error can't find the container with id eb6b1816796e979d3c168166a8108dbb50117b35c37a5c52afb89475273fd85c
Jul 24 17:17:05.005805 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:05.005784    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:17:05.100431 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:05.100391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f" event={"ID":"545cf848-00b3-4654-adfa-a5a4620fc0bd","Type":"ContainerStarted","Data":"eb6b1816796e979d3c168166a8108dbb50117b35c37a5c52afb89475273fd85c"}
Jul 24 17:17:07.109984 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:07.109947    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f" event={"ID":"545cf848-00b3-4654-adfa-a5a4620fc0bd","Type":"ContainerStarted","Data":"129fcc7eee693413aa704f2d81a1da995768fc5304cb79460506ba6d80f80397"}
Jul 24 17:17:07.128691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:07.128634    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f" podStartSLOduration=2.051596537 podStartE2EDuration="3.128617571s" totalImagesPullingTime="1.077021034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:07.126603327 +0000 UTC m=+829.841757114" watchObservedRunningTime="2026-07-24 17:17:07.128617571 +0000 UTC m=+829.843771356"
Jul 24 17:17:07.256148 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:07.256111    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:17:14.862680 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:14.862636    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:14.863192 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:14.862999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:14.875516 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:14.875491    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:15.155700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:15.155670    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-74h9f"
Jul 24 17:17:22.947945 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:17:22.947908    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:18:17.769513 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:18:17.769444    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:18:17.769513 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:18:17.769448    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:18:50.750670 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:18:50.750634    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:19:00.953836 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:19:00.953799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:19:10.648404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:19:10.648366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:20:49.853975 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:20:49.853941    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:21:02.040799 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:21:02.040758    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:21:37.046440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:21:37.046357    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:21:46.646631 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:21:46.646595    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:21:55.783913 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:21:55.783878    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:22:07.239023 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:22:07.238985    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:22:16.351433 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:22:16.351396    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:22:25.751266 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:22:25.751230    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:22:38.551231 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:22:38.551199    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:22:48.667286 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:22:48.667252    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:23:10.343869 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:23:10.343836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:23:17.796810 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:23:17.796772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:23:17.797391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:23:17.797368    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:23:20.746527 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:23:20.746491    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:23:44.946076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:23:44.946040    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:23:55.945466 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:23:55.945423    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:24:02.447467 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:24:02.447432    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:24:14.545308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:24:14.545228    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:24:23.747802 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:24:23.747765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:24:42.151475 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:24:42.151440    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:24:52.348637 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:24:52.348602    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:26:41.849612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:26:41.849573    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:26:51.141224 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:26:51.141184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:27:04.543568 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:27:04.543526    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:27:18.069156 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:27:18.069073    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:27:28.943161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:27:28.943123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:27:38.310859 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:27:38.310821    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:27:45.961448 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:27:45.961413    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:27:57.447484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:27:57.447442    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:28:09.387856 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:28:09.387821    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:28:17.821467 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:28:17.821438    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:28:17.826113 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:28:17.826082    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:28:17.837666 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:28:17.837634    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:28:28.597671 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:28:28.597637    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:28:52.846229 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:28:52.846146    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:29:00.252611 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:00.252577    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:29:11.063420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:11.063377    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:29:13.457842 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.455445    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"]
Jul 24 17:29:13.461384 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.460006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.463435 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.463404    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-8c26ce9e-kserve-self-signed-certs\""
Jul 24 17:29:13.475837 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.475809    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"]
Jul 24 17:29:13.541306 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.541267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-dshm\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.541484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.541312    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvcnk\" (UniqueName: \"kubernetes.io/projected/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-kube-api-access-zvcnk\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.541484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.541380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tmp-dir\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.541484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.541416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tls-certs\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.541484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.541465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-home\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.541484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.541480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-model-cache\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.642678 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.642640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-dshm\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.642678 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.642683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvcnk\" (UniqueName: \"kubernetes.io/projected/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-kube-api-access-zvcnk\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.642929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.642709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tmp-dir\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.642929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.642774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tls-certs\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.642929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.642808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-home\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.642929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.642823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-model-cache\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.643225 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.643197    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-model-cache\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.643351 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.643234    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tmp-dir\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.643351 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.643262    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-home\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.645017 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.644990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-dshm\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.645119 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.645091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tls-certs\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.663426 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.663401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvcnk\" (UniqueName: \"kubernetes.io/projected/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-kube-api-access-zvcnk\") pod \"e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") " pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.771846 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.771749    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:13.910444 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:13.910420    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"]
Jul 24 17:29:13.912946 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:29:13.912908    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e49a6fd_405c_4d9e_a0bd_8eb8e20c88a9.slice/crio-96269fe34760ff3c145bf8283ca2cba42d2b2e061c5a1655b0aa7f4e0a1a78c0 WatchSource:0}: Error finding container 96269fe34760ff3c145bf8283ca2cba42d2b2e061c5a1655b0aa7f4e0a1a78c0: Status 404 returned error can't find the container with id 96269fe34760ff3c145bf8283ca2cba42d2b2e061c5a1655b0aa7f4e0a1a78c0
Jul 24 17:29:14.305199 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:14.305160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9" event={"ID":"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9","Type":"ContainerStarted","Data":"b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc"}
Jul 24 17:29:14.305199 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:14.305205    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9" event={"ID":"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9","Type":"ContainerStarted","Data":"96269fe34760ff3c145bf8283ca2cba42d2b2e061c5a1655b0aa7f4e0a1a78c0"}
Jul 24 17:29:14.323581 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:14.323431    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9" podStartSLOduration=1.3234117699999999 podStartE2EDuration="1.32341177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:14.323145726 +0000 UTC m=+1557.038299524" watchObservedRunningTime="2026-07-24 17:29:14.32341177 +0000 UTC m=+1557.038565556"
Jul 24 17:29:23.772869 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:23.772821    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:23.773283 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:23.772888    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:23.785474 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:23.785442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:24.363012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:24.362978    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:27.545047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:27.545006    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:29:33.974086 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:33.974053    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"]
Jul 24 17:29:38.159072 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:38.159041    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:29:48.993134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:48.993075    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9" podUID="7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" containerName="main" containerID="cri-o://b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc" gracePeriod=45
Jul 24 17:29:49.246778 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.246703    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:49.256857 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.256839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-dshm\") pod \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") "
Jul 24 17:29:49.256948 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.256890    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-model-cache\") pod \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") "
Jul 24 17:29:49.256948 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.256923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tmp-dir\") pod \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") "
Jul 24 17:29:49.256948 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.256943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tls-certs\") pod \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") "
Jul 24 17:29:49.257084 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.256972    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-home\") pod \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") "
Jul 24 17:29:49.257084 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.257006    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvcnk\" (UniqueName: \"kubernetes.io/projected/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-kube-api-access-zvcnk\") pod \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\" (UID: \"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9\") "
Jul 24 17:29:49.257233 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.257202    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" (UID: "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:29:49.257349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.257210    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" (UID: "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:29:49.257349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.257326    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-home" (OuterVolumeSpecName: "home") pod "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" (UID: "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:29:49.259227 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.259192    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-kube-api-access-zvcnk" (OuterVolumeSpecName: "kube-api-access-zvcnk") pod "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" (UID: "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9"). InnerVolumeSpecName "kube-api-access-zvcnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:29:49.259311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.259201    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" (UID: "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:29:49.259311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.259203    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-dshm" (OuterVolumeSpecName: "dshm") pod "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" (UID: "7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:29:49.357585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.357549    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-dshm\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:29:49.357585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.357577    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-model-cache\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:29:49.357585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.357586    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tmp-dir\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:29:49.357585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.357594    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-tls-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:29:49.357880 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.357601    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-home\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:29:49.357880 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.357610    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvcnk\" (UniqueName: \"kubernetes.io/projected/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9-kube-api-access-zvcnk\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:29:49.464971 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.464941    2568 generic.go:356] "Generic (PLEG): container finished" podID="7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" containerID="b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc" exitCode=0
Jul 24 17:29:49.465167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.464983    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"
Jul 24 17:29:49.465167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.465026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9" event={"ID":"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9","Type":"ContainerDied","Data":"b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc"}
Jul 24 17:29:49.465167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.465072    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9" event={"ID":"7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9","Type":"ContainerDied","Data":"96269fe34760ff3c145bf8283ca2cba42d2b2e061c5a1655b0aa7f4e0a1a78c0"}
Jul 24 17:29:49.465167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.465093    2568 scope.go:117] "RemoveContainer" containerID="b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc"
Jul 24 17:29:49.474255 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.474239    2568 scope.go:117] "RemoveContainer" containerID="b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc"
Jul 24 17:29:49.474529 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:29:49.474510    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc\": container with ID starting with b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc not found: ID does not exist" containerID="b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc"
Jul 24 17:29:49.474583 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.474539    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc"} err="failed to get container status \"b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc\": rpc error: code = NotFound desc = could not find container \"b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc\": container with ID starting with b9f6652854f8ccbd47669a5207f31c61fc43bbe3d9ce260af254b96197e1f2dc not found: ID does not exist"
Jul 24 17:29:49.487427 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.487398    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"]
Jul 24 17:29:49.491793 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.491770    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-8c26ce9e-kserve-c67874b67-lktx9"]
Jul 24 17:29:49.904762 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.904705    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" path="/var/lib/kubelet/pods/7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9/volumes"
Jul 24 17:29:49.957640 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:49.957602    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:29:59.554513 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:29:59.554460    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:30:00.146880 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.146847    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"]
Jul 24 17:30:00.147224 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.147210    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" containerName="main"
Jul 24 17:30:00.147224 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.147225    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" containerName="main"
Jul 24 17:30:00.147316 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.147309    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e49a6fd-405c-4d9e-a0bd-8eb8e20c88a9" containerName="main"
Jul 24 17:30:00.151683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.151662    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"
Jul 24 17:30:00.154422 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.154399    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:30:00.158778 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.158753    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"]
Jul 24 17:30:00.162689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.162667    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"
Jul 24 17:30:00.294393 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.294347    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"]
Jul 24 17:30:00.297379 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:30:00.297341    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ef64dc_8ba2_494a_9a21_88c8a5eda429.slice/crio-84117f2ad968db85bf31576529015b74ca4d99867afad29e5799979aa598d22e WatchSource:0}: Error finding container 84117f2ad968db85bf31576529015b74ca4d99867afad29e5799979aa598d22e: Status 404 returned error can't find the container with id 84117f2ad968db85bf31576529015b74ca4d99867afad29e5799979aa598d22e
Jul 24 17:30:00.299322 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.299307    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:30:00.520145 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:00.520064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx" event={"ID":"46ef64dc-8ba2-494a-9a21-88c8a5eda429","Type":"ContainerStarted","Data":"84117f2ad968db85bf31576529015b74ca4d99867afad29e5799979aa598d22e"}
Jul 24 17:30:03.537645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:03.537616    2568 generic.go:356] "Generic (PLEG): container finished" podID="46ef64dc-8ba2-494a-9a21-88c8a5eda429" containerID="042efc99a3bf44e9a99455988d24a42b4dcda54935dc6c2c05d9003936159de9" exitCode=0
Jul 24 17:30:03.538040 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:03.537707    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx" event={"ID":"46ef64dc-8ba2-494a-9a21-88c8a5eda429","Type":"ContainerDied","Data":"042efc99a3bf44e9a99455988d24a42b4dcda54935dc6c2c05d9003936159de9"}
Jul 24 17:30:04.671671 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:04.671648    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"
Jul 24 17:30:05.547949 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:05.547915    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx"
Jul 24 17:30:05.548203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:05.547947    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748570-249jx" event={"ID":"46ef64dc-8ba2-494a-9a21-88c8a5eda429","Type":"ContainerDied","Data":"84117f2ad968db85bf31576529015b74ca4d99867afad29e5799979aa598d22e"}
Jul 24 17:30:05.548203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:05.548015    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84117f2ad968db85bf31576529015b74ca4d99867afad29e5799979aa598d22e"
Jul 24 17:30:12.159842 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:12.159759    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:30:21.950871 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:21.950833    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:30:31.348437 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:31.348398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:30:39.541285 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:39.541248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:30:47.839441 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:47.839403    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:30:58.746438 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:30:58.746399    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:31:12.561500 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:31:12.561465    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:31:21.847996 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:31:21.847957    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:31:31.447604 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:31:31.447566    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:31:41.046677 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:31:41.046598    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:31:53.751694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:31:53.751661    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:32:02.969975 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:32:02.969940    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:32:15.351700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:32:15.351662    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:32:26.248282 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:32:26.248248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:32:35.752834 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:32:35.752801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:32:44.150129 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:32:44.150093    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:32:57.945576 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:32:57.945539    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:33:06.586846 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:06.586811    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:33:16.746983 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:16.746945    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:33:17.680867 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.680831    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"]
Jul 24 17:33:17.681352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.681332    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ef64dc-8ba2-494a-9a21-88c8a5eda429" containerName="cleanup"
Jul 24 17:33:17.681459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.681353    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ef64dc-8ba2-494a-9a21-88c8a5eda429" containerName="cleanup"
Jul 24 17:33:17.681459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.681455    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ef64dc-8ba2-494a-9a21-88c8a5eda429" containerName="cleanup"
Jul 24 17:33:17.687275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.687250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.690249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.690223    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f231d414-openshift-default-dockercfg-x2fk8\""
Jul 24 17:33:17.717692 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.717657    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"]
Jul 24 17:33:17.780128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-certs\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-credential-socket\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-data\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-token\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7680e88-8955-44d9-a0ea-5e06101e9e12-istiod-ca-cert\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqhp\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-kube-api-access-kbqhp\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-envoy\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780397    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-podinfo\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.780520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.780424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-socket\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.855803 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.855776    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:33:17.860004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.859978    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:33:17.881019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.880990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-podinfo\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881214 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-socket\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881214 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-certs\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-credential-socket\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-data\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-token\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7680e88-8955-44d9-a0ea-5e06101e9e12-istiod-ca-cert\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqhp\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-kube-api-access-kbqhp\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-envoy\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-socket\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-certs\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881550    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-credential-socket\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.881926 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.881906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-data\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.882028 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.882011    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7680e88-8955-44d9-a0ea-5e06101e9e12-istiod-ca-cert\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.883586 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.883561    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-envoy\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.883702 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.883567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-podinfo\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.890778 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.890753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqhp\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-kube-api-access-kbqhp\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:17.891891 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.891867    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-token\") pod \"e2e-ait-f231d414-openshift-default-854d489498-2bfxz\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") " pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:18.000041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:17.999950    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:18.194927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.194904    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"]
Jul 24 17:33:18.197256 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:33:18.197227    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7680e88_8955_44d9_a0ea_5e06101e9e12.slice/crio-49819dc102ee7348f59660b31769b1339aa76d632965860307962e5e4921630f WatchSource:0}: Error finding container 49819dc102ee7348f59660b31769b1339aa76d632965860307962e5e4921630f: Status 404 returned error can't find the container with id 49819dc102ee7348f59660b31769b1339aa76d632965860307962e5e4921630f
Jul 24 17:33:18.199180 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.199147    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:33:18.199246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.199211    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:33:18.199246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.199237    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:33:18.399749 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.399689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" event={"ID":"c7680e88-8955-44d9-a0ea-5e06101e9e12","Type":"ContainerStarted","Data":"52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"}
Jul 24 17:33:18.399930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.399776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" event={"ID":"c7680e88-8955-44d9-a0ea-5e06101e9e12","Type":"ContainerStarted","Data":"49819dc102ee7348f59660b31769b1339aa76d632965860307962e5e4921630f"}
Jul 24 17:33:18.427962 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:18.427894    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podStartSLOduration=1.427871504 podStartE2EDuration="1.427871504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:33:18.42705435 +0000 UTC m=+1801.142208153" watchObservedRunningTime="2026-07-24 17:33:18.427871504 +0000 UTC m=+1801.143025291"
Jul 24 17:33:19.001213 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:19.001167    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:19.002743 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:19.002703    2568 patch_prober.go:28] interesting pod/e2e-ait-f231d414-openshift-default-854d489498-2bfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 24 17:33:19.002857 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:19.002773    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 24 17:33:20.005591 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:20.005561    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:20.409707 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:20.409676    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:20.410648 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:20.410630    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:27.152912 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:27.152873    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:33:35.411814 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.411779    2568 patch_prober.go:28] interesting pod/e2e-ait-f231d414-openshift-default-854d489498-2bfxz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 24 17:33:35.412223 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.411847    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 24 17:33:35.488680 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.488647    2568 generic.go:356] "Generic (PLEG): container finished" podID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerID="52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c" exitCode=0
Jul 24 17:33:35.488865 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.488706    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" event={"ID":"c7680e88-8955-44d9-a0ea-5e06101e9e12","Type":"ContainerDied","Data":"52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"}
Jul 24 17:33:35.489092 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.489079    2568 scope.go:117] "RemoveContainer" containerID="52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"
Jul 24 17:33:35.490124 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.490095    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:33:35.490187 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.490175    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:33:35.490229 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:35.490212    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:33:36.495195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:36.495157    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" event={"ID":"c7680e88-8955-44d9-a0ea-5e06101e9e12","Type":"ContainerStarted","Data":"4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca"}
Jul 24 17:33:37.001214 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:37.001174    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:37.001429 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:37.001411    2568 patch_prober.go:28] interesting pod/e2e-ait-f231d414-openshift-default-854d489498-2bfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 24 17:33:37.001476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:37.001455    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 24 17:33:38.000442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:38.000397    2568 patch_prober.go:28] interesting pod/e2e-ait-f231d414-openshift-default-854d489498-2bfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 24 17:33:38.000872 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:38.000470    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 24 17:33:39.000741 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:39.000682    2568 patch_prober.go:28] interesting pod/e2e-ait-f231d414-openshift-default-854d489498-2bfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 24 17:33:39.001138 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:39.000780    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 24 17:33:40.000459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:40.000422    2568 patch_prober.go:28] interesting pod/e2e-ait-f231d414-openshift-default-854d489498-2bfxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 24 17:33:40.000650 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:40.000487    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 24 17:33:41.004342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:41.004309    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:41.004836 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:41.004637    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:41.005401 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:41.005381    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:33:45.357954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.357921    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"]
Jul 24 17:33:45.360394 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.360377    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:45.362815 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.362792    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:33:45.362908 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.362798    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:33:45.368382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.368330    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"]
Jul 24 17:33:45.444011 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.443966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcdb15b-c836-4057-88dd-b5a2aa7ac175-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f231d414-dxksd\" (UID: \"5dcdb15b-c836-4057-88dd-b5a2aa7ac175\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:45.544930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.544894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcdb15b-c836-4057-88dd-b5a2aa7ac175-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f231d414-dxksd\" (UID: \"5dcdb15b-c836-4057-88dd-b5a2aa7ac175\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:45.545501 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.545480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcdb15b-c836-4057-88dd-b5a2aa7ac175-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f231d414-dxksd\" (UID: \"5dcdb15b-c836-4057-88dd-b5a2aa7ac175\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:45.672406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.672349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:45.804746 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:45.804681    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"]
Jul 24 17:33:45.807024 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:33:45.806997    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcdb15b_c836_4057_88dd_b5a2aa7ac175.slice/crio-62f1612c200889dc7cf703db45a6d40598c38f709b2f508ef2875e229530e14d WatchSource:0}: Error finding container 62f1612c200889dc7cf703db45a6d40598c38f709b2f508ef2875e229530e14d: Status 404 returned error can't find the container with id 62f1612c200889dc7cf703db45a6d40598c38f709b2f508ef2875e229530e14d
Jul 24 17:33:46.543219 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:46.543193    2568 generic.go:356] "Generic (PLEG): container finished" podID="5dcdb15b-c836-4057-88dd-b5a2aa7ac175" containerID="8062c93106ad316e6b8628aa072a211c58e973303b8a60ecbc5d49e590ef229d" exitCode=0
Jul 24 17:33:46.543585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:46.543253    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd" event={"ID":"5dcdb15b-c836-4057-88dd-b5a2aa7ac175","Type":"ContainerDied","Data":"8062c93106ad316e6b8628aa072a211c58e973303b8a60ecbc5d49e590ef229d"}
Jul 24 17:33:46.543585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:46.543326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd" event={"ID":"5dcdb15b-c836-4057-88dd-b5a2aa7ac175","Type":"ContainerStarted","Data":"62f1612c200889dc7cf703db45a6d40598c38f709b2f508ef2875e229530e14d"}
Jul 24 17:33:47.680558 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:47.680530    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:47.766467 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:47.766432    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcdb15b-c836-4057-88dd-b5a2aa7ac175-maas-api-service-ca\") pod \"5dcdb15b-c836-4057-88dd-b5a2aa7ac175\" (UID: \"5dcdb15b-c836-4057-88dd-b5a2aa7ac175\") "
Jul 24 17:33:47.766839 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:47.766818    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dcdb15b-c836-4057-88dd-b5a2aa7ac175-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5dcdb15b-c836-4057-88dd-b5a2aa7ac175" (UID: "5dcdb15b-c836-4057-88dd-b5a2aa7ac175"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:33:47.867399 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:47.867314    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dcdb15b-c836-4057-88dd-b5a2aa7ac175-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:33:48.552898 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:48.552867    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"
Jul 24 17:33:48.553093 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:48.552863    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd" event={"ID":"5dcdb15b-c836-4057-88dd-b5a2aa7ac175","Type":"ContainerDied","Data":"62f1612c200889dc7cf703db45a6d40598c38f709b2f508ef2875e229530e14d"}
Jul 24 17:33:48.553093 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:48.553003    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62f1612c200889dc7cf703db45a6d40598c38f709b2f508ef2875e229530e14d"
Jul 24 17:33:58.665473 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:33:58.665436    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:34:00.442414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:00.442376    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"]
Jul 24 17:34:00.444927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:00.444899    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f231d414-dxksd"]
Jul 24 17:34:00.587407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:00.587363    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"]
Jul 24 17:34:00.587726 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:00.587660    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy" containerID="cri-o://4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca" gracePeriod=30
Jul 24 17:34:01.904435 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:01.904400    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dcdb15b-c836-4057-88dd-b5a2aa7ac175" path="/var/lib/kubelet/pods/5dcdb15b-c836-4057-88dd-b5a2aa7ac175/volumes"
Jul 24 17:34:05.841173 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.841140    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:34:05.937522 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937489    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7680e88-8955-44d9-a0ea-5e06101e9e12-istiod-ca-cert\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937522 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-podinfo\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937566    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-certs\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-data\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937608    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbqhp\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-kube-api-access-kbqhp\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937648    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-credential-socket\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937666    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-token\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937687    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-socket\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.937827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-envoy\") pod \"c7680e88-8955-44d9-a0ea-5e06101e9e12\" (UID: \"c7680e88-8955-44d9-a0ea-5e06101e9e12\") "
Jul 24 17:34:05.938163 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.937913    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:05.938163 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.938035    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:05.938163 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.938119    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:05.938308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.938155    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7680e88-8955-44d9-a0ea-5e06101e9e12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:05.938387 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.938362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:05.938642 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.938621    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:05.940342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.940314    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:34:05.940429 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.940383    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:34:05.940475 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.940426    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:05.940475 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:05.940431    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-kube-api-access-kbqhp" (OuterVolumeSpecName: "kube-api-access-kbqhp") pod "c7680e88-8955-44d9-a0ea-5e06101e9e12" (UID: "c7680e88-8955-44d9-a0ea-5e06101e9e12"). InnerVolumeSpecName "kube-api-access-kbqhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:34:06.039302 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039268    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7680e88-8955-44d9-a0ea-5e06101e9e12-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039302 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039293    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039302 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039302    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039302 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039311    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbqhp\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-kube-api-access-kbqhp\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039554 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039322    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039554 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039330    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039554 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039338    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.039554 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.039346    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7680e88-8955-44d9-a0ea-5e06101e9e12-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:06.636970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.636940    2568 generic.go:356] "Generic (PLEG): container finished" podID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerID="4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca" exitCode=0
Jul 24 17:34:06.637177 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.637006    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"
Jul 24 17:34:06.637177 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.637022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" event={"ID":"c7680e88-8955-44d9-a0ea-5e06101e9e12","Type":"ContainerDied","Data":"4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca"}
Jul 24 17:34:06.637177 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.637083    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz" event={"ID":"c7680e88-8955-44d9-a0ea-5e06101e9e12","Type":"ContainerDied","Data":"49819dc102ee7348f59660b31769b1339aa76d632965860307962e5e4921630f"}
Jul 24 17:34:06.637177 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.637115    2568 scope.go:117] "RemoveContainer" containerID="4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca"
Jul 24 17:34:06.646970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.646953    2568 scope.go:117] "RemoveContainer" containerID="52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"
Jul 24 17:34:06.654745 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.654727    2568 scope.go:117] "RemoveContainer" containerID="4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca"
Jul 24 17:34:06.655033 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:34:06.655014    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca\": container with ID starting with 4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca not found: ID does not exist" containerID="4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca"
Jul 24 17:34:06.655087 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.655043    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca"} err="failed to get container status \"4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca\": rpc error: code = NotFound desc = could not find container \"4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca\": container with ID starting with 4a8595f773c2698415561e3c6d217fb9bdbe12702e754c76c46affac6b785bca not found: ID does not exist"
Jul 24 17:34:06.655087 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.655059    2568 scope.go:117] "RemoveContainer" containerID="52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"
Jul 24 17:34:06.655327 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:34:06.655307    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c\": container with ID starting with 52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c not found: ID does not exist" containerID="52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"
Jul 24 17:34:06.655380 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.655336    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c"} err="failed to get container status \"52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c\": rpc error: code = NotFound desc = could not find container \"52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c\": container with ID starting with 52f6831b7224210dc0265715a7d0739d4f4f9349cd7bc3078c21631d039cf55c not found: ID does not exist"
Jul 24 17:34:06.660119 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.660096    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"]
Jul 24 17:34:06.665213 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:06.665188    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f231d414-openshift-default-854d489498-2bfxz"]
Jul 24 17:34:07.904436 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:07.904397    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" path="/var/lib/kubelet/pods/c7680e88-8955-44d9-a0ea-5e06101e9e12/volumes"
Jul 24 17:34:09.852030 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:09.851989    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:34:29.315637 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.315602    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"]
Jul 24 17:34:29.316043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.315972    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy"
Jul 24 17:34:29.316043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.315986    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy"
Jul 24 17:34:29.316043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316002    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy"
Jul 24 17:34:29.316043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316008    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy"
Jul 24 17:34:29.316043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316021    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dcdb15b-c836-4057-88dd-b5a2aa7ac175" containerName="revoke-keys"
Jul 24 17:34:29.316043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316026    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dcdb15b-c836-4057-88dd-b5a2aa7ac175" containerName="revoke-keys"
Jul 24 17:34:29.316234 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316079    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy"
Jul 24 17:34:29.316234 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316086    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7680e88-8955-44d9-a0ea-5e06101e9e12" containerName="istio-proxy"
Jul 24 17:34:29.316234 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.316093    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dcdb15b-c836-4057-88dd-b5a2aa7ac175" containerName="revoke-keys"
Jul 24 17:34:29.318244 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.318228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:29.320765 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.320745    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:34:29.320909 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.320849    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:34:29.327537 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.327503    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"]
Jul 24 17:34:29.451875 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.451835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f5021a-9dc7-49b3-a0ec-41a08a68584b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc\" (UID: \"a4f5021a-9dc7-49b3-a0ec-41a08a68584b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:29.553195 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.553158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f5021a-9dc7-49b3-a0ec-41a08a68584b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc\" (UID: \"a4f5021a-9dc7-49b3-a0ec-41a08a68584b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:29.553826 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.553801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f5021a-9dc7-49b3-a0ec-41a08a68584b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc\" (UID: \"a4f5021a-9dc7-49b3-a0ec-41a08a68584b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:29.629380 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.629298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:29.766704 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:29.766637    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"]
Jul 24 17:34:29.769331 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:34:29.769304    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f5021a_9dc7_49b3_a0ec_41a08a68584b.slice/crio-3649bd9a6bc732a0fd96b10b6f6800d0e8a8a0ce112e0b51ca5d718c6bb7ddfa WatchSource:0}: Error finding container 3649bd9a6bc732a0fd96b10b6f6800d0e8a8a0ce112e0b51ca5d718c6bb7ddfa: Status 404 returned error can't find the container with id 3649bd9a6bc732a0fd96b10b6f6800d0e8a8a0ce112e0b51ca5d718c6bb7ddfa
Jul 24 17:34:30.747101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:30.747003    2568 generic.go:356] "Generic (PLEG): container finished" podID="a4f5021a-9dc7-49b3-a0ec-41a08a68584b" containerID="024097049d418bc538de381406cb9bf96cb78cdd293ef34cf1f56a547d8a415f" exitCode=0
Jul 24 17:34:30.747101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:30.747056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc" event={"ID":"a4f5021a-9dc7-49b3-a0ec-41a08a68584b","Type":"ContainerDied","Data":"024097049d418bc538de381406cb9bf96cb78cdd293ef34cf1f56a547d8a415f"}
Jul 24 17:34:30.747101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:30.747099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc" event={"ID":"a4f5021a-9dc7-49b3-a0ec-41a08a68584b","Type":"ContainerStarted","Data":"3649bd9a6bc732a0fd96b10b6f6800d0e8a8a0ce112e0b51ca5d718c6bb7ddfa"}
Jul 24 17:34:31.882871 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:31.882846    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:31.975875 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:31.975842    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f5021a-9dc7-49b3-a0ec-41a08a68584b-maas-api-service-ca\") pod \"a4f5021a-9dc7-49b3-a0ec-41a08a68584b\" (UID: \"a4f5021a-9dc7-49b3-a0ec-41a08a68584b\") "
Jul 24 17:34:31.976221 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:31.976199    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4f5021a-9dc7-49b3-a0ec-41a08a68584b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4f5021a-9dc7-49b3-a0ec-41a08a68584b" (UID: "a4f5021a-9dc7-49b3-a0ec-41a08a68584b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:34:32.076442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:32.076376    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f5021a-9dc7-49b3-a0ec-41a08a68584b-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:34:32.757399 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:32.757360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc" event={"ID":"a4f5021a-9dc7-49b3-a0ec-41a08a68584b","Type":"ContainerDied","Data":"3649bd9a6bc732a0fd96b10b6f6800d0e8a8a0ce112e0b51ca5d718c6bb7ddfa"}
Jul 24 17:34:32.757399 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:32.757400    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"
Jul 24 17:34:32.757668 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:32.757436    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3649bd9a6bc732a0fd96b10b6f6800d0e8a8a0ce112e0b51ca5d718c6bb7ddfa"
Jul 24 17:34:42.946535 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:42.946453    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:34:44.405047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:44.405008    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"]
Jul 24 17:34:44.411627 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:44.411595    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3f26bc98-ldfzc"]
Jul 24 17:34:45.487237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.487200    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"]
Jul 24 17:34:45.487789 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.487773    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f5021a-9dc7-49b3-a0ec-41a08a68584b" containerName="revoke-keys"
Jul 24 17:34:45.487840 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.487793    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f5021a-9dc7-49b3-a0ec-41a08a68584b" containerName="revoke-keys"
Jul 24 17:34:45.487907 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.487896    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f5021a-9dc7-49b3-a0ec-41a08a68584b" containerName="revoke-keys"
Jul 24 17:34:45.490250 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.490234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.495209 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.495183    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-74f5d728-openshift-default-dockercfg-p4cfw\""
Jul 24 17:34:45.521202 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.521172    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"]
Jul 24 17:34:45.599132 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-socket\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-certs\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-envoy\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599311 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-data\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599308    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-podinfo\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-token\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599392    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee82d672-fc49-48d4-a814-6248a960a4f1-istiod-ca-cert\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599523 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599443    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-credential-socket\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.599523 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.599504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9chfz\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-kube-api-access-9chfz\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.700818 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9chfz\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-kube-api-access-9chfz\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-socket\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-certs\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-envoy\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700898    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-data\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-podinfo\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-token\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.700986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee82d672-fc49-48d4-a814-6248a960a4f1-istiod-ca-cert\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701271 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.701022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-credential-socket\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701351 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.701330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-certs\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701413 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.701314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-socket\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701548 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.701527    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-credential-socket\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701630 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.701613    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-data\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.701898 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.701881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee82d672-fc49-48d4-a814-6248a960a4f1-istiod-ca-cert\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.703371 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.703336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-envoy\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.703525 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.703499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-podinfo\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.709500 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.709470    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-token\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.709640 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.709621    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9chfz\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-kube-api-access-9chfz\") pod \"e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") " pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.800264 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.800165    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:45.906056 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.906022    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f5021a-9dc7-49b3-a0ec-41a08a68584b" path="/var/lib/kubelet/pods/a4f5021a-9dc7-49b3-a0ec-41a08a68584b/volumes"
Jul 24 17:34:45.945767 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.945640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"]
Jul 24 17:34:45.949736 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:34:45.949689    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee82d672_fc49_48d4_a814_6248a960a4f1.slice/crio-ea18699e125b1b8a4ca6235303f415be168d8abfd7d343b7bb740f119b6b2528 WatchSource:0}: Error finding container ea18699e125b1b8a4ca6235303f415be168d8abfd7d343b7bb740f119b6b2528: Status 404 returned error can't find the container with id ea18699e125b1b8a4ca6235303f415be168d8abfd7d343b7bb740f119b6b2528
Jul 24 17:34:45.955879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.952401    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:34:45.955879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.952554    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:34:45.955879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:45.952660    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:34:46.821881 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:46.821841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" event={"ID":"ee82d672-fc49-48d4-a814-6248a960a4f1","Type":"ContainerStarted","Data":"6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"}
Jul 24 17:34:46.822285 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:46.821925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" event={"ID":"ee82d672-fc49-48d4-a814-6248a960a4f1","Type":"ContainerStarted","Data":"ea18699e125b1b8a4ca6235303f415be168d8abfd7d343b7bb740f119b6b2528"}
Jul 24 17:34:46.841466 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:46.841416    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" podStartSLOduration=1.841400938 podStartE2EDuration="1.841400938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:34:46.840295136 +0000 UTC m=+1889.555448923" watchObservedRunningTime="2026-07-24 17:34:46.841400938 +0000 UTC m=+1889.556554724"
Jul 24 17:34:47.800557 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:47.800514    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:47.805479 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:47.805454    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:47.828291 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:47.828251    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:47.829229 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:47.829209    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:34:54.043051 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:34:54.043007    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:35:01.897176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:01.897128    2568 generic.go:356] "Generic (PLEG): container finished" podID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerID="6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207" exitCode=0
Jul 24 17:35:01.897705 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:01.897204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" event={"ID":"ee82d672-fc49-48d4-a814-6248a960a4f1","Type":"ContainerDied","Data":"6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"}
Jul 24 17:35:01.897808 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:01.897755    2568 scope.go:117] "RemoveContainer" containerID="6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"
Jul 24 17:35:01.898854 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:01.898825    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:35:01.898953 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:01.898889    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:35:01.898953 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:01.898919    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:35:02.829084 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:02.829036    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:02.903782 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:02.903744    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" event={"ID":"ee82d672-fc49-48d4-a814-6248a960a4f1","Type":"ContainerStarted","Data":"11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791"}
Jul 24 17:35:03.801204 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:03.801165    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:03.802386 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:03.802358    2568 patch_prober.go:28] interesting pod/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 17:35:03.802508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:03.802408    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 17:35:04.801045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:04.801005    2568 patch_prober.go:28] interesting pod/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 17:35:04.801448 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:04.801067    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 17:35:05.800921 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:05.800880    2568 patch_prober.go:28] interesting pod/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 17:35:05.801115 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:05.800953    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 17:35:06.801041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:06.800995    2568 patch_prober.go:28] interesting pod/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 24 17:35:06.801251 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:06.801076    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 24 17:35:07.805434 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:07.805402    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:07.805832 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:07.805673    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:07.806433 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:07.806418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:14.063151 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.063118    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"]
Jul 24 17:35:14.066660 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.066644    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:14.068808 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.068784    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:35:14.068808 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.068798    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:35:14.073518 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.073495    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"]
Jul 24 17:35:14.084363 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.084335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a7dc3-9923-4039-9a76-472a2210bd7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl\" (UID: \"569a7dc3-9923-4039-9a76-472a2210bd7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:14.185310 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.185270    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a7dc3-9923-4039-9a76-472a2210bd7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl\" (UID: \"569a7dc3-9923-4039-9a76-472a2210bd7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:14.185932 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.185910    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a7dc3-9923-4039-9a76-472a2210bd7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl\" (UID: \"569a7dc3-9923-4039-9a76-472a2210bd7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:14.377818 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.377705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:14.518148 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.518121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"]
Jul 24 17:35:14.520120 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:35:14.520092    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569a7dc3_9923_4039_9a76_472a2210bd7e.slice/crio-6f91316636d290f13adeca973bff9fdb6789e199c9f2069b7847a7f9b538079e WatchSource:0}: Error finding container 6f91316636d290f13adeca973bff9fdb6789e199c9f2069b7847a7f9b538079e: Status 404 returned error can't find the container with id 6f91316636d290f13adeca973bff9fdb6789e199c9f2069b7847a7f9b538079e
Jul 24 17:35:14.960791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.960761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl" event={"ID":"569a7dc3-9923-4039-9a76-472a2210bd7e","Type":"ContainerStarted","Data":"3c80cd5513620b5920085f78f6bd6e2a55334eec2968667db2499867c54193db"}
Jul 24 17:35:14.960999 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.960811    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl" event={"ID":"569a7dc3-9923-4039-9a76-472a2210bd7e","Type":"ContainerStarted","Data":"6f91316636d290f13adeca973bff9fdb6789e199c9f2069b7847a7f9b538079e"}
Jul 24 17:35:14.977916 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:14.977867    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl" podStartSLOduration=0.977850122 podStartE2EDuration="977.850122ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:35:14.97582738 +0000 UTC m=+1917.690981177" watchObservedRunningTime="2026-07-24 17:35:14.977850122 +0000 UTC m=+1917.693003908"
Jul 24 17:35:15.966529 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:15.966494    2568 generic.go:356] "Generic (PLEG): container finished" podID="569a7dc3-9923-4039-9a76-472a2210bd7e" containerID="3c80cd5513620b5920085f78f6bd6e2a55334eec2968667db2499867c54193db" exitCode=0
Jul 24 17:35:15.966996 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:15.966580    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl" event={"ID":"569a7dc3-9923-4039-9a76-472a2210bd7e","Type":"ContainerDied","Data":"3c80cd5513620b5920085f78f6bd6e2a55334eec2968667db2499867c54193db"}
Jul 24 17:35:17.103378 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.103344    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:17.106296 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.106275    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a7dc3-9923-4039-9a76-472a2210bd7e-maas-api-service-ca\") pod \"569a7dc3-9923-4039-9a76-472a2210bd7e\" (UID: \"569a7dc3-9923-4039-9a76-472a2210bd7e\") "
Jul 24 17:35:17.106612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.106591    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569a7dc3-9923-4039-9a76-472a2210bd7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "569a7dc3-9923-4039-9a76-472a2210bd7e" (UID: "569a7dc3-9923-4039-9a76-472a2210bd7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:35:17.207115 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.207074    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569a7dc3-9923-4039-9a76-472a2210bd7e-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:17.977194 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.977159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl" event={"ID":"569a7dc3-9923-4039-9a76-472a2210bd7e","Type":"ContainerDied","Data":"6f91316636d290f13adeca973bff9fdb6789e199c9f2069b7847a7f9b538079e"}
Jul 24 17:35:17.977194 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.977190    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"
Jul 24 17:35:17.977407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:17.977211    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f91316636d290f13adeca973bff9fdb6789e199c9f2069b7847a7f9b538079e"
Jul 24 17:35:27.646686 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:27.646652    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:35:29.155845 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:29.155810    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"]
Jul 24 17:35:29.158762 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:29.158737    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-74f5d728-7v9fl"]
Jul 24 17:35:29.906308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:29.906247    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569a7dc3-9923-4039-9a76-472a2210bd7e" path="/var/lib/kubelet/pods/569a7dc3-9923-4039-9a76-472a2210bd7e/volumes"
Jul 24 17:35:30.371611 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:30.371516    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"]
Jul 24 17:35:30.372036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:30.371794    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy" containerID="cri-o://11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791" gracePeriod=30
Jul 24 17:35:35.623036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.623009    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:35.683068 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683035    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9chfz\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-kube-api-access-9chfz\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683068 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683082    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee82d672-fc49-48d4-a814-6248a960a4f1-istiod-ca-cert\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683127    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-credential-socket\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-token\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683268    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-data\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683298    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-podinfo\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683325    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-envoy\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683360    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-certs\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683361    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:35.683508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683419    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-socket\") pod \"ee82d672-fc49-48d4-a814-6248a960a4f1\" (UID: \"ee82d672-fc49-48d4-a814-6248a960a4f1\") "
Jul 24 17:35:35.683735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683562    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee82d672-fc49-48d4-a814-6248a960a4f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:35:35.683872 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683852    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee82d672-fc49-48d4-a814-6248a960a4f1-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.684034 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.684018    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.684158 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.683982    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:35.684158 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.684061    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:35.684158 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.684146    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:35.685476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.685451    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:35.685568 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.685490    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-kube-api-access-9chfz" (OuterVolumeSpecName: "kube-api-access-9chfz") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "kube-api-access-9chfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:35:35.685756 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.685738    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:35:35.685828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.685778    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee82d672-fc49-48d4-a814-6248a960a4f1" (UID: "ee82d672-fc49-48d4-a814-6248a960a4f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:35:35.785249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785217    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.785249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785246    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.785249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785255    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.785249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785264    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.785249 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785273    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.785564 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785281    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee82d672-fc49-48d4-a814-6248a960a4f1-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:35.785564 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:35.785290    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9chfz\" (UniqueName: \"kubernetes.io/projected/ee82d672-fc49-48d4-a814-6248a960a4f1-kube-api-access-9chfz\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:35:36.065648 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.065563    2568 generic.go:356] "Generic (PLEG): container finished" podID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerID="11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791" exitCode=0
Jul 24 17:35:36.065648 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.065627    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"
Jul 24 17:35:36.065847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.065649    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" event={"ID":"ee82d672-fc49-48d4-a814-6248a960a4f1","Type":"ContainerDied","Data":"11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791"}
Jul 24 17:35:36.065847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.065761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz" event={"ID":"ee82d672-fc49-48d4-a814-6248a960a4f1","Type":"ContainerDied","Data":"ea18699e125b1b8a4ca6235303f415be168d8abfd7d343b7bb740f119b6b2528"}
Jul 24 17:35:36.065847 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.065793    2568 scope.go:117] "RemoveContainer" containerID="11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791"
Jul 24 17:35:36.075334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.075314    2568 scope.go:117] "RemoveContainer" containerID="6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"
Jul 24 17:35:36.083854 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.083831    2568 scope.go:117] "RemoveContainer" containerID="11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791"
Jul 24 17:35:36.084174 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:35:36.084153    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791\": container with ID starting with 11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791 not found: ID does not exist" containerID="11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791"
Jul 24 17:35:36.084246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.084183    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791"} err="failed to get container status \"11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791\": rpc error: code = NotFound desc = could not find container \"11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791\": container with ID starting with 11050a2b61b77a5f6d00560316bf261802100cad63bc800bf2179232b7abd791 not found: ID does not exist"
Jul 24 17:35:36.084246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.084201    2568 scope.go:117] "RemoveContainer" containerID="6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"
Jul 24 17:35:36.084485 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:35:36.084463    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207\": container with ID starting with 6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207 not found: ID does not exist" containerID="6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"
Jul 24 17:35:36.084599 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.084493    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207"} err="failed to get container status \"6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207\": rpc error: code = NotFound desc = could not find container \"6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207\": container with ID starting with 6fbe765708826a2f11b19da2d0246bb1f005f6efae00d0a8f973225cd2a68207 not found: ID does not exist"
Jul 24 17:35:36.090917 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.090895    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"]
Jul 24 17:35:36.096951 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:36.096928    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-74f5d728-openshift-default-8f6cf59db-cljbz"]
Jul 24 17:35:37.904828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:37.904798    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" path="/var/lib/kubelet/pods/ee82d672-fc49-48d4-a814-6248a960a4f1/volumes"
Jul 24 17:35:38.942928 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:35:38.942898    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:36:03.749202 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749163    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"]
Jul 24 17:36:03.749615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749529    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy"
Jul 24 17:36:03.749615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749541    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy"
Jul 24 17:36:03.749615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749559    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy"
Jul 24 17:36:03.749615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749565    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy"
Jul 24 17:36:03.749615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749574    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569a7dc3-9923-4039-9a76-472a2210bd7e" containerName="revoke-keys"
Jul 24 17:36:03.749615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749581    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="569a7dc3-9923-4039-9a76-472a2210bd7e" containerName="revoke-keys"
Jul 24 17:36:03.749841 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749634    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy"
Jul 24 17:36:03.749841 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749644    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="569a7dc3-9923-4039-9a76-472a2210bd7e" containerName="revoke-keys"
Jul 24 17:36:03.749841 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.749652    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee82d672-fc49-48d4-a814-6248a960a4f1" containerName="istio-proxy"
Jul 24 17:36:03.752633 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.752616    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:03.754889 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.754868    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:36:03.754889 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.754869    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:36:03.761018 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.760993    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"]
Jul 24 17:36:03.832248 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.832211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ab7a82-cd17-4f9e-86b4-3367ed158764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-72534233-9dq4c\" (UID: \"67ab7a82-cd17-4f9e-86b4-3367ed158764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:03.933484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.933442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ab7a82-cd17-4f9e-86b4-3367ed158764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-72534233-9dq4c\" (UID: \"67ab7a82-cd17-4f9e-86b4-3367ed158764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:03.934106 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:03.934085    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ab7a82-cd17-4f9e-86b4-3367ed158764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-72534233-9dq4c\" (UID: \"67ab7a82-cd17-4f9e-86b4-3367ed158764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:04.064843 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:04.064750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:04.198354 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:04.198179    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"]
Jul 24 17:36:04.201611 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:36:04.201581    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ab7a82_cd17_4f9e_86b4_3367ed158764.slice/crio-eabb4eaa9ae8025b1e52efcd4702eb855e48b584d0ff8ecd266b5610849a6d82 WatchSource:0}: Error finding container eabb4eaa9ae8025b1e52efcd4702eb855e48b584d0ff8ecd266b5610849a6d82: Status 404 returned error can't find the container with id eabb4eaa9ae8025b1e52efcd4702eb855e48b584d0ff8ecd266b5610849a6d82
Jul 24 17:36:05.208125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:05.208035    2568 generic.go:356] "Generic (PLEG): container finished" podID="67ab7a82-cd17-4f9e-86b4-3367ed158764" containerID="0a9867c5e79f23cb93da0e6746f87a5ef15a3a5463443b92230f430ea17c9815" exitCode=0
Jul 24 17:36:05.208125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:05.208076    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c" event={"ID":"67ab7a82-cd17-4f9e-86b4-3367ed158764","Type":"ContainerDied","Data":"0a9867c5e79f23cb93da0e6746f87a5ef15a3a5463443b92230f430ea17c9815"}
Jul 24 17:36:05.208557 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:05.208145    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c" event={"ID":"67ab7a82-cd17-4f9e-86b4-3367ed158764","Type":"ContainerStarted","Data":"eabb4eaa9ae8025b1e52efcd4702eb855e48b584d0ff8ecd266b5610849a6d82"}
Jul 24 17:36:06.342529 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:06.342502    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:06.351551 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:06.351526    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ab7a82-cd17-4f9e-86b4-3367ed158764-maas-api-service-ca\") pod \"67ab7a82-cd17-4f9e-86b4-3367ed158764\" (UID: \"67ab7a82-cd17-4f9e-86b4-3367ed158764\") "
Jul 24 17:36:06.351877 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:06.351856    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ab7a82-cd17-4f9e-86b4-3367ed158764-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67ab7a82-cd17-4f9e-86b4-3367ed158764" (UID: "67ab7a82-cd17-4f9e-86b4-3367ed158764"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:36:06.452701 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:06.452661    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ab7a82-cd17-4f9e-86b4-3367ed158764-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:36:07.218345 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:07.218305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c" event={"ID":"67ab7a82-cd17-4f9e-86b4-3367ed158764","Type":"ContainerDied","Data":"eabb4eaa9ae8025b1e52efcd4702eb855e48b584d0ff8ecd266b5610849a6d82"}
Jul 24 17:36:07.218345 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:07.218345    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"
Jul 24 17:36:07.218606 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:07.218367    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eabb4eaa9ae8025b1e52efcd4702eb855e48b584d0ff8ecd266b5610849a6d82"
Jul 24 17:36:17.347379 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:17.347288    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:36:18.828997 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:18.828963    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"]
Jul 24 17:36:18.831216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:18.831191    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-72534233-9dq4c"]
Jul 24 17:36:19.904775 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:36:19.904736    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ab7a82-cd17-4f9e-86b4-3367ed158764" path="/var/lib/kubelet/pods/67ab7a82-cd17-4f9e-86b4-3367ed158764/volumes"
Jul 24 17:37:44.788746 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:44.788654    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:37:56.952806 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:56.952773    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:37:57.755864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.755817    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"]
Jul 24 17:37:57.756391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.756373    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ab7a82-cd17-4f9e-86b4-3367ed158764" containerName="revoke-keys"
Jul 24 17:37:57.756486 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.756393    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ab7a82-cd17-4f9e-86b4-3367ed158764" containerName="revoke-keys"
Jul 24 17:37:57.756486 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.756478    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ab7a82-cd17-4f9e-86b4-3367ed158764" containerName="revoke-keys"
Jul 24 17:37:57.759614 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.759591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.762148 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.762128    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4ba182d6-openshift-default-dockercfg-5j8sd\""
Jul 24 17:37:57.783149 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.783119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"]
Jul 24 17:37:57.812189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-envoy\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-token\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istiod-ca-cert\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-credential-socket\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812356    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smqv\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-kube-api-access-6smqv\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-socket\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812430    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-certs\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812581 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812483    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-data\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.812581 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.812505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-podinfo\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913315 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-credential-socket\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913489 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smqv\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-kube-api-access-6smqv\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913489 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913353    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-socket\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913489 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-certs\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913653 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-data\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913653 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-podinfo\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913653 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-envoy\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-token\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istiod-ca-cert\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913764    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-certs\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.913835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.913773    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-credential-socket\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.914097 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.914052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-data\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.914234 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.914208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-socket\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.914386 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.914362    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istiod-ca-cert\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.915896 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.915878    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-envoy\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.916287 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.916266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-podinfo\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.920842 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.920821    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-token\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:57.921138 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:57.921117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smqv\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-kube-api-access-6smqv\") pod \"e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") " pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:58.073050 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.072950    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:58.214369 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.214342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"]
Jul 24 17:37:58.215964 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:37:58.215934    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddcb0f9_7da5_48af_908b_8ac3365934c7.slice/crio-460a15f34a1edd288de6c66bbacab49b6f3816efe8d5913c97438f8a0c55e199 WatchSource:0}: Error finding container 460a15f34a1edd288de6c66bbacab49b6f3816efe8d5913c97438f8a0c55e199: Status 404 returned error can't find the container with id 460a15f34a1edd288de6c66bbacab49b6f3816efe8d5913c97438f8a0c55e199
Jul 24 17:37:58.217996 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.217966    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:37:58.218066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.218031    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:37:58.218102 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.218064    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:37:58.755047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.755012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" event={"ID":"2ddcb0f9-7da5-48af-908b-8ac3365934c7","Type":"ContainerStarted","Data":"2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"}
Jul 24 17:37:58.755241 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.755067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" event={"ID":"2ddcb0f9-7da5-48af-908b-8ac3365934c7","Type":"ContainerStarted","Data":"460a15f34a1edd288de6c66bbacab49b6f3816efe8d5913c97438f8a0c55e199"}
Jul 24 17:37:58.775498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:58.775446    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" podStartSLOduration=1.775429345 podStartE2EDuration="1.775429345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:37:58.773809957 +0000 UTC m=+2081.488963742" watchObservedRunningTime="2026-07-24 17:37:58.775429345 +0000 UTC m=+2081.490583130"
Jul 24 17:37:59.073901 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:59.073811    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:59.078844 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:59.078818    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:59.759877 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:59.759845    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:37:59.760761 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:37:59.760739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:10.545858 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:10.545822    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:38:11.824173 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:11.824071    2568 generic.go:356] "Generic (PLEG): container finished" podID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerID="2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f" exitCode=0
Jul 24 17:38:11.824173 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:11.824123    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" event={"ID":"2ddcb0f9-7da5-48af-908b-8ac3365934c7","Type":"ContainerDied","Data":"2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"}
Jul 24 17:38:11.824807 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:11.824593    2568 scope.go:117] "RemoveContainer" containerID="2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"
Jul 24 17:38:11.825647 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:11.825618    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:38:11.825755 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:11.825701    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:38:11.825827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:11.825789    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:38:12.601215 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.601171    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"]
Jul 24 17:38:12.603606 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.603581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:12.605954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.605933    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:38:12.606075 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.606006    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:38:12.613448 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.613416    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"]
Jul 24 17:38:12.658417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.658373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20da95c9-a688-4a8e-8f7d-4519e30b0767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq\" (UID: \"20da95c9-a688-4a8e-8f7d-4519e30b0767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:12.759914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.759871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20da95c9-a688-4a8e-8f7d-4519e30b0767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq\" (UID: \"20da95c9-a688-4a8e-8f7d-4519e30b0767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:12.760524 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.760505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20da95c9-a688-4a8e-8f7d-4519e30b0767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq\" (UID: \"20da95c9-a688-4a8e-8f7d-4519e30b0767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:12.831585 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.831543    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" event={"ID":"2ddcb0f9-7da5-48af-908b-8ac3365934c7","Type":"ContainerStarted","Data":"4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374"}
Jul 24 17:38:12.916560 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:12.916516    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:13.073078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.073045    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:13.074176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.074150    2568 patch_prober.go:28] interesting pod/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 24 17:38:13.074295 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.074213    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 24 17:38:13.092036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.092003    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"]
Jul 24 17:38:13.094842 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:38:13.094805    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20da95c9_a688_4a8e_8f7d_4519e30b0767.slice/crio-578f4d504e4f77f9e075aa2a2cd60884ae43116d8ca4b85e66c535e5c0bf56f0 WatchSource:0}: Error finding container 578f4d504e4f77f9e075aa2a2cd60884ae43116d8ca4b85e66c535e5c0bf56f0: Status 404 returned error can't find the container with id 578f4d504e4f77f9e075aa2a2cd60884ae43116d8ca4b85e66c535e5c0bf56f0
Jul 24 17:38:13.842006 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.841966    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq" event={"ID":"20da95c9-a688-4a8e-8f7d-4519e30b0767","Type":"ContainerStarted","Data":"eed6124f91986ab569344eae11df6546d61d5a03ef486a6406c5ce40301aba42"}
Jul 24 17:38:13.842522 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.842028    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq" event={"ID":"20da95c9-a688-4a8e-8f7d-4519e30b0767","Type":"ContainerStarted","Data":"578f4d504e4f77f9e075aa2a2cd60884ae43116d8ca4b85e66c535e5c0bf56f0"}
Jul 24 17:38:13.860794 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:13.860737    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq" podStartSLOduration=1.860700287 podStartE2EDuration="1.860700287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:13.859510089 +0000 UTC m=+2096.574663877" watchObservedRunningTime="2026-07-24 17:38:13.860700287 +0000 UTC m=+2096.575854104"
Jul 24 17:38:14.074061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:14.074030    2568 patch_prober.go:28] interesting pod/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 24 17:38:14.074163 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:14.074087    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 24 17:38:14.760422 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:14.760385    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:14.849822 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:14.849782    2568 generic.go:356] "Generic (PLEG): container finished" podID="20da95c9-a688-4a8e-8f7d-4519e30b0767" containerID="eed6124f91986ab569344eae11df6546d61d5a03ef486a6406c5ce40301aba42" exitCode=0
Jul 24 17:38:14.851041 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:14.851006    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq" event={"ID":"20da95c9-a688-4a8e-8f7d-4519e30b0767","Type":"ContainerDied","Data":"eed6124f91986ab569344eae11df6546d61d5a03ef486a6406c5ce40301aba42"}
Jul 24 17:38:15.073761 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:15.073638    2568 patch_prober.go:28] interesting pod/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 24 17:38:15.073761 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:15.073695    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 24 17:38:16.005496 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.005472    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:16.073493 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.073461    2568 patch_prober.go:28] interesting pod/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 24 17:38:16.073652 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.073515    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 24 17:38:16.090950 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.090929    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20da95c9-a688-4a8e-8f7d-4519e30b0767-maas-api-service-ca\") pod \"20da95c9-a688-4a8e-8f7d-4519e30b0767\" (UID: \"20da95c9-a688-4a8e-8f7d-4519e30b0767\") "
Jul 24 17:38:16.091301 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.091281    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20da95c9-a688-4a8e-8f7d-4519e30b0767-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "20da95c9-a688-4a8e-8f7d-4519e30b0767" (UID: "20da95c9-a688-4a8e-8f7d-4519e30b0767"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:38:16.192317 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.192276    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/20da95c9-a688-4a8e-8f7d-4519e30b0767-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:16.861651 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.861622    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"
Jul 24 17:38:16.861864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.861613    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq" event={"ID":"20da95c9-a688-4a8e-8f7d-4519e30b0767","Type":"ContainerDied","Data":"578f4d504e4f77f9e075aa2a2cd60884ae43116d8ca4b85e66c535e5c0bf56f0"}
Jul 24 17:38:16.861864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:16.861770    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="578f4d504e4f77f9e075aa2a2cd60884ae43116d8ca4b85e66c535e5c0bf56f0"
Jul 24 17:38:17.077669 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:17.077639    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:17.078586 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:17.078569    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:17.885724 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:17.885680    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:38:17.889635 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:17.889614    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:38:26.369673 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:26.369635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:38:27.729421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:27.729387    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"]
Jul 24 17:38:27.731707 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:27.731680    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ba182d6-55jvq"]
Jul 24 17:38:27.904897 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:27.904865    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20da95c9-a688-4a8e-8f7d-4519e30b0767" path="/var/lib/kubelet/pods/20da95c9-a688-4a8e-8f7d-4519e30b0767/volumes"
Jul 24 17:38:34.686441 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:34.686408    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"]
Jul 24 17:38:34.686921 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:34.686618    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy" containerID="cri-o://4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374" gracePeriod=30
Jul 24 17:38:39.924023 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.923996    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:39.978020 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.977926    2568 generic.go:356] "Generic (PLEG): container finished" podID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerID="4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374" exitCode=0
Jul 24 17:38:39.978020 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.977982    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"
Jul 24 17:38:39.978239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.978032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" event={"ID":"2ddcb0f9-7da5-48af-908b-8ac3365934c7","Type":"ContainerDied","Data":"4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374"}
Jul 24 17:38:39.978239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.978077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz" event={"ID":"2ddcb0f9-7da5-48af-908b-8ac3365934c7","Type":"ContainerDied","Data":"460a15f34a1edd288de6c66bbacab49b6f3816efe8d5913c97438f8a0c55e199"}
Jul 24 17:38:39.978239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.978100    2568 scope.go:117] "RemoveContainer" containerID="4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374"
Jul 24 17:38:39.986786 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.986764    2568 scope.go:117] "RemoveContainer" containerID="2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"
Jul 24 17:38:39.994459 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.994443    2568 scope.go:117] "RemoveContainer" containerID="4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374"
Jul 24 17:38:39.994708 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:38:39.994688    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374\": container with ID starting with 4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374 not found: ID does not exist" containerID="4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374"
Jul 24 17:38:39.994791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.994729    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374"} err="failed to get container status \"4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374\": rpc error: code = NotFound desc = could not find container \"4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374\": container with ID starting with 4f7b3d9415ceff49f096c606d381167bd8aefaabdf40b4c8b72abea595ed4374 not found: ID does not exist"
Jul 24 17:38:39.994791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.994749    2568 scope.go:117] "RemoveContainer" containerID="2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"
Jul 24 17:38:39.994975 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:38:39.994961    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f\": container with ID starting with 2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f not found: ID does not exist" containerID="2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"
Jul 24 17:38:39.995019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:39.994981    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f"} err="failed to get container status \"2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f\": rpc error: code = NotFound desc = could not find container \"2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f\": container with ID starting with 2dddf4c71622b4efc9ab9ed0394f2894074c12b395f1df8bd5c4e1e62d67696f not found: ID does not exist"
Jul 24 17:38:40.008329 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008301    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-podinfo\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008351    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-certs\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008377    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6smqv\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-kube-api-access-6smqv\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008414    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-envoy\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008550 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008429    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-data\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008550 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008449    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-socket\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008550 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008509    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istiod-ca-cert\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008550 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008533    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-credential-socket\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-token\") pod \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\" (UID: \"2ddcb0f9-7da5-48af-908b-8ac3365934c7\") "
Jul 24 17:38:40.008759 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008648    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:38:40.008871 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008822    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:38:40.009019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008936    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.009019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.008996    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.009019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.009001    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:38:40.009463 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.009433    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:38:40.009578 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.009493    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:38:40.010828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.010685    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:38:40.010941 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.010866    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:38:40.011065 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.011044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:38:40.011065 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.011055    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-kube-api-access-6smqv" (OuterVolumeSpecName: "kube-api-access-6smqv") pod "2ddcb0f9-7da5-48af-908b-8ac3365934c7" (UID: "2ddcb0f9-7da5-48af-908b-8ac3365934c7"). InnerVolumeSpecName "kube-api-access-6smqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:38:40.110010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.109974    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.110010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.110002    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.110010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.110011    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.110010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.110019    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6smqv\" (UniqueName: \"kubernetes.io/projected/2ddcb0f9-7da5-48af-908b-8ac3365934c7-kube-api-access-6smqv\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.110289 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.110028    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.110289 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.110035    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.110289 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.110043    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddcb0f9-7da5-48af-908b-8ac3365934c7-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:38:40.298961 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.298929    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"]
Jul 24 17:38:40.304858 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:40.304830    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4ba182d6-openshift-default-5bffb587f6-vv8lz"]
Jul 24 17:38:41.908966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:41.908932    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" path="/var/lib/kubelet/pods/2ddcb0f9-7da5-48af-908b-8ac3365934c7/volumes"
Jul 24 17:38:54.217740 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.217667    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"]
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218026    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218038    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218050    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218056    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218066    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20da95c9-a688-4a8e-8f7d-4519e30b0767" containerName="revoke-keys"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218072    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20da95c9-a688-4a8e-8f7d-4519e30b0767" containerName="revoke-keys"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218131    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20da95c9-a688-4a8e-8f7d-4519e30b0767" containerName="revoke-keys"
Jul 24 17:38:54.218274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.218139    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy"
Jul 24 17:38:54.221009 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.220985    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.223246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.223225    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-47dfc7db-openshift-default-dockercfg-whkz7\""
Jul 24 17:38:54.235821 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.235788    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"]
Jul 24 17:38:54.341348 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341307    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-envoy\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341536 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-data\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341536 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-socket\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341536 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341467    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-podinfo\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341536 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-certs\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341688 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f865\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-kube-api-access-8f865\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341688 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-token\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341688 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-credential-socket\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.341688 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.341673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istiod-ca-cert\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.442925 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.442880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f865\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-kube-api-access-8f865\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443118 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.442955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-token\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443118 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.442986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-credential-socket\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443118 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istiod-ca-cert\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443118 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-envoy\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443118 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-data\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443393 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-socket\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443393 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-podinfo\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443393 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-certs\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443561 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443532    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-credential-socket\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443947 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443921    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istiod-ca-cert\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.443947 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.443955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-socket\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.444108 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.444025    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-data\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.444108 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.444053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-certs\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.445690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.445651    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-envoy\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.445812 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.445772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-podinfo\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.451788 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.451757    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-token\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.451976 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.451957    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f865\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-kube-api-access-8f865\") pod \"e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") " pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.532073 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.531978    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:54.678194 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.678167    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"]
Jul 24 17:38:54.680398 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:38:54.680373    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadb5ce9_7824_41a2_b9f4_6b3a8a3bcd6e.slice/crio-90c44f6b3e6a2c1ba8226451ac7c32ed49f44c50b512b5c8aab83f8e88a021a6 WatchSource:0}: Error finding container 90c44f6b3e6a2c1ba8226451ac7c32ed49f44c50b512b5c8aab83f8e88a021a6: Status 404 returned error can't find the container with id 90c44f6b3e6a2c1ba8226451ac7c32ed49f44c50b512b5c8aab83f8e88a021a6
Jul 24 17:38:54.682465 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.682432    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:38:54.682542 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.682496    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:38:54.682542 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:54.682524    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:38:55.051840 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:55.051805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" event={"ID":"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e","Type":"ContainerStarted","Data":"c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"}
Jul 24 17:38:55.052022 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:55.051865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" event={"ID":"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e","Type":"ContainerStarted","Data":"90c44f6b3e6a2c1ba8226451ac7c32ed49f44c50b512b5c8aab83f8e88a021a6"}
Jul 24 17:38:55.074565 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:55.074512    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podStartSLOduration=1.074492437 podStartE2EDuration="1.074492437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:38:55.072112727 +0000 UTC m=+2137.787266514" watchObservedRunningTime="2026-07-24 17:38:55.074492437 +0000 UTC m=+2137.789646223"
Jul 24 17:38:55.532516 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:55.532476    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:55.537441 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:55.537413    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:56.056492 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:56.056467    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:38:56.057389 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:38:56.057362    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:39:04.147073 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:04.147037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:39:11.698694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:11.698535    2568 patch_prober.go:28] interesting pod/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:46590->10.134.0.39:15021: read: connection reset by peer" start-of-body=
Jul 24 17:39:11.698694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:11.698597    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:46590->10.134.0.39:15021: read: connection reset by peer"
Jul 24 17:39:12.138644 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:12.138562    2568 generic.go:356] "Generic (PLEG): container finished" podID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerID="c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b" exitCode=0
Jul 24 17:39:12.138644 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:12.138616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" event={"ID":"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e","Type":"ContainerDied","Data":"c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"}
Jul 24 17:39:12.139002 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:12.138988    2568 scope.go:117] "RemoveContainer" containerID="c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"
Jul 24 17:39:12.139991 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:12.139958    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:39:12.140043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:12.140028    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:39:12.140089 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:12.140062    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:39:13.148966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:13.148921    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" event={"ID":"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e","Type":"ContainerStarted","Data":"d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca"}
Jul 24 17:39:13.532618 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:13.532506    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:39:13.533080 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:13.533054    2568 patch_prober.go:28] interesting pod/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 24 17:39:13.533297 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:13.533272    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 24 17:39:14.532854 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:14.532811    2568 patch_prober.go:28] interesting pod/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 24 17:39:14.533488 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:14.533450    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 24 17:39:15.533239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:15.533200    2568 patch_prober.go:28] interesting pod/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 24 17:39:15.533840 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:15.533805    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 24 17:39:16.532818 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:16.532777    2568 patch_prober.go:28] interesting pod/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 24 17:39:16.533036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:16.532860    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 24 17:39:17.535670 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:17.535638    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:39:17.536170 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:17.536042    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:39:17.536599 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:17.536580    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:39:26.239877 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:39:26.239838    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:40:12.552121 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:12.552084    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:40:17.139485 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.139447    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"]
Jul 24 17:40:17.139919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.139877    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddcb0f9-7da5-48af-908b-8ac3365934c7" containerName="istio-proxy"
Jul 24 17:40:17.142961 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.142945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:17.148048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.148027    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:40:17.148170 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.148096    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:40:17.177985 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.177947    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"]
Jul 24 17:40:17.202082 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.202047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db3234a-0c1b-4888-85e1-3d77231cd4cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k\" (UID: \"6db3234a-0c1b-4888-85e1-3d77231cd4cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:17.303623 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.303583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db3234a-0c1b-4888-85e1-3d77231cd4cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k\" (UID: \"6db3234a-0c1b-4888-85e1-3d77231cd4cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:17.304239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.304217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db3234a-0c1b-4888-85e1-3d77231cd4cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k\" (UID: \"6db3234a-0c1b-4888-85e1-3d77231cd4cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:17.452842 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.452813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:17.587517 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.587492    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"]
Jul 24 17:40:17.590129 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:40:17.590100    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db3234a_0c1b_4888_85e1_3d77231cd4cd.slice/crio-af21336202d97fe83def45ac7024cddd6060be43eea9e8fed856ff2a1b729c93 WatchSource:0}: Error finding container af21336202d97fe83def45ac7024cddd6060be43eea9e8fed856ff2a1b729c93: Status 404 returned error can't find the container with id af21336202d97fe83def45ac7024cddd6060be43eea9e8fed856ff2a1b729c93
Jul 24 17:40:17.948414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:17.948390    2568 scope.go:117] "RemoveContainer" containerID="8062c93106ad316e6b8628aa072a211c58e973303b8a60ecbc5d49e590ef229d"
Jul 24 17:40:18.459812 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:18.459767    2568 generic.go:356] "Generic (PLEG): container finished" podID="6db3234a-0c1b-4888-85e1-3d77231cd4cd" containerID="7a3fefa6a97f9176abef3da6fcd7ce4b928d7480144faf3d9b11c33f67e25b3c" exitCode=0
Jul 24 17:40:18.460222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:18.459828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k" event={"ID":"6db3234a-0c1b-4888-85e1-3d77231cd4cd","Type":"ContainerDied","Data":"7a3fefa6a97f9176abef3da6fcd7ce4b928d7480144faf3d9b11c33f67e25b3c"}
Jul 24 17:40:18.460222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:18.459912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k" event={"ID":"6db3234a-0c1b-4888-85e1-3d77231cd4cd","Type":"ContainerStarted","Data":"af21336202d97fe83def45ac7024cddd6060be43eea9e8fed856ff2a1b729c93"}
Jul 24 17:40:19.592091 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:19.592069    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:19.626630 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:19.626596    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db3234a-0c1b-4888-85e1-3d77231cd4cd-maas-api-service-ca\") pod \"6db3234a-0c1b-4888-85e1-3d77231cd4cd\" (UID: \"6db3234a-0c1b-4888-85e1-3d77231cd4cd\") "
Jul 24 17:40:19.627083 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:19.627055    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db3234a-0c1b-4888-85e1-3d77231cd4cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6db3234a-0c1b-4888-85e1-3d77231cd4cd" (UID: "6db3234a-0c1b-4888-85e1-3d77231cd4cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:40:19.728254 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:19.728167    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db3234a-0c1b-4888-85e1-3d77231cd4cd-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:40:20.470628 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:20.470595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k" event={"ID":"6db3234a-0c1b-4888-85e1-3d77231cd4cd","Type":"ContainerDied","Data":"af21336202d97fe83def45ac7024cddd6060be43eea9e8fed856ff2a1b729c93"}
Jul 24 17:40:20.470628 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:20.470626    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"
Jul 24 17:40:20.470873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:20.470647    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af21336202d97fe83def45ac7024cddd6060be43eea9e8fed856ff2a1b729c93"
Jul 24 17:40:30.340341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:30.340299    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:40:37.236944 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:37.236904    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"]
Jul 24 17:40:37.239914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:37.239888    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-47dfc7db-nh74k"]
Jul 24 17:40:37.904905 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:37.904874    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6db3234a-0c1b-4888-85e1-3d77231cd4cd" path="/var/lib/kubelet/pods/6db3234a-0c1b-4888-85e1-3d77231cd4cd/volumes"
Jul 24 17:40:42.048619 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:40:42.048531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:41:17.967341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:17.967311    2568 scope.go:117] "RemoveContainer" containerID="024097049d418bc538de381406cb9bf96cb78cdd293ef34cf1f56a547d8a415f"
Jul 24 17:41:17.975723 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:17.975687    2568 scope.go:117] "RemoveContainer" containerID="3c80cd5513620b5920085f78f6bd6e2a55334eec2968667db2499867c54193db"
Jul 24 17:41:42.519602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:42.519569    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"]
Jul 24 17:41:42.520078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:42.519788    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" containerID="cri-o://d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca" gracePeriod=30
Jul 24 17:41:46.552314 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:46.552273    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:41:47.537440 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.537414    2568 patch_prober.go:28] interesting pod/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 24 17:41:47.537556 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.537483    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 24 17:41:47.773561 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.773534    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:41:47.813384 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813270    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istiod-ca-cert\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813384 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813332    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-data\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813384 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813367    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-podinfo\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813393    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-token\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813426    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-envoy\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813450    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-socket\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813496    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f865\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-kube-api-access-8f865\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813544    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-credential-socket\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.813683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813609    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-certs\") pod \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\" (UID: \"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e\") "
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813796    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813818    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813965    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.813985    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.814008    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.814021    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:47.814334 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.814323    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:47.815694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.815670    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:41:47.815851 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.815824    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-kube-api-access-8f865" (OuterVolumeSpecName: "kube-api-access-8f865") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "kube-api-access-8f865". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:47.816059 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.816033    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:41:47.816143 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.816036    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" (UID: "eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:41:47.883690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.883648    2568 generic.go:356] "Generic (PLEG): container finished" podID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerID="d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca" exitCode=0
Jul 24 17:41:47.883690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.883692    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" event={"ID":"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e","Type":"ContainerDied","Data":"d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca"}
Jul 24 17:41:47.883911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.883708    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"
Jul 24 17:41:47.883911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.883782    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl" event={"ID":"eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e","Type":"ContainerDied","Data":"90c44f6b3e6a2c1ba8226451ac7c32ed49f44c50b512b5c8aab83f8e88a021a6"}
Jul 24 17:41:47.883911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.883807    2568 scope.go:117] "RemoveContainer" containerID="d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca"
Jul 24 17:41:47.893047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.893028    2568 scope.go:117] "RemoveContainer" containerID="c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"
Jul 24 17:41:47.900949 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.900932    2568 scope.go:117] "RemoveContainer" containerID="d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca"
Jul 24 17:41:47.901193 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:41:47.901172    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca\": container with ID starting with d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca not found: ID does not exist" containerID="d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca"
Jul 24 17:41:47.901237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.901201    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca"} err="failed to get container status \"d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca\": rpc error: code = NotFound desc = could not find container \"d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca\": container with ID starting with d62a675ea4b840d3b3438bc16340a53cd46fe7d3ce6fa99c06145772d08a5cca not found: ID does not exist"
Jul 24 17:41:47.901237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.901218    2568 scope.go:117] "RemoveContainer" containerID="c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"
Jul 24 17:41:47.901482 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:41:47.901459    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b\": container with ID starting with c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b not found: ID does not exist" containerID="c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"
Jul 24 17:41:47.901589 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.901485    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b"} err="failed to get container status \"c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b\": rpc error: code = NotFound desc = could not find container \"c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b\": container with ID starting with c7d3bf734bc6f5e30f2601e2fcf6428897951ea5731b79047621ca9ac09cf54b not found: ID does not exist"
Jul 24 17:41:47.909261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.909238    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"]
Jul 24 17:41:47.915001 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.914981    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f865\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-kube-api-access-8f865\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.915078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.915004    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.915078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.915015    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.915078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.915024    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.915078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.915032    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.915078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.915039    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.915078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.915047    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:41:47.921641 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:47.921617    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-47dfc7db-openshift-default-8b84bb6dd-5sngl"]
Jul 24 17:41:49.904038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:49.904006    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" path="/var/lib/kubelet/pods/eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e/volumes"
Jul 24 17:41:58.649549 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:41:58.649509    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:42:17.997824 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:17.997751    2568 scope.go:117] "RemoveContainer" containerID="0a9867c5e79f23cb93da0e6746f87a5ef15a3a5463443b92230f430ea17c9815"
Jul 24 17:42:38.927691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.927652    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"]
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928077    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy"
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928092    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy"
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928100    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db3234a-0c1b-4888-85e1-3d77231cd4cd" containerName="revoke-keys"
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928105    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db3234a-0c1b-4888-85e1-3d77231cd4cd" containerName="revoke-keys"
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928176    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy"
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928186    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy"
Jul 24 17:42:38.928206 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.928193    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db3234a-0c1b-4888-85e1-3d77231cd4cd" containerName="revoke-keys"
Jul 24 17:42:38.931071 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.931055    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.933449 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.933432    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5e8b71-openshift-default-dockercfg-724kn\""
Jul 24 17:42:38.947954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.947928    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"]
Jul 24 17:42:38.974941 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.974901    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istiod-ca-cert\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.974975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m52mk\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-kube-api-access-m52mk\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-data\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-token\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-socket\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975268 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-certs\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975268 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-envoy\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975268 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-podinfo\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:38.975400 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:38.975274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-credential-socket\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076261 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istiod-ca-cert\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076292    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m52mk\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-kube-api-access-m52mk\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-data\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-token\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-socket\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076765 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-certs\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076765 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-envoy\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076765 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-podinfo\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.076951 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076930    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-certs\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.077007 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-data\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.077007 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-socket\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.077007 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.076997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-credential-socket\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.077140 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.077047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istiod-ca-cert\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.077291 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.077273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-credential-socket\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.078883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.078858    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-envoy\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.078993 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.078971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-podinfo\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.085466 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.085444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-token\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.085672 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.085652    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m52mk\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-kube-api-access-m52mk\") pod \"e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") " pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.241578 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.241489    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:39.386192 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.386167    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"]
Jul 24 17:42:39.389214 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:42:39.389183    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3156f3a_456d_482b_9ed4_8c0ac003c67f.slice/crio-28314d76c442f41405e528ec19e665619220e8fa64233ff9a8259bfa80ce4e49 WatchSource:0}: Error finding container 28314d76c442f41405e528ec19e665619220e8fa64233ff9a8259bfa80ce4e49: Status 404 returned error can't find the container with id 28314d76c442f41405e528ec19e665619220e8fa64233ff9a8259bfa80ce4e49
Jul 24 17:42:39.392074 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.392031    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:39.392176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.392108    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:39.392176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:39.392145    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:40.128588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:40.128550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" event={"ID":"a3156f3a-456d-482b-9ed4-8c0ac003c67f","Type":"ContainerStarted","Data":"1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"}
Jul 24 17:42:40.129134 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:40.128607    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" event={"ID":"a3156f3a-456d-482b-9ed4-8c0ac003c67f","Type":"ContainerStarted","Data":"28314d76c442f41405e528ec19e665619220e8fa64233ff9a8259bfa80ce4e49"}
Jul 24 17:42:40.152641 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:40.152575    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podStartSLOduration=2.152557986 podStartE2EDuration="2.152557986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:40.150379323 +0000 UTC m=+2362.865533120" watchObservedRunningTime="2026-07-24 17:42:40.152557986 +0000 UTC m=+2362.867711772"
Jul 24 17:42:40.242108 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:40.242068    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:40.247162 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:40.247134    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:41.133521 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:41.133490    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:41.134593 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:41.134572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:47.282048 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.282011    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"]
Jul 24 17:42:47.282541 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.282480    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy"
Jul 24 17:42:47.282541 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.282493    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadb5ce9-7824-41a2-b9f4-6b3a8a3bcd6e" containerName="istio-proxy"
Jul 24 17:42:47.286100 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.286073    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.291364 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.291341    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-368755-openshift-default-dockercfg-glz6b\""
Jul 24 17:42:47.301636 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.301609    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"]
Jul 24 17:42:47.355019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.354986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-credential-socket\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-certs\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355059    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-envoy\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355112    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjfdm\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-kube-api-access-rjfdm\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-data\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355228 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355223    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-token\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355493 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istiod-ca-cert\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355493 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355357    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-socket\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.355493 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.355412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-podinfo\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.456519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456477    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-podinfo\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.456519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-credential-socket\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.456819 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-certs\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.456819 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-envoy\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.456819 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjfdm\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-kube-api-access-rjfdm\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.456819 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-data\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-token\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istiod-ca-cert\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-socket\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.457010    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-credential-socket\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457038 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.456953    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-certs\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457403 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.457124    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-data\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457403 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.457307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-socket\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.457639 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.457618    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istiod-ca-cert\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.458919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.458900    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-envoy\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.459160 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.459143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-podinfo\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.465322 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.465299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-token\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.465431 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.465379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjfdm\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-kube-api-access-rjfdm\") pod \"e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") " pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.597520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.597423    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:47.733155 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.733123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"]
Jul 24 17:42:47.736595 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:42:47.736564    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc117aec1_98f7_4c0b_8e21_a4e18442c3c6.slice/crio-e9c3ef34649d61804b52f3da95b3a594f94f81d8cdf6579078fec646ce6f89d7 WatchSource:0}: Error finding container e9c3ef34649d61804b52f3da95b3a594f94f81d8cdf6579078fec646ce6f89d7: Status 404 returned error can't find the container with id e9c3ef34649d61804b52f3da95b3a594f94f81d8cdf6579078fec646ce6f89d7
Jul 24 17:42:47.738738 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.738680    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:47.738828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.738763    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:47.738828 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:47.738794    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:48.168797 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:48.168761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" event={"ID":"c117aec1-98f7-4c0b-8e21-a4e18442c3c6","Type":"ContainerStarted","Data":"7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"}
Jul 24 17:42:48.168979 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:48.168814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" event={"ID":"c117aec1-98f7-4c0b-8e21-a4e18442c3c6","Type":"ContainerStarted","Data":"e9c3ef34649d61804b52f3da95b3a594f94f81d8cdf6579078fec646ce6f89d7"}
Jul 24 17:42:48.242606 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:48.242544    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podStartSLOduration=1.242524351 podStartE2EDuration="1.242524351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:42:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:42:48.191923728 +0000 UTC m=+2370.907077515" watchObservedRunningTime="2026-07-24 17:42:48.242524351 +0000 UTC m=+2370.957678136"
Jul 24 17:42:48.244123 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:48.244104    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:42:48.598533 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:48.598444    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:48.605128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:48.605097    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:49.173505 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:49.173461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:49.174519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:49.174497    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:42:56.287061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:56.286699    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:34728->10.134.0.41:15021: read: connection reset by peer" start-of-body=
Jul 24 17:42:56.287061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:56.286779    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:34728->10.134.0.41:15021: read: connection reset by peer"
Jul 24 17:42:57.212584 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:57.212550    2568 generic.go:356] "Generic (PLEG): container finished" podID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerID="1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248" exitCode=0
Jul 24 17:42:57.212798 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:57.212634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" event={"ID":"a3156f3a-456d-482b-9ed4-8c0ac003c67f","Type":"ContainerDied","Data":"1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"}
Jul 24 17:42:57.213074 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:57.213061    2568 scope.go:117] "RemoveContainer" containerID="1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"
Jul 24 17:42:57.214099 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:57.214069    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:57.214201 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:57.214151    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:57.214263 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:57.214199    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:42:58.219468 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:58.219430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" event={"ID":"a3156f3a-456d-482b-9ed4-8c0ac003c67f","Type":"ContainerStarted","Data":"78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb"}
Jul 24 17:42:58.242900 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:58.242454    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:42:58.242900 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:58.242584    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 17:42:58.242900 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:58.242630    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 17:42:59.241936 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:59.241892    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 17:42:59.242515 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:42:59.242484    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 17:43:00.242200 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:00.242154    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 17:43:00.242708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:00.242224    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 17:43:00.447265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:00.447221    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:43:01.243071 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:01.242551    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 17:43:01.243071 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:01.242623    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 17:43:02.242176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:02.242143    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 24 17:43:02.242386 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:02.242202    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 24 17:43:03.246120 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.246090    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:43:03.246612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.246474    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:43:03.247371 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.247350    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:43:03.248621 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.248601    2568 generic.go:356] "Generic (PLEG): container finished" podID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerID="7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458" exitCode=0
Jul 24 17:43:03.248704 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.248656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" event={"ID":"c117aec1-98f7-4c0b-8e21-a4e18442c3c6","Type":"ContainerDied","Data":"7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"}
Jul 24 17:43:03.249008 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.248995    2568 scope.go:117] "RemoveContainer" containerID="7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"
Jul 24 17:43:03.250012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.249982    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:43:03.250086 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.250051    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:43:03.250086 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:03.250081    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:43:04.173799 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:04.173755    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:43:04.259957 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:04.259921    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" event={"ID":"c117aec1-98f7-4c0b-8e21-a4e18442c3c6","Type":"ContainerStarted","Data":"f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf"}
Jul 24 17:43:04.597851 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:04.597761    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:43:04.598909 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:04.598886    2568 patch_prober.go:28] interesting pod/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 17:43:04.598965 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:04.598937    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 17:43:05.598862 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:05.598827    2568 patch_prober.go:28] interesting pod/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 17:43:05.599275 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:05.598881    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 17:43:06.598442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:06.598398    2568 patch_prober.go:28] interesting pod/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 17:43:06.598680 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:06.598466    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 17:43:07.597909 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:07.597866    2568 patch_prober.go:28] interesting pod/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 24 17:43:07.598325 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:07.597921    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 24 17:43:08.601661 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:08.601624    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:43:08.602170 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:08.602025    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:43:08.602641 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:08.602620    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:43:10.837571 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:10.837537    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:43:17.921542 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:17.921513    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:43:17.925202 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:17.925178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:43:40.451877 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.451788    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"]
Jul 24 17:43:40.454587 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.454563    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.456794 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.456769    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-368755\"/\"openshift-service-ca.crt\""
Jul 24 17:43:40.457780 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.457677    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-368755\"/\"default-dockercfg-85bq5\""
Jul 24 17:43:40.457780 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.457690    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-368755\"/\"kube-root-ca.crt\""
Jul 24 17:43:40.457979 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.457814    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-368755\"/\"test-model-368755-kserve-self-signed-certs\""
Jul 24 17:43:40.466649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.466599    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"]
Jul 24 17:43:40.563484 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.563444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-model-cache\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.563665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.563541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tls-certs\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.563665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.563573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tmp-dir\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.563665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.563597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g785h\" (UniqueName: \"kubernetes.io/projected/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-kube-api-access-g785h\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.563665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.563649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-dshm\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.563857 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.563679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-home\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664377 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tmp-dir\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664377 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g785h\" (UniqueName: \"kubernetes.io/projected/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-kube-api-access-g785h\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-dshm\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-home\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-model-cache\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tls-certs\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664865 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664826    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tmp-dir\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664926 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664900    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-home\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.664981 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.664927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-model-cache\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.666701 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.666676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-dshm\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.666970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.666954    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tls-certs\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.674840 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.674817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g785h\" (UniqueName: \"kubernetes.io/projected/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-kube-api-access-g785h\") pod \"test-model-368755-kserve-57485bbbd9-tp6tq\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") " pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.766432 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.766339    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:40.897827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:40.897798    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"]
Jul 24 17:43:40.900161 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:43:40.900138    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a0c520e_2de9_4119_8ff0_14739d4fcdf7.slice/crio-eb7659a0d19d209377501f67799a8650447d31bb31fa2e5cad9df2786e6f9cc6 WatchSource:0}: Error finding container eb7659a0d19d209377501f67799a8650447d31bb31fa2e5cad9df2786e6f9cc6: Status 404 returned error can't find the container with id eb7659a0d19d209377501f67799a8650447d31bb31fa2e5cad9df2786e6f9cc6
Jul 24 17:43:41.433595 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:41.433552    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq" event={"ID":"6a0c520e-2de9-4119-8ff0-14739d4fcdf7","Type":"ContainerStarted","Data":"4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594"}
Jul 24 17:43:41.433595 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:41.433603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq" event={"ID":"6a0c520e-2de9-4119-8ff0-14739d4fcdf7","Type":"ContainerStarted","Data":"eb7659a0d19d209377501f67799a8650447d31bb31fa2e5cad9df2786e6f9cc6"}
Jul 24 17:43:41.450513 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:41.450460    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq" podStartSLOduration=1.450444178 podStartE2EDuration="1.450444178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:43:41.449616877 +0000 UTC m=+2424.164770664" watchObservedRunningTime="2026-07-24 17:43:41.450444178 +0000 UTC m=+2424.165597964"
Jul 24 17:43:43.652964 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:43.652929    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:43:50.766658 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:50.766610    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:50.767312 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:50.766676    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:50.779210 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:50.779173    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:51.493997 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:51.493969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:43:57.850347 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:43:57.850307    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:44:18.029864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:18.029833    2568 scope.go:117] "RemoveContainer" containerID="eed6124f91986ab569344eae11df6546d61d5a03ef486a6406c5ce40301aba42"
Jul 24 17:44:21.070280 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:21.070243    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"]
Jul 24 17:44:24.841469 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:24.841439    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:44:36.089633 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.089572    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq" podUID="6a0c520e-2de9-4119-8ff0-14739d4fcdf7" containerName="main" containerID="cri-o://4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594" gracePeriod=45
Jul 24 17:44:36.342118 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.342051    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:44:36.498737 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.498664    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g785h\" (UniqueName: \"kubernetes.io/projected/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-kube-api-access-g785h\") pod \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") "
Jul 24 17:44:36.498737 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.498754    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tmp-dir\") pod \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") "
Jul 24 17:44:36.499029 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.498806    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tls-certs\") pod \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") "
Jul 24 17:44:36.499029 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.498881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-model-cache\") pod \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") "
Jul 24 17:44:36.499029 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.498896    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-home\") pod \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") "
Jul 24 17:44:36.499029 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.498922    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-dshm\") pod \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\" (UID: \"6a0c520e-2de9-4119-8ff0-14739d4fcdf7\") "
Jul 24 17:44:36.499237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.499058    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a0c520e-2de9-4119-8ff0-14739d4fcdf7" (UID: "6a0c520e-2de9-4119-8ff0-14739d4fcdf7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:36.499237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.499158    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a0c520e-2de9-4119-8ff0-14739d4fcdf7" (UID: "6a0c520e-2de9-4119-8ff0-14739d4fcdf7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:36.499237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.499153    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-home" (OuterVolumeSpecName: "home") pod "6a0c520e-2de9-4119-8ff0-14739d4fcdf7" (UID: "6a0c520e-2de9-4119-8ff0-14739d4fcdf7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:36.499237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.499230    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tmp-dir\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.501002 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.500970    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-dshm" (OuterVolumeSpecName: "dshm") pod "6a0c520e-2de9-4119-8ff0-14739d4fcdf7" (UID: "6a0c520e-2de9-4119-8ff0-14739d4fcdf7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:36.501119 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.501089    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a0c520e-2de9-4119-8ff0-14739d4fcdf7" (UID: "6a0c520e-2de9-4119-8ff0-14739d4fcdf7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:44:36.501165 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.501149    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-kube-api-access-g785h" (OuterVolumeSpecName: "kube-api-access-g785h") pod "6a0c520e-2de9-4119-8ff0-14739d4fcdf7" (UID: "6a0c520e-2de9-4119-8ff0-14739d4fcdf7"). InnerVolumeSpecName "kube-api-access-g785h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:44:36.600790 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.600660    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g785h\" (UniqueName: \"kubernetes.io/projected/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-kube-api-access-g785h\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.600790 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.600694    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-tls-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.600790 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.600709    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-model-cache\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.600790 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.600750    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-home\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.600790 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.600760    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0c520e-2de9-4119-8ff0-14739d4fcdf7-dshm\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:36.695597 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.695558    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a0c520e-2de9-4119-8ff0-14739d4fcdf7" containerID="4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594" exitCode=0
Jul 24 17:44:36.695785 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.695603    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"
Jul 24 17:44:36.695785 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.695645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq" event={"ID":"6a0c520e-2de9-4119-8ff0-14739d4fcdf7","Type":"ContainerDied","Data":"4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594"}
Jul 24 17:44:36.695785 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.695687    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq" event={"ID":"6a0c520e-2de9-4119-8ff0-14739d4fcdf7","Type":"ContainerDied","Data":"eb7659a0d19d209377501f67799a8650447d31bb31fa2e5cad9df2786e6f9cc6"}
Jul 24 17:44:36.695785 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.695706    2568 scope.go:117] "RemoveContainer" containerID="4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594"
Jul 24 17:44:36.705132 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.705113    2568 scope.go:117] "RemoveContainer" containerID="4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594"
Jul 24 17:44:36.705437 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:44:36.705415    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594\": container with ID starting with 4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594 not found: ID does not exist" containerID="4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594"
Jul 24 17:44:36.705488 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.705446    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594"} err="failed to get container status \"4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594\": rpc error: code = NotFound desc = could not find container \"4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594\": container with ID starting with 4a72a942f26963d846bb5e5d725c535121e7b8f7c75c9dc9131a266523e4d594 not found: ID does not exist"
Jul 24 17:44:36.738067 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.738034    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"]
Jul 24 17:44:36.748406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:36.748375    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-368755/test-model-368755-kserve-57485bbbd9-tp6tq"]
Jul 24 17:44:37.905070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:37.905035    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0c520e-2de9-4119-8ff0-14739d4fcdf7" path="/var/lib/kubelet/pods/6a0c520e-2de9-4119-8ff0-14739d4fcdf7/volumes"
Jul 24 17:44:40.665893 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:40.665861    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:44:43.042551 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:43.042512    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"]
Jul 24 17:44:43.043125 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:43.042796    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" containerID="cri-o://78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb" gracePeriod=30
Jul 24 17:44:48.299170 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.299143    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:44:48.399895 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.399864    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m52mk\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-kube-api-access-m52mk\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.399927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-envoy\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.399947    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-podinfo\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.399973    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istiod-ca-cert\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-socket\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400270 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400186    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-credential-socket\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400270 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400248    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-certs\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400374 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400289    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-data\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400374 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400319    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-token\") pod \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\" (UID: \"a3156f3a-456d-482b-9ed4-8c0ac003c67f\") "
Jul 24 17:44:48.400374 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400335    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:48.400518 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400422    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:48.400518 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400427    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:44:48.400615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400566    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:48.400708 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400691    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.400791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400730    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.400791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400747    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.400791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.400761    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.401238 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.401213    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:48.402342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.402319    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:44:48.402342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.402331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-kube-api-access-m52mk" (OuterVolumeSpecName: "kube-api-access-m52mk") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "kube-api-access-m52mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:44:48.402342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.402323    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:44:48.402511 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.402403    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3156f3a-456d-482b-9ed4-8c0ac003c67f" (UID: "a3156f3a-456d-482b-9ed4-8c0ac003c67f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:44:48.501744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.501677    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.501744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.501711    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.501744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.501742    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m52mk\" (UniqueName: \"kubernetes.io/projected/a3156f3a-456d-482b-9ed4-8c0ac003c67f-kube-api-access-m52mk\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.501744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.501751    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.501744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.501760    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3156f3a-456d-482b-9ed4-8c0ac003c67f-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:44:48.755612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.755519    2568 generic.go:356] "Generic (PLEG): container finished" podID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerID="78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb" exitCode=0
Jul 24 17:44:48.755612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.755575    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"
Jul 24 17:44:48.755612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.755600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" event={"ID":"a3156f3a-456d-482b-9ed4-8c0ac003c67f","Type":"ContainerDied","Data":"78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb"}
Jul 24 17:44:48.755899 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.755642    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" event={"ID":"a3156f3a-456d-482b-9ed4-8c0ac003c67f","Type":"ContainerDied","Data":"28314d76c442f41405e528ec19e665619220e8fa64233ff9a8259bfa80ce4e49"}
Jul 24 17:44:48.755899 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.755664    2568 scope.go:117] "RemoveContainer" containerID="78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb"
Jul 24 17:44:48.764612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.764594    2568 scope.go:117] "RemoveContainer" containerID="1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"
Jul 24 17:44:48.773418 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.773399    2568 scope.go:117] "RemoveContainer" containerID="78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb"
Jul 24 17:44:48.773694 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:44:48.773671    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb\": container with ID starting with 78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb not found: ID does not exist" containerID="78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb"
Jul 24 17:44:48.773798 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.773706    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb"} err="failed to get container status \"78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb\": rpc error: code = NotFound desc = could not find container \"78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb\": container with ID starting with 78fb88a266e1a7cd4c9ca8d70132fcbc768533312ba57d435f16c8f7aeb25afb not found: ID does not exist"
Jul 24 17:44:48.773798 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.773743    2568 scope.go:117] "RemoveContainer" containerID="1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"
Jul 24 17:44:48.773993 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:44:48.773977    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248\": container with ID starting with 1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248 not found: ID does not exist" containerID="1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"
Jul 24 17:44:48.774031 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.773998    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248"} err="failed to get container status \"1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248\": rpc error: code = NotFound desc = could not find container \"1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248\": container with ID starting with 1de5f31554d1d9058c6d220a197e9a14089ed47cb6c75a4c90c9292fea2de248 not found: ID does not exist"
Jul 24 17:44:48.777954 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.777930    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"]
Jul 24 17:44:48.781825 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:48.781804    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj"]
Jul 24 17:44:49.247742 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:49.247679    2568 patch_prober.go:28] interesting pod/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:44:49.247955 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:49.247797    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5e8b71-openshift-default-579476bdb6-qbkwj" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:44:49.904556 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:49.904517    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" path="/var/lib/kubelet/pods/a3156f3a-456d-482b-9ed4-8c0ac003c67f/volumes"
Jul 24 17:44:57.259161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:44:57.259124    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:45:05.152632 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:05.152598    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"]
Jul 24 17:45:05.153107 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:05.152830    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy" containerID="cri-o://f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf" gracePeriod=30
Jul 24 17:45:08.604911 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.604868    2568 patch_prober.go:28] interesting pod/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:45:08.605383 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.604948    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:45:08.813792 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.813682    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"]
Jul 24 17:45:08.814040 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814026    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0c520e-2de9-4119-8ff0-14739d4fcdf7" containerName="main"
Jul 24 17:45:08.814103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814040    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0c520e-2de9-4119-8ff0-14739d4fcdf7" containerName="main"
Jul 24 17:45:08.814103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814064    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy"
Jul 24 17:45:08.814103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814070    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy"
Jul 24 17:45:08.814103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814081    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy"
Jul 24 17:45:08.814103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814087    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy"
Jul 24 17:45:08.814362 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814141    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy"
Jul 24 17:45:08.814362 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814148    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a0c520e-2de9-4119-8ff0-14739d4fcdf7" containerName="main"
Jul 24 17:45:08.814362 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.814154    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3156f3a-456d-482b-9ed4-8c0ac003c67f" containerName="istio-proxy"
Jul 24 17:45:08.817192 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.817174    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.820079 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.820039    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ac84f7-serving-cert\""
Jul 24 17:45:08.820079 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.820067    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9md79\""
Jul 24 17:45:08.820286 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.820074    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:45:08.820286 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.820093    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:45:08.832875 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.832847    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"]
Jul 24 17:45:08.886274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.886177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.886274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.886230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/860d8d6e-d29c-4d78-92b0-4f78e36207bc-openshift-service-ca\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.886481 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.886340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs24g\" (UniqueName: \"kubernetes.io/projected/860d8d6e-d29c-4d78-92b0-4f78e36207bc-kube-api-access-rs24g\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.987536 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.987499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.987752 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.987550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/860d8d6e-d29c-4d78-92b0-4f78e36207bc-openshift-service-ca\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.987752 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.987629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs24g\" (UniqueName: \"kubernetes.io/projected/860d8d6e-d29c-4d78-92b0-4f78e36207bc-kube-api-access-rs24g\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.987752 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:45:08.987666    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-serving-cert: secret "maas-api-e2e-api-a-ac84f7-serving-cert" not found
Jul 24 17:45:08.987752 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:45:08.987750    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls podName:860d8d6e-d29c-4d78-92b0-4f78e36207bc nodeName:}" failed. No retries permitted until 2026-07-24 17:45:09.487728709 +0000 UTC m=+2512.202882489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls") pod "maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" (UID: "860d8d6e-d29c-4d78-92b0-4f78e36207bc") : secret "maas-api-e2e-api-a-ac84f7-serving-cert" not found
Jul 24 17:45:08.988218 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.988197    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/860d8d6e-d29c-4d78-92b0-4f78e36207bc-openshift-service-ca\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:08.997503 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:08.997471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs24g\" (UniqueName: \"kubernetes.io/projected/860d8d6e-d29c-4d78-92b0-4f78e36207bc-kube-api-access-rs24g\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:09.494397 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:09.494354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:09.496969 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:09.496947    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls\") pod \"maas-api-e2e-api-a-ac84f7-867d884c68-s97dz\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:09.727418 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:09.727372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:09.861927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:09.861903    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"]
Jul 24 17:45:09.864390 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:45:09.864362    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860d8d6e_d29c_4d78_92b0_4f78e36207bc.slice/crio-50b4ef5f6e1d9804782bf2bd2573a29493e44438a2af5cb4cce62b4af0fb2fb3 WatchSource:0}: Error finding container 50b4ef5f6e1d9804782bf2bd2573a29493e44438a2af5cb4cce62b4af0fb2fb3: Status 404 returned error can't find the container with id 50b4ef5f6e1d9804782bf2bd2573a29493e44438a2af5cb4cce62b4af0fb2fb3
Jul 24 17:45:09.865503 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:09.865487    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:45:10.403883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.403861    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:45:10.504983 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.504878    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-credential-socket\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.504983 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.504927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-certs\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.504983 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.504958    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-data\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.504990    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-podinfo\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505025    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-envoy\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505042    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-token\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505062    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-socket\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505136    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjfdm\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-kube-api-access-rjfdm\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505170    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istiod-ca-cert\") pod \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\" (UID: \"c117aec1-98f7-4c0b-8e21-a4e18442c3c6\") "
Jul 24 17:45:10.505593 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505509    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:10.505857 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505820    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:10.506006 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.505981    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:10.506074 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.506016    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:45:10.506367 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.506310    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:10.507940 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.507908    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:45:10.508189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.508168    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-kube-api-access-rjfdm" (OuterVolumeSpecName: "kube-api-access-rjfdm") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "kube-api-access-rjfdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:10.508474 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.508449    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:45:10.509901 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.509876    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c117aec1-98f7-4c0b-8e21-a4e18442c3c6" (UID: "c117aec1-98f7-4c0b-8e21-a4e18442c3c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:10.606483 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606437    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjfdm\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-kube-api-access-rjfdm\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606483 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606476    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606493    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606507    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606521    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606533    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606546    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606558    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.606783 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.606571    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c117aec1-98f7-4c0b-8e21-a4e18442c3c6-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:10.870515 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.870410    2568 generic.go:356] "Generic (PLEG): container finished" podID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerID="f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf" exitCode=0
Jul 24 17:45:10.871227 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.870531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" event={"ID":"c117aec1-98f7-4c0b-8e21-a4e18442c3c6","Type":"ContainerDied","Data":"f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf"}
Jul 24 17:45:10.871227 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.870626    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g" event={"ID":"c117aec1-98f7-4c0b-8e21-a4e18442c3c6","Type":"ContainerDied","Data":"e9c3ef34649d61804b52f3da95b3a594f94f81d8cdf6579078fec646ce6f89d7"}
Jul 24 17:45:10.871227 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.870660    2568 scope.go:117] "RemoveContainer" containerID="f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf"
Jul 24 17:45:10.871227 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.870871    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"
Jul 24 17:45:10.876884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.876808    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" event={"ID":"860d8d6e-d29c-4d78-92b0-4f78e36207bc","Type":"ContainerStarted","Data":"50b4ef5f6e1d9804782bf2bd2573a29493e44438a2af5cb4cce62b4af0fb2fb3"}
Jul 24 17:45:10.887770 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.887744    2568 scope.go:117] "RemoveContainer" containerID="7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"
Jul 24 17:45:10.898684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.898586    2568 scope.go:117] "RemoveContainer" containerID="f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf"
Jul 24 17:45:10.898818 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.898793    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"]
Jul 24 17:45:10.899155 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:45:10.898999    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf\": container with ID starting with f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf not found: ID does not exist" containerID="f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf"
Jul 24 17:45:10.899155 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.899038    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf"} err="failed to get container status \"f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf\": rpc error: code = NotFound desc = could not find container \"f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf\": container with ID starting with f7f598dda0a09164bd503ac60e7437ca53ee0e1be24457ef93fd2257d4eeeebf not found: ID does not exist"
Jul 24 17:45:10.899155 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.899064    2568 scope.go:117] "RemoveContainer" containerID="7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"
Jul 24 17:45:10.899417 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:45:10.899360    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458\": container with ID starting with 7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458 not found: ID does not exist" containerID="7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"
Jul 24 17:45:10.899417 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.899399    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458"} err="failed to get container status \"7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458\": rpc error: code = NotFound desc = could not find container \"7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458\": container with ID starting with 7f1e528e2b3efb999877cc08a0eda344b42b515b67f387cf6850353fb54a2458 not found: ID does not exist"
Jul 24 17:45:10.903117 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:10.903095    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-368755-openshift-default-7c5c499884-lqp8g"]
Jul 24 17:45:11.906615 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:11.906583    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" path="/var/lib/kubelet/pods/c117aec1-98f7-4c0b-8e21-a4e18442c3c6/volumes"
Jul 24 17:45:12.890033 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:12.890000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" event={"ID":"860d8d6e-d29c-4d78-92b0-4f78e36207bc","Type":"ContainerStarted","Data":"617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855"}
Jul 24 17:45:12.890216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:12.890131    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:12.907797 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:12.907746    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" podStartSLOduration=2.594921132 podStartE2EDuration="4.907728978s" totalImagesPullingTime="2.312807846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:12.905045825 +0000 UTC m=+2515.620199611" watchObservedRunningTime="2026-07-24 17:45:12.907728978 +0000 UTC m=+2515.622882755"
Jul 24 17:45:14.117073 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.117042    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"]
Jul 24 17:45:14.117602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.117579    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy"
Jul 24 17:45:14.117782 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.117758    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy"
Jul 24 17:45:14.117925 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.117887    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy"
Jul 24 17:45:14.120895 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.120875    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.123254 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.123234    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-94ab01-openshift-default-dockercfg-ttjrd\""
Jul 24 17:45:14.133088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.133053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"]
Jul 24 17:45:14.238149 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-data\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238149 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238160    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-certs\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238369 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-envoy\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238369 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-podinfo\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238369 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-token\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238369 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238308    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-credential-socket\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238561 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-socket\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238561 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvdvx\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-kube-api-access-vvdvx\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.238561 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.238426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2738d300-3823-4c5a-a7e1-1188f2c7e458-istiod-ca-cert\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339164 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-podinfo\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339164 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-token\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-credential-socket\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-socket\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvdvx\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-kube-api-access-vvdvx\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2738d300-3823-4c5a-a7e1-1188f2c7e458-istiod-ca-cert\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339362    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-data\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339421 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-certs\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.339788 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-envoy\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.340143 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339853    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-socket\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.340143 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-certs\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.340143 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.339950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-data\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.340143 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.340100    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-credential-socket\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.340526 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.340274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2738d300-3823-4c5a-a7e1-1188f2c7e458-istiod-ca-cert\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.341649 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.341628    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-envoy\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.341899 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.341883    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-podinfo\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.354360 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.354339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-token\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.360834 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.360813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvdvx\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-kube-api-access-vvdvx\") pod \"e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") " pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.433566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.433529    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:14.580935 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.580905    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"]
Jul 24 17:45:14.583294 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:45:14.583270    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2738d300_3823_4c5a_a7e1_1188f2c7e458.slice/crio-a88ff8955784c546ec57a383b832729f2066dec0a4982a4b8602bbf4e287d827 WatchSource:0}: Error finding container a88ff8955784c546ec57a383b832729f2066dec0a4982a4b8602bbf4e287d827: Status 404 returned error can't find the container with id a88ff8955784c546ec57a383b832729f2066dec0a4982a4b8602bbf4e287d827
Jul 24 17:45:14.585452 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.585418    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:45:14.585523 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.585482    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:45:14.585523 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.585510    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:45:14.901642 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.901599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" event={"ID":"2738d300-3823-4c5a-a7e1-1188f2c7e458","Type":"ContainerStarted","Data":"c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"}
Jul 24 17:45:14.901642 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.901647    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" event={"ID":"2738d300-3823-4c5a-a7e1-1188f2c7e458","Type":"ContainerStarted","Data":"a88ff8955784c546ec57a383b832729f2066dec0a4982a4b8602bbf4e287d827"}
Jul 24 17:45:14.924529 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:14.924470    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podStartSLOduration=0.924450311 podStartE2EDuration="924.450311ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:14.923405693 +0000 UTC m=+2517.638559480" watchObservedRunningTime="2026-07-24 17:45:14.924450311 +0000 UTC m=+2517.639604097"
Jul 24 17:45:15.434054 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:15.434015    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:15.439024 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:15.438997    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:15.906594 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:15.906563    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:15.907532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:15.907512    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:16.447091 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:16.447053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:45:18.899645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:18.899610    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:29.534154 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.534120    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"]
Jul 24 17:45:29.535413 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.535389    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy"
Jul 24 17:45:29.535579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.535554    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy"
Jul 24 17:45:29.535840 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.535827    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c117aec1-98f7-4c0b-8e21-a4e18442c3c6" containerName="istio-proxy"
Jul 24 17:45:29.539373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.539353    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:29.542043 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.542024    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:45:29.548972 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.548946    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"]
Jul 24 17:45:29.577859 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.577824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2607be57-4d1f-497b-bf58-2db673ced7f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx\" (UID: \"2607be57-4d1f-497b-bf58-2db673ced7f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:29.679185 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.679148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2607be57-4d1f-497b-bf58-2db673ced7f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx\" (UID: \"2607be57-4d1f-497b-bf58-2db673ced7f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:29.679789 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.679769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2607be57-4d1f-497b-bf58-2db673ced7f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx\" (UID: \"2607be57-4d1f-497b-bf58-2db673ced7f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:29.856168 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:29.856063    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:30.014971 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:30.014934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"]
Jul 24 17:45:30.018182 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:45:30.018154    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2607be57_4d1f_497b_bf58_2db673ced7f3.slice/crio-337dbf96619e13c35f483413a1c59514dc91a5cc0b4e649c9551eac65b6a227c WatchSource:0}: Error finding container 337dbf96619e13c35f483413a1c59514dc91a5cc0b4e649c9551eac65b6a227c: Status 404 returned error can't find the container with id 337dbf96619e13c35f483413a1c59514dc91a5cc0b4e649c9551eac65b6a227c
Jul 24 17:45:30.976734 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:30.976690    2568 generic.go:356] "Generic (PLEG): container finished" podID="2607be57-4d1f-497b-bf58-2db673ced7f3" containerID="5a843484e34c38ee26c8c9bab438716d9ffc3af824f40e86ccb30be712718e16" exitCode=0
Jul 24 17:45:30.977103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:30.976747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx" event={"ID":"2607be57-4d1f-497b-bf58-2db673ced7f3","Type":"ContainerDied","Data":"5a843484e34c38ee26c8c9bab438716d9ffc3af824f40e86ccb30be712718e16"}
Jul 24 17:45:30.977103 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:30.976807    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx" event={"ID":"2607be57-4d1f-497b-bf58-2db673ced7f3","Type":"ContainerStarted","Data":"337dbf96619e13c35f483413a1c59514dc91a5cc0b4e649c9551eac65b6a227c"}
Jul 24 17:45:31.947899 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:31.947855    2568 patch_prober.go:28] interesting pod/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:45:31.948074 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:31.947911    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:45:32.043674 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.043641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:45:32.113482 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.113457    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:32.202389 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.202303    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2607be57-4d1f-497b-bf58-2db673ced7f3-maas-api-service-ca\") pod \"2607be57-4d1f-497b-bf58-2db673ced7f3\" (UID: \"2607be57-4d1f-497b-bf58-2db673ced7f3\") "
Jul 24 17:45:32.202756 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.202710    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2607be57-4d1f-497b-bf58-2db673ced7f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2607be57-4d1f-497b-bf58-2db673ced7f3" (UID: "2607be57-4d1f-497b-bf58-2db673ced7f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:45:32.303461 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.303417    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2607be57-4d1f-497b-bf58-2db673ced7f3-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:32.988246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.988201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx" event={"ID":"2607be57-4d1f-497b-bf58-2db673ced7f3","Type":"ContainerDied","Data":"337dbf96619e13c35f483413a1c59514dc91a5cc0b4e649c9551eac65b6a227c"}
Jul 24 17:45:32.988246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.988222    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"
Jul 24 17:45:32.988246 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:32.988251    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="337dbf96619e13c35f483413a1c59514dc91a5cc0b4e649c9551eac65b6a227c"
Jul 24 17:45:33.994044 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:33.994009    2568 generic.go:356] "Generic (PLEG): container finished" podID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerID="c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a" exitCode=0
Jul 24 17:45:33.994473 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:33.994061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" event={"ID":"2738d300-3823-4c5a-a7e1-1188f2c7e458","Type":"ContainerDied","Data":"c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"}
Jul 24 17:45:33.994473 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:33.994455    2568 scope.go:117] "RemoveContainer" containerID="c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"
Jul 24 17:45:33.995525 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:33.995493    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:45:33.995606 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:33.995590    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:45:33.995645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:33.995628    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:45:35.001625 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:35.001590    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" event={"ID":"2738d300-3823-4c5a-a7e1-1188f2c7e458","Type":"ContainerStarted","Data":"b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086"}
Jul 24 17:45:35.434616 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:35.434561    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:35.435378 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:35.435353    2568 patch_prober.go:28] interesting pod/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 24 17:45:35.435916 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:35.435584    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 24 17:45:36.434752 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:36.434690    2568 patch_prober.go:28] interesting pod/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 24 17:45:36.435383 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:36.435349    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 24 17:45:37.434950 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:37.434903    2568 patch_prober.go:28] interesting pod/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 24 17:45:37.435477 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:37.434974    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 24 17:45:38.434516 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:38.434473    2568 patch_prober.go:28] interesting pod/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 24 17:45:38.434757 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:38.434544    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 24 17:45:39.437579 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:39.437543    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:39.438009 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:39.437837    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:39.438546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:39.438527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:45:45.131172 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.131134    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"]
Jul 24 17:45:45.131629 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.131368    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" podUID="860d8d6e-d29c-4d78-92b0-4f78e36207bc" containerName="maas-api" containerID="cri-o://617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855" gracePeriod=30
Jul 24 17:45:45.386748 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.386670    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:45.523382 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.523343    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs24g\" (UniqueName: \"kubernetes.io/projected/860d8d6e-d29c-4d78-92b0-4f78e36207bc-kube-api-access-rs24g\") pod \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") "
Jul 24 17:45:45.523588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.523409    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls\") pod \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") "
Jul 24 17:45:45.523588 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.523442    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/860d8d6e-d29c-4d78-92b0-4f78e36207bc-openshift-service-ca\") pod \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\" (UID: \"860d8d6e-d29c-4d78-92b0-4f78e36207bc\") "
Jul 24 17:45:45.523901 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.523875    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/860d8d6e-d29c-4d78-92b0-4f78e36207bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "860d8d6e-d29c-4d78-92b0-4f78e36207bc" (UID: "860d8d6e-d29c-4d78-92b0-4f78e36207bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:45:45.525609 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.525580    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "860d8d6e-d29c-4d78-92b0-4f78e36207bc" (UID: "860d8d6e-d29c-4d78-92b0-4f78e36207bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:45:45.525701 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.525640    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860d8d6e-d29c-4d78-92b0-4f78e36207bc-kube-api-access-rs24g" (OuterVolumeSpecName: "kube-api-access-rs24g") pod "860d8d6e-d29c-4d78-92b0-4f78e36207bc" (UID: "860d8d6e-d29c-4d78-92b0-4f78e36207bc"). InnerVolumeSpecName "kube-api-access-rs24g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:45:45.624396 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.624354    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs24g\" (UniqueName: \"kubernetes.io/projected/860d8d6e-d29c-4d78-92b0-4f78e36207bc-kube-api-access-rs24g\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:45.624396 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.624388    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/860d8d6e-d29c-4d78-92b0-4f78e36207bc-maas-api-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:45.624396 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:45.624400    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/860d8d6e-d29c-4d78-92b0-4f78e36207bc-openshift-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:45:46.056835 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.056799    2568 generic.go:356] "Generic (PLEG): container finished" podID="860d8d6e-d29c-4d78-92b0-4f78e36207bc" containerID="617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855" exitCode=0
Jul 24 17:45:46.057012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.056843    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"
Jul 24 17:45:46.057012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.056881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" event={"ID":"860d8d6e-d29c-4d78-92b0-4f78e36207bc","Type":"ContainerDied","Data":"617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855"}
Jul 24 17:45:46.057012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.056935    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz" event={"ID":"860d8d6e-d29c-4d78-92b0-4f78e36207bc","Type":"ContainerDied","Data":"50b4ef5f6e1d9804782bf2bd2573a29493e44438a2af5cb4cce62b4af0fb2fb3"}
Jul 24 17:45:46.057012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.056957    2568 scope.go:117] "RemoveContainer" containerID="617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855"
Jul 24 17:45:46.065347 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.065318    2568 scope.go:117] "RemoveContainer" containerID="617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855"
Jul 24 17:45:46.065600 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:45:46.065571    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855\": container with ID starting with 617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855 not found: ID does not exist" containerID="617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855"
Jul 24 17:45:46.065702 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.065607    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855"} err="failed to get container status \"617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855\": rpc error: code = NotFound desc = could not find container \"617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855\": container with ID starting with 617ed5e030c8d85f01a2799f5c71f402031cf00c322aec8d9a92dc47b84bc855 not found: ID does not exist"
Jul 24 17:45:46.085378 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.085350    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"]
Jul 24 17:45:46.093179 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:46.093156    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ac84f7-867d884c68-s97dz"]
Jul 24 17:45:47.744076 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:47.744038    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:45:47.904984 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:47.904952    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="860d8d6e-d29c-4d78-92b0-4f78e36207bc" path="/var/lib/kubelet/pods/860d8d6e-d29c-4d78-92b0-4f78e36207bc/volumes"
Jul 24 17:45:49.616503 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:49.616465    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"]
Jul 24 17:45:49.617940 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:49.617919    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ac84f7-9lkbx"]
Jul 24 17:45:49.904874 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:49.904846    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2607be57-4d1f-497b-bf58-2db673ced7f3" path="/var/lib/kubelet/pods/2607be57-4d1f-497b-bf58-2db673ced7f3/volumes"
Jul 24 17:45:56.503780 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.503738    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"]
Jul 24 17:45:56.504284 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.504242    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2607be57-4d1f-497b-bf58-2db673ced7f3" containerName="revoke-keys"
Jul 24 17:45:56.504284 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.504261    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2607be57-4d1f-497b-bf58-2db673ced7f3" containerName="revoke-keys"
Jul 24 17:45:56.504401 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.504297    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="860d8d6e-d29c-4d78-92b0-4f78e36207bc" containerName="maas-api"
Jul 24 17:45:56.504401 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.504305    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="860d8d6e-d29c-4d78-92b0-4f78e36207bc" containerName="maas-api"
Jul 24 17:45:56.504499 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.504399    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2607be57-4d1f-497b-bf58-2db673ced7f3" containerName="revoke-keys"
Jul 24 17:45:56.504499 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.504414    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="860d8d6e-d29c-4d78-92b0-4f78e36207bc" containerName="maas-api"
Jul 24 17:45:56.507101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.507080    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:45:56.509323 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.509295    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:45:56.509447 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.509355    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:45:56.514883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.514858    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"]
Jul 24 17:45:56.625160 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.625122    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8363bd08-2bf1-4de7-8035-6d48c6937b91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-94ab01-96qs9\" (UID: \"8363bd08-2bf1-4de7-8035-6d48c6937b91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:45:56.726634 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.726598    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8363bd08-2bf1-4de7-8035-6d48c6937b91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-94ab01-96qs9\" (UID: \"8363bd08-2bf1-4de7-8035-6d48c6937b91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:45:56.727282 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.727257    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8363bd08-2bf1-4de7-8035-6d48c6937b91-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-94ab01-96qs9\" (UID: \"8363bd08-2bf1-4de7-8035-6d48c6937b91\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:45:56.819354 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.819269    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:45:56.956071 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:56.956044    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"]
Jul 24 17:45:56.958662 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:45:56.958636    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8363bd08_2bf1_4de7_8035_6d48c6937b91.slice/crio-3356644baf0f93a4523f42f841bb03374abfe6961d9f46ce280d9992d3e1ecf6 WatchSource:0}: Error finding container 3356644baf0f93a4523f42f841bb03374abfe6961d9f46ce280d9992d3e1ecf6: Status 404 returned error can't find the container with id 3356644baf0f93a4523f42f841bb03374abfe6961d9f46ce280d9992d3e1ecf6
Jul 24 17:45:57.108879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:57.108786    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9" event={"ID":"8363bd08-2bf1-4de7-8035-6d48c6937b91","Type":"ContainerStarted","Data":"3356644baf0f93a4523f42f841bb03374abfe6961d9f46ce280d9992d3e1ecf6"}
Jul 24 17:45:58.115232 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:58.115138    2568 generic.go:356] "Generic (PLEG): container finished" podID="8363bd08-2bf1-4de7-8035-6d48c6937b91" containerID="502b877ae05597eb743f7d4ee651f49652a4dd941b2e6e071e10a6e12357e8d5" exitCode=0
Jul 24 17:45:58.115595 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:58.115227    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9" event={"ID":"8363bd08-2bf1-4de7-8035-6d48c6937b91","Type":"ContainerDied","Data":"502b877ae05597eb743f7d4ee651f49652a4dd941b2e6e071e10a6e12357e8d5"}
Jul 24 17:45:59.251772 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:59.251748    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:45:59.357288 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:59.357252    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8363bd08-2bf1-4de7-8035-6d48c6937b91-maas-api-service-ca\") pod \"8363bd08-2bf1-4de7-8035-6d48c6937b91\" (UID: \"8363bd08-2bf1-4de7-8035-6d48c6937b91\") "
Jul 24 17:45:59.357627 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:59.357604    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8363bd08-2bf1-4de7-8035-6d48c6937b91-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8363bd08-2bf1-4de7-8035-6d48c6937b91" (UID: "8363bd08-2bf1-4de7-8035-6d48c6937b91"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:45:59.458486 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:45:59.458449    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8363bd08-2bf1-4de7-8035-6d48c6937b91-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:00.125788 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:00.125754    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9" event={"ID":"8363bd08-2bf1-4de7-8035-6d48c6937b91","Type":"ContainerDied","Data":"3356644baf0f93a4523f42f841bb03374abfe6961d9f46ce280d9992d3e1ecf6"}
Jul 24 17:46:00.125788 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:00.125779    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"
Jul 24 17:46:00.126002 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:00.125814    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3356644baf0f93a4523f42f841bb03374abfe6961d9f46ce280d9992d3e1ecf6"
Jul 24 17:46:16.587925 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:16.587884    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"]
Jul 24 17:46:16.591752 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:16.591725    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-94ab01-96qs9"]
Jul 24 17:46:17.248452 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:17.248412    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:46:17.908903 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:17.907066    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8363bd08-2bf1-4de7-8035-6d48c6937b91" path="/var/lib/kubelet/pods/8363bd08-2bf1-4de7-8035-6d48c6937b91/volumes"
Jul 24 17:46:18.069432 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:18.069403    2568 scope.go:117] "RemoveContainer" containerID="7a3fefa6a97f9176abef3da6fcd7ce4b928d7480144faf3d9b11c33f67e25b3c"
Jul 24 17:46:23.307791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:23.307760    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"]
Jul 24 17:46:23.308215 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:23.307968    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" containerID="cri-o://b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086" gracePeriod=30
Jul 24 17:46:24.441037 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:24.440995    2568 patch_prober.go:28] interesting pod/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 17:46:24.441497 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:24.441063    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 17:46:27.468505 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.468463    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"]
Jul 24 17:46:27.468930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.468817    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8363bd08-2bf1-4de7-8035-6d48c6937b91" containerName="revoke-keys"
Jul 24 17:46:27.468930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.468829    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8363bd08-2bf1-4de7-8035-6d48c6937b91" containerName="revoke-keys"
Jul 24 17:46:27.468930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.468884    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8363bd08-2bf1-4de7-8035-6d48c6937b91" containerName="revoke-keys"
Jul 24 17:46:27.471685 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.471666    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.474127 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.474102    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 24 17:46:27.474263 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.474207    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 17:46:27.474263 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.474222    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-13c2c7-serving-cert\""
Jul 24 17:46:27.474477 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.474460    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9md79\""
Jul 24 17:46:27.482775 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.482749    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"]
Jul 24 17:46:27.513223 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.513196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8cea3-7410-411d-a385-99fefd17a60c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.513407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.513234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd8cea3-7410-411d-a385-99fefd17a60c-maas-api-tls\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.513407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.513313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-679k2\" (UniqueName: \"kubernetes.io/projected/fdd8cea3-7410-411d-a385-99fefd17a60c-kube-api-access-679k2\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.614476 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.614436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-679k2\" (UniqueName: \"kubernetes.io/projected/fdd8cea3-7410-411d-a385-99fefd17a60c-kube-api-access-679k2\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.614676 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.614551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8cea3-7410-411d-a385-99fefd17a60c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.614676 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.614592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd8cea3-7410-411d-a385-99fefd17a60c-maas-api-tls\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.615239 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.615213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8cea3-7410-411d-a385-99fefd17a60c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.617004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.616984    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd8cea3-7410-411d-a385-99fefd17a60c-maas-api-tls\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.622128 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.622109    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-679k2\" (UniqueName: \"kubernetes.io/projected/fdd8cea3-7410-411d-a385-99fefd17a60c-kube-api-access-679k2\") pod \"maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.784047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.783952    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:27.917472 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:27.917449    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"]
Jul 24 17:46:27.920129 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:46:27.920096    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd8cea3_7410_411d_a385_99fefd17a60c.slice/crio-ed69d4c962ff8012e5dd533529cd0d6c62eb271773dd3cb8583a2c244b431dcf WatchSource:0}: Error finding container ed69d4c962ff8012e5dd533529cd0d6c62eb271773dd3cb8583a2c244b431dcf: Status 404 returned error can't find the container with id ed69d4c962ff8012e5dd533529cd0d6c62eb271773dd3cb8583a2c244b431dcf
Jul 24 17:46:28.258020 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.257987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8" event={"ID":"fdd8cea3-7410-411d-a385-99fefd17a60c","Type":"ContainerStarted","Data":"ed69d4c962ff8012e5dd533529cd0d6c62eb271773dd3cb8583a2c244b431dcf"}
Jul 24 17:46:28.549212 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.549188    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:46:28.622413 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622379    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-certs\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.622413 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622423    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2738d300-3823-4c5a-a7e1-1188f2c7e458-istiod-ca-cert\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.622684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622465    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-envoy\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.622684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622493    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-data\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.622684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622525    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvdvx\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-kube-api-access-vvdvx\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.622684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622599    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-credential-socket\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.622684 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622658    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-token\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.623212 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.622681    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:28.623359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.623250    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2738d300-3823-4c5a-a7e1-1188f2c7e458-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:46:28.623359 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.623254    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-socket\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.623530 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.623352    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:28.623530 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.623448    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-podinfo\") pod \"2738d300-3823-4c5a-a7e1-1188f2c7e458\" (UID: \"2738d300-3823-4c5a-a7e1-1188f2c7e458\") "
Jul 24 17:46:28.623530 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.623458    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:28.624075 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.623881    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-data" (OuterVolumeSpecName: "istio-data") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:28.624211 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.624186    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.624278 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.624225    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.624278 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.624266    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2738d300-3823-4c5a-a7e1-1188f2c7e458-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.624376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.624288    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.624376 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.624310    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.632686 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.632628    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:46:28.633907 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.633864    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-token" (OuterVolumeSpecName: "istio-token") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:28.634057 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.634036    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:46:28.634781 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.634759    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-kube-api-access-vvdvx" (OuterVolumeSpecName: "kube-api-access-vvdvx") pod "2738d300-3823-4c5a-a7e1-1188f2c7e458" (UID: "2738d300-3823-4c5a-a7e1-1188f2c7e458"). InnerVolumeSpecName "kube-api-access-vvdvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:46:28.725015 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.724982    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.725015 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.725012    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.725015 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.725025    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2738d300-3823-4c5a-a7e1-1188f2c7e458-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:28.725252 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:28.725034    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvdvx\" (UniqueName: \"kubernetes.io/projected/2738d300-3823-4c5a-a7e1-1188f2c7e458-kube-api-access-vvdvx\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:46:29.266386 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.266354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8" event={"ID":"fdd8cea3-7410-411d-a385-99fefd17a60c","Type":"ContainerStarted","Data":"542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311"}
Jul 24 17:46:29.266564 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.266472    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:29.268033 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.268013    2568 generic.go:356] "Generic (PLEG): container finished" podID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerID="b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086" exitCode=0
Jul 24 17:46:29.268140 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.268060    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"
Jul 24 17:46:29.268207 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.268060    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" event={"ID":"2738d300-3823-4c5a-a7e1-1188f2c7e458","Type":"ContainerDied","Data":"b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086"}
Jul 24 17:46:29.268207 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.268192    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz" event={"ID":"2738d300-3823-4c5a-a7e1-1188f2c7e458","Type":"ContainerDied","Data":"a88ff8955784c546ec57a383b832729f2066dec0a4982a4b8602bbf4e287d827"}
Jul 24 17:46:29.268313 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.268232    2568 scope.go:117] "RemoveContainer" containerID="b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086"
Jul 24 17:46:29.276998 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.276984    2568 scope.go:117] "RemoveContainer" containerID="c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"
Jul 24 17:46:29.284900 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.284876    2568 scope.go:117] "RemoveContainer" containerID="b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086"
Jul 24 17:46:29.285183 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:46:29.285163    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086\": container with ID starting with b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086 not found: ID does not exist" containerID="b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086"
Jul 24 17:46:29.285293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.285191    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086"} err="failed to get container status \"b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086\": rpc error: code = NotFound desc = could not find container \"b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086\": container with ID starting with b43cd595add36d63edbc2eb523c45c4887fb51597c442ffc04b1d53e06808086 not found: ID does not exist"
Jul 24 17:46:29.285293 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.285208    2568 scope.go:117] "RemoveContainer" containerID="c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"
Jul 24 17:46:29.285455 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:46:29.285440    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a\": container with ID starting with c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a not found: ID does not exist" containerID="c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"
Jul 24 17:46:29.285495 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.285460    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a"} err="failed to get container status \"c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a\": rpc error: code = NotFound desc = could not find container \"c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a\": container with ID starting with c9a401e4769dcaa11b78a9f49bf9a8c9f0d37c723ac989c7eae7bf1acc62a35a not found: ID does not exist"
Jul 24 17:46:29.285786 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.285749    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8" podStartSLOduration=1.8676371729999999 podStartE2EDuration="2.285710913s" totalImagesPullingTime="418.07374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:29.284823014 +0000 UTC m=+2591.999976799" watchObservedRunningTime="2026-07-24 17:46:29.285710913 +0000 UTC m=+2592.000864699"
Jul 24 17:46:29.299357 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.299330    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"]
Jul 24 17:46:29.303141 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.303118    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-94ab01-openshift-default-7d6fd48c76-66vnz"]
Jul 24 17:46:29.905394 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:29.905360    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" path="/var/lib/kubelet/pods/2738d300-3823-4c5a-a7e1-1188f2c7e458/volumes"
Jul 24 17:46:32.397696 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.397666    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"]
Jul 24 17:46:32.398090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.398031    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy"
Jul 24 17:46:32.398090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.398047    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy"
Jul 24 17:46:32.398090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.398059    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy"
Jul 24 17:46:32.398090 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.398064    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy"
Jul 24 17:46:32.398215 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.398142    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy"
Jul 24 17:46:32.398215 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.398153    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2738d300-3823-4c5a-a7e1-1188f2c7e458" containerName="istio-proxy"
Jul 24 17:46:32.402574 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.402549    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.405916 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.405897    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b9a122-openshift-default-dockercfg-wxjlw\""
Jul 24 17:46:32.418066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.418041    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"]
Jul 24 17:46:32.454107 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-envoy\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454107 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-socket\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-data\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c137f7f6-a68b-4708-b048-64921ff37caf-istiod-ca-cert\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glc9w\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-kube-api-access-glc9w\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-credential-socket\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454575 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454374    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-certs\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454575 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c137f7f6-a68b-4708-b048-64921ff37caf-istio-podinfo\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.454575 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.454497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-istio-token\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555104 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-istio-token\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-envoy\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555142    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-socket\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-data\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c137f7f6-a68b-4708-b048-64921ff37caf-istiod-ca-cert\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555221    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glc9w\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-kube-api-access-glc9w\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555241    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-credential-socket\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555671 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-certs\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555671 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c137f7f6-a68b-4708-b048-64921ff37caf-istio-podinfo\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555671 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-socket\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555896 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555867    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-certs\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.555965 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-credential-socket\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.556006 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c137f7f6-a68b-4708-b048-64921ff37caf-istiod-ca-cert\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.556006 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.555981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-data\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.557400 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.557379    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-envoy\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.557755 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.557738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c137f7f6-a68b-4708-b048-64921ff37caf-istio-podinfo\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.563829 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.563808    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-istio-token\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.564167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.564149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glc9w\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-kube-api-access-glc9w\") pod \"e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") " pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.712846 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.712743    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:32.851651 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.851509    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"]
Jul 24 17:46:32.853722 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:46:32.853673    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc137f7f6_a68b_4708_b048_64921ff37caf.slice/crio-9272b77abb1681e65bbe52bf23c02d45e96ce8e56600a77f4da0f5c41d3c919f WatchSource:0}: Error finding container 9272b77abb1681e65bbe52bf23c02d45e96ce8e56600a77f4da0f5c41d3c919f: Status 404 returned error can't find the container with id 9272b77abb1681e65bbe52bf23c02d45e96ce8e56600a77f4da0f5c41d3c919f
Jul 24 17:46:32.856035 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.856002    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:46:32.856117 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.856074    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:46:32.856117 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:32.856105    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:46:33.288565 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:33.288521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" event={"ID":"c137f7f6-a68b-4708-b048-64921ff37caf","Type":"ContainerStarted","Data":"54234a8bc5e9369f8e1e7d17579ed88457da1a919539dda923e9d3803746216a"}
Jul 24 17:46:33.288788 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:33.288581    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" event={"ID":"c137f7f6-a68b-4708-b048-64921ff37caf","Type":"ContainerStarted","Data":"9272b77abb1681e65bbe52bf23c02d45e96ce8e56600a77f4da0f5c41d3c919f"}
Jul 24 17:46:33.315694 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:33.315646    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podStartSLOduration=1.315628584 podStartE2EDuration="1.315628584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:33.31428606 +0000 UTC m=+2596.029439846" watchObservedRunningTime="2026-07-24 17:46:33.315628584 +0000 UTC m=+2596.030782370"
Jul 24 17:46:33.713092 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:33.713049    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:33.718097 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:33.718071    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:34.299101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:34.295854    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:34.299879 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:34.299857    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:34.835747 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:34.835695    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:46:35.278600 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.278572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:46:35.366800 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.366764    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"]
Jul 24 17:46:35.370963 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.370939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.373308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.373287    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b9a122-serving-cert\""
Jul 24 17:46:35.379958 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.379931    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"]
Jul 24 17:46:35.486454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.486168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzg27\" (UniqueName: \"kubernetes.io/projected/fc2a2fab-24ff-47cc-8494-7de0758741d7-kube-api-access-mzg27\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.486454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.486279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2a2fab-24ff-47cc-8494-7de0758741d7-maas-api-tls\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.486454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.486335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a2fab-24ff-47cc-8494-7de0758741d7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.587943 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.587843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2a2fab-24ff-47cc-8494-7de0758741d7-maas-api-tls\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.587943 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.587904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a2fab-24ff-47cc-8494-7de0758741d7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.588141 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.587950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzg27\" (UniqueName: \"kubernetes.io/projected/fc2a2fab-24ff-47cc-8494-7de0758741d7-kube-api-access-mzg27\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.588596 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.588576    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a2fab-24ff-47cc-8494-7de0758741d7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.590250 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.590231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2a2fab-24ff-47cc-8494-7de0758741d7-maas-api-tls\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.596029 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.596005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzg27\" (UniqueName: \"kubernetes.io/projected/fc2a2fab-24ff-47cc-8494-7de0758741d7-kube-api-access-mzg27\") pod \"maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.686256 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.686216    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:35.831439 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:35.831399    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"]
Jul 24 17:46:35.834152 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:46:35.834124    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2a2fab_24ff_47cc_8494_7de0758741d7.slice/crio-d6096801247a19664c586dd491299ee67a734f56223a2a75a9df052081744f8a WatchSource:0}: Error finding container d6096801247a19664c586dd491299ee67a734f56223a2a75a9df052081744f8a: Status 404 returned error can't find the container with id d6096801247a19664c586dd491299ee67a734f56223a2a75a9df052081744f8a
Jul 24 17:46:36.306192 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:36.306163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp" event={"ID":"fc2a2fab-24ff-47cc-8494-7de0758741d7","Type":"ContainerStarted","Data":"d6096801247a19664c586dd491299ee67a734f56223a2a75a9df052081744f8a"}
Jul 24 17:46:37.312895 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:37.312853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp" event={"ID":"fc2a2fab-24ff-47cc-8494-7de0758741d7","Type":"ContainerStarted","Data":"25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab"}
Jul 24 17:46:37.313349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:37.312937    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:37.330392 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:37.330342    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp" podStartSLOduration=1.885395237 podStartE2EDuration="2.330324831s" totalImagesPullingTime="444.929594ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:37.32957277 +0000 UTC m=+2600.044726557" watchObservedRunningTime="2026-07-24 17:46:37.330324831 +0000 UTC m=+2600.045478645"
Jul 24 17:46:43.323610 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:43.323529    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:46:48.940044 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:48.940003    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:46:50.337986 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:50.337938    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 17:46:50.338399 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:50.338021    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 17:46:51.384384 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:51.384352    2568 generic.go:356] "Generic (PLEG): container finished" podID="c137f7f6-a68b-4708-b048-64921ff37caf" containerID="54234a8bc5e9369f8e1e7d17579ed88457da1a919539dda923e9d3803746216a" exitCode=0
Jul 24 17:46:51.384880 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:51.384435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" event={"ID":"c137f7f6-a68b-4708-b048-64921ff37caf","Type":"ContainerDied","Data":"54234a8bc5e9369f8e1e7d17579ed88457da1a919539dda923e9d3803746216a"}
Jul 24 17:46:51.384880 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:51.384855    2568 scope.go:117] "RemoveContainer" containerID="54234a8bc5e9369f8e1e7d17579ed88457da1a919539dda923e9d3803746216a"
Jul 24 17:46:51.385938 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:51.385914    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:46:51.386009 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:51.385986    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:46:51.386047 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:51.386021    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:46:52.391069 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:52.391035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" event={"ID":"c137f7f6-a68b-4708-b048-64921ff37caf","Type":"ContainerStarted","Data":"c92d137234f94a28b37c8f4b65f828191d67be429438a18e2501727c8ea3132e"}
Jul 24 17:46:52.713569 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:52.713468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:52.713780 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:52.713759    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:46:52.713836 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:52.713814    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 17:46:53.713660 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:53.713621    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:46:53.714127 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:53.713677    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 17:46:54.714123 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:54.714082    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:46:54.714532 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:54.714146    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 17:46:55.714091 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:55.714046    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 24 17:46:55.714264 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:55.714117    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 24 17:46:56.716611 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:56.716573    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:56.717075 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:56.716924    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:56.717481 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:56.717466    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:46:56.960997 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:46:56.960962    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:47:10.049360 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.049323    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"]
Jul 24 17:47:10.051848 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.051832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.055030 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.055009    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"openshift-service-ca.crt\""
Jul 24 17:47:10.055161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.055032    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"default-dockercfg-6ggbf\""
Jul 24 17:47:10.055161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.055050    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"kube-root-ca.crt\""
Jul 24 17:47:10.055161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.055032    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"auth-test-model-b9a122-kserve-self-signed-certs\""
Jul 24 17:47:10.060520 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.060498    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"]
Jul 24 17:47:10.117682 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.117645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-dshm\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.117682 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.117686    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9vc\" (UniqueName: \"kubernetes.io/projected/46a74505-bf06-47e0-96cf-654647448c37-kube-api-access-5j9vc\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.117920 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.117781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a74505-bf06-47e0-96cf-654647448c37-tls-certs\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.117920 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.117880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-home\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.118011 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.117922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-model-cache\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.118011 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.117995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-tmp-dir\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.218494 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-home\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.218494 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-model-cache\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.218821 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-tmp-dir\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.218821 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-dshm\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.218821 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9vc\" (UniqueName: \"kubernetes.io/projected/46a74505-bf06-47e0-96cf-654647448c37-kube-api-access-5j9vc\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.218821 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a74505-bf06-47e0-96cf-654647448c37-tls-certs\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.219040 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.218961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-home\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.219040 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.219019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-tmp-dir\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.219116 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.219062    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-model-cache\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.221036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.221019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-dshm\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.221243 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.221228    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a74505-bf06-47e0-96cf-654647448c37-tls-certs\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.226026 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.226004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9vc\" (UniqueName: \"kubernetes.io/projected/46a74505-bf06-47e0-96cf-654647448c37-kube-api-access-5j9vc\") pod \"auth-test-model-b9a122-kserve-94bf64875-p4l5p\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") " pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.362066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.361966    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:10.498252 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:10.498149    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"]
Jul 24 17:47:10.500477 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:47:10.500444    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46a74505_bf06_47e0_96cf_654647448c37.slice/crio-96afc5515b0749db1928d8f0042b760616ce4b6f0b1aace0937d66de28a68cb8 WatchSource:0}: Error finding container 96afc5515b0749db1928d8f0042b760616ce4b6f0b1aace0937d66de28a68cb8: Status 404 returned error can't find the container with id 96afc5515b0749db1928d8f0042b760616ce4b6f0b1aace0937d66de28a68cb8
Jul 24 17:47:11.487831 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:11.487796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p" event={"ID":"46a74505-bf06-47e0-96cf-654647448c37","Type":"ContainerStarted","Data":"312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7"}
Jul 24 17:47:11.488220 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:11.487841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p" event={"ID":"46a74505-bf06-47e0-96cf-654647448c37","Type":"ContainerStarted","Data":"96afc5515b0749db1928d8f0042b760616ce4b6f0b1aace0937d66de28a68cb8"}
Jul 24 17:47:11.506042 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:11.505989    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p" podStartSLOduration=1.5059731570000001 podStartE2EDuration="1.505973157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:47:11.503565537 +0000 UTC m=+2634.218719305" watchObservedRunningTime="2026-07-24 17:47:11.505973157 +0000 UTC m=+2634.221126940"
Jul 24 17:47:13.745328 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:13.745288    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:47:20.362927 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:20.362891    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:20.363399 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:20.362940    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:20.375669 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:20.375639    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:20.541008 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:20.540978    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:47:28.047480 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:28.047439    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:47:46.846777 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:47:46.846735    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:48:01.745563 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:48:01.745524    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:48:17.949059 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:48:17.948979    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:48:17.954531 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:48:17.954510    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:48:20.644370 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:48:20.644336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:48:38.249415 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:48:38.249374    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:48:55.842495 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:48:55.842456    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:49:12.824951 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:12.824913    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"]
Jul 24 17:49:15.097757 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:15.097707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:49:27.844833 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:27.844790    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p" podUID="46a74505-bf06-47e0-96cf-654647448c37" containerName="main" containerID="cri-o://312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7" gracePeriod=45
Jul 24 17:49:28.106621 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.106552    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:49:28.135612 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.135581    2568 generic.go:356] "Generic (PLEG): container finished" podID="46a74505-bf06-47e0-96cf-654647448c37" containerID="312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7" exitCode=0
Jul 24 17:49:28.135806 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.135639    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"
Jul 24 17:49:28.135806 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.135648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p" event={"ID":"46a74505-bf06-47e0-96cf-654647448c37","Type":"ContainerDied","Data":"312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7"}
Jul 24 17:49:28.135806 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.135693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p" event={"ID":"46a74505-bf06-47e0-96cf-654647448c37","Type":"ContainerDied","Data":"96afc5515b0749db1928d8f0042b760616ce4b6f0b1aace0937d66de28a68cb8"}
Jul 24 17:49:28.135806 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.135710    2568 scope.go:117] "RemoveContainer" containerID="312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7"
Jul 24 17:49:28.144427 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.144383    2568 scope.go:117] "RemoveContainer" containerID="312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7"
Jul 24 17:49:28.144671 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:49:28.144649    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7\": container with ID starting with 312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7 not found: ID does not exist" containerID="312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7"
Jul 24 17:49:28.144803 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.144678    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7"} err="failed to get container status \"312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7\": rpc error: code = NotFound desc = could not find container \"312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7\": container with ID starting with 312e7d16de1c69a48778e6f487cdcc0910ae724dd616c9939bd07ea52520c9b7 not found: ID does not exist"
Jul 24 17:49:28.212696 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212655    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-home\") pod \"46a74505-bf06-47e0-96cf-654647448c37\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") "
Jul 24 17:49:28.212919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212707    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-dshm\") pod \"46a74505-bf06-47e0-96cf-654647448c37\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") "
Jul 24 17:49:28.212919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212763    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-model-cache\") pod \"46a74505-bf06-47e0-96cf-654647448c37\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") "
Jul 24 17:49:28.212919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212804    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-tmp-dir\") pod \"46a74505-bf06-47e0-96cf-654647448c37\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") "
Jul 24 17:49:28.212919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212873    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a74505-bf06-47e0-96cf-654647448c37-tls-certs\") pod \"46a74505-bf06-47e0-96cf-654647448c37\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") "
Jul 24 17:49:28.212919 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212898    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j9vc\" (UniqueName: \"kubernetes.io/projected/46a74505-bf06-47e0-96cf-654647448c37-kube-api-access-5j9vc\") pod \"46a74505-bf06-47e0-96cf-654647448c37\" (UID: \"46a74505-bf06-47e0-96cf-654647448c37\") "
Jul 24 17:49:28.213182 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.212992    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-home" (OuterVolumeSpecName: "home") pod "46a74505-bf06-47e0-96cf-654647448c37" (UID: "46a74505-bf06-47e0-96cf-654647448c37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:49:28.213182 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.213066    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-model-cache" (OuterVolumeSpecName: "model-cache") pod "46a74505-bf06-47e0-96cf-654647448c37" (UID: "46a74505-bf06-47e0-96cf-654647448c37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:49:28.213182 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.213143    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46a74505-bf06-47e0-96cf-654647448c37" (UID: "46a74505-bf06-47e0-96cf-654647448c37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:49:28.213182 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.213175    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-model-cache\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:49:28.213323 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.213192    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-home\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:49:28.215023 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.215003    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-dshm" (OuterVolumeSpecName: "dshm") pod "46a74505-bf06-47e0-96cf-654647448c37" (UID: "46a74505-bf06-47e0-96cf-654647448c37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:49:28.215123 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.215100    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46a74505-bf06-47e0-96cf-654647448c37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46a74505-bf06-47e0-96cf-654647448c37" (UID: "46a74505-bf06-47e0-96cf-654647448c37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:49:28.215174 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.215160    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a74505-bf06-47e0-96cf-654647448c37-kube-api-access-5j9vc" (OuterVolumeSpecName: "kube-api-access-5j9vc") pod "46a74505-bf06-47e0-96cf-654647448c37" (UID: "46a74505-bf06-47e0-96cf-654647448c37"). InnerVolumeSpecName "kube-api-access-5j9vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:49:28.314138 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.314083    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a74505-bf06-47e0-96cf-654647448c37-tls-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:49:28.314138 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.314134    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j9vc\" (UniqueName: \"kubernetes.io/projected/46a74505-bf06-47e0-96cf-654647448c37-kube-api-access-5j9vc\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:49:28.314138 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.314147    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-dshm\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:49:28.314395 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.314159    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46a74505-bf06-47e0-96cf-654647448c37-tmp-dir\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:49:28.457983 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.457946    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"]
Jul 24 17:49:28.464121 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:28.464089    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/auth-test-model-b9a122-kserve-94bf64875-p4l5p"]
Jul 24 17:49:29.444766 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:29.444730    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:49:29.905014 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:29.904984    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46a74505-bf06-47e0-96cf-654647448c37" path="/var/lib/kubelet/pods/46a74505-bf06-47e0-96cf-654647448c37/volumes"
Jul 24 17:49:58.252225 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.252187    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"]
Jul 24 17:49:58.252656 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.252531    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46a74505-bf06-47e0-96cf-654647448c37" containerName="main"
Jul 24 17:49:58.252656 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.252542    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="46a74505-bf06-47e0-96cf-654647448c37" containerName="main"
Jul 24 17:49:58.252656 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.252611    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="46a74505-bf06-47e0-96cf-654647448c37" containerName="main"
Jul 24 17:49:58.255515 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.255495    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.258849 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.258821    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"openshift-service-ca.crt\""
Jul 24 17:49:58.258979 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.258856    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"sub-test-model-b9a122-kserve-self-signed-certs\""
Jul 24 17:49:58.259045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.258969    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"kube-root-ca.crt\""
Jul 24 17:49:58.259045 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.258975    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"default-dockercfg-6ggbf\""
Jul 24 17:49:58.265504 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.265480    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"]
Jul 24 17:49:58.381340 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.381304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tmp-dir\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.381547 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.381365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tls-certs\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.381547 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.381457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xdc\" (UniqueName: \"kubernetes.io/projected/c4238bfc-0ac9-4d5c-8334-516eec6655b6-kube-api-access-l5xdc\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.381547 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.381509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-home\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.381547 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.381532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-dshm\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.381733 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.381564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-model-cache\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482020 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.481992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tls-certs\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xdc\" (UniqueName: \"kubernetes.io/projected/c4238bfc-0ac9-4d5c-8334-516eec6655b6-kube-api-access-l5xdc\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482076    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-home\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-dshm\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482121    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-model-cache\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482216 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482169    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tmp-dir\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482561 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-home\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482637 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482609    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tmp-dir\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.482687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.482639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-model-cache\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.484766 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.484742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-dshm\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.485044 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.485023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tls-certs\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.490194 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.490174    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xdc\" (UniqueName: \"kubernetes.io/projected/c4238bfc-0ac9-4d5c-8334-516eec6655b6-kube-api-access-l5xdc\") pod \"sub-test-model-b9a122-kserve-747c9c494f-jwpd5\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") " pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.565166 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.565074    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:49:58.707242 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:58.707201    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"]
Jul 24 17:49:58.709975 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:49:58.709947    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4238bfc_0ac9_4d5c_8334_516eec6655b6.slice/crio-30f8bca8db31ad9b7dee0c5a41d235c1e245c09bf6522390eb5b20cc4394137c WatchSource:0}: Error finding container 30f8bca8db31ad9b7dee0c5a41d235c1e245c09bf6522390eb5b20cc4394137c: Status 404 returned error can't find the container with id 30f8bca8db31ad9b7dee0c5a41d235c1e245c09bf6522390eb5b20cc4394137c
Jul 24 17:49:59.291214 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:59.291179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5" event={"ID":"c4238bfc-0ac9-4d5c-8334-516eec6655b6","Type":"ContainerStarted","Data":"2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0"}
Jul 24 17:49:59.291214 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:59.291220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5" event={"ID":"c4238bfc-0ac9-4d5c-8334-516eec6655b6","Type":"ContainerStarted","Data":"30f8bca8db31ad9b7dee0c5a41d235c1e245c09bf6522390eb5b20cc4394137c"}
Jul 24 17:49:59.307943 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:49:59.307893    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5" podStartSLOduration=1.307878451 podStartE2EDuration="1.307878451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:49:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:49:59.306321166 +0000 UTC m=+2802.021474946" watchObservedRunningTime="2026-07-24 17:49:59.307878451 +0000 UTC m=+2802.023032237"
Jul 24 17:50:02.347380 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:02.347340    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:50:08.565878 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:08.565823    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:50:08.566310 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:08.565910    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:50:08.578410 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:08.578382    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:50:09.351329 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:09.351298    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:50:16.842397 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:16.842365    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:50:37.348040 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:37.348004    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:50:43.665342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:43.665307    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"]
Jul 24 17:50:55.843179 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:55.843135    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:50:58.683970 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:58.683918    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5" podUID="c4238bfc-0ac9-4d5c-8334-516eec6655b6" containerName="main" containerID="cri-o://2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0" gracePeriod=45
Jul 24 17:50:58.951710 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:58.951640    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:50:59.034036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034001    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tls-certs\") pod \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") "
Jul 24 17:50:59.034242 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034049    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tmp-dir\") pod \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") "
Jul 24 17:50:59.034242 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5xdc\" (UniqueName: \"kubernetes.io/projected/c4238bfc-0ac9-4d5c-8334-516eec6655b6-kube-api-access-l5xdc\") pod \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") "
Jul 24 17:50:59.034242 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034153    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-dshm\") pod \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") "
Jul 24 17:50:59.034242 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034236    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-home\") pod \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") "
Jul 24 17:50:59.034460 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034260    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-model-cache\") pod \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\" (UID: \"c4238bfc-0ac9-4d5c-8334-516eec6655b6\") "
Jul 24 17:50:59.034460 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034380    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4238bfc-0ac9-4d5c-8334-516eec6655b6" (UID: "c4238bfc-0ac9-4d5c-8334-516eec6655b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:59.034559 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034497    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-home" (OuterVolumeSpecName: "home") pod "c4238bfc-0ac9-4d5c-8334-516eec6655b6" (UID: "c4238bfc-0ac9-4d5c-8334-516eec6655b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:59.034635 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034600    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4238bfc-0ac9-4d5c-8334-516eec6655b6" (UID: "c4238bfc-0ac9-4d5c-8334-516eec6655b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:59.035013 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.034992    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tmp-dir\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:50:59.035117 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.035037    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-home\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:50:59.035117 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.035051    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-model-cache\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:50:59.036425 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.036392    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-dshm" (OuterVolumeSpecName: "dshm") pod "c4238bfc-0ac9-4d5c-8334-516eec6655b6" (UID: "c4238bfc-0ac9-4d5c-8334-516eec6655b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:50:59.036506 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.036449    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4238bfc-0ac9-4d5c-8334-516eec6655b6" (UID: "c4238bfc-0ac9-4d5c-8334-516eec6655b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:50:59.036802 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.036761    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4238bfc-0ac9-4d5c-8334-516eec6655b6-kube-api-access-l5xdc" (OuterVolumeSpecName: "kube-api-access-l5xdc") pod "c4238bfc-0ac9-4d5c-8334-516eec6655b6" (UID: "c4238bfc-0ac9-4d5c-8334-516eec6655b6"). InnerVolumeSpecName "kube-api-access-l5xdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:50:59.135868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.135827    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4238bfc-0ac9-4d5c-8334-516eec6655b6-tls-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:50:59.135868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.135863    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5xdc\" (UniqueName: \"kubernetes.io/projected/c4238bfc-0ac9-4d5c-8334-516eec6655b6-kube-api-access-l5xdc\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:50:59.135868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.135876    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4238bfc-0ac9-4d5c-8334-516eec6655b6-dshm\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:50:59.580749 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.580698    2568 generic.go:356] "Generic (PLEG): container finished" podID="c4238bfc-0ac9-4d5c-8334-516eec6655b6" containerID="2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0" exitCode=0
Jul 24 17:50:59.580936 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.580771    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"
Jul 24 17:50:59.580936 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.580790    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5" event={"ID":"c4238bfc-0ac9-4d5c-8334-516eec6655b6","Type":"ContainerDied","Data":"2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0"}
Jul 24 17:50:59.580936 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.580838    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5" event={"ID":"c4238bfc-0ac9-4d5c-8334-516eec6655b6","Type":"ContainerDied","Data":"30f8bca8db31ad9b7dee0c5a41d235c1e245c09bf6522390eb5b20cc4394137c"}
Jul 24 17:50:59.580936 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.580862    2568 scope.go:117] "RemoveContainer" containerID="2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0"
Jul 24 17:50:59.590411 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.590391    2568 scope.go:117] "RemoveContainer" containerID="2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0"
Jul 24 17:50:59.590695 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:50:59.590676    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0\": container with ID starting with 2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0 not found: ID does not exist" containerID="2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0"
Jul 24 17:50:59.590764 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.590703    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0"} err="failed to get container status \"2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0\": rpc error: code = NotFound desc = could not find container \"2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0\": container with ID starting with 2ef202decd5a8d9879824bbbd77d6fbccdd76031c3fcb2920486d4a7fe0593f0 not found: ID does not exist"
Jul 24 17:50:59.601703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.601674    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"]
Jul 24 17:50:59.606370 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.606347    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/sub-test-model-b9a122-kserve-747c9c494f-jwpd5"]
Jul 24 17:50:59.905257 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:50:59.905228    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4238bfc-0ac9-4d5c-8334-516eec6655b6" path="/var/lib/kubelet/pods/c4238bfc-0ac9-4d5c-8334-516eec6655b6/volumes"
Jul 24 17:51:05.094303 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:05.094258    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:51:17.751002 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.750915    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"]
Jul 24 17:51:17.751508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.751438    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4238bfc-0ac9-4d5c-8334-516eec6655b6" containerName="main"
Jul 24 17:51:17.751508 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.751458    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4238bfc-0ac9-4d5c-8334-516eec6655b6" containerName="main"
Jul 24 17:51:17.751598 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.751563    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4238bfc-0ac9-4d5c-8334-516eec6655b6" containerName="main"
Jul 24 17:51:17.755760 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.755739    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.758070 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.758048    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"openshift-service-ca.crt\""
Jul 24 17:51:17.758964 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.758944    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"rate-test-model-b9a122-kserve-self-signed-certs\""
Jul 24 17:51:17.759026 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.758946    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"kube-root-ca.crt\""
Jul 24 17:51:17.759026 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.758947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b9a122\"/\"default-dockercfg-6ggbf\""
Jul 24 17:51:17.765796 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.765775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"]
Jul 24 17:51:17.811229 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.811196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tmp-dir\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.811406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.811262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662d4\" (UniqueName: \"kubernetes.io/projected/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-kube-api-access-662d4\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.811406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.811285    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-dshm\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.811406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.811310    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-home\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.811406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.811368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-model-cache\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.811406 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.811394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tls-certs\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.912657 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.912625    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-model-cache\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.912868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.912665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tls-certs\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.912868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.912692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tmp-dir\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.912868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.912750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-662d4\" (UniqueName: \"kubernetes.io/projected/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-kube-api-access-662d4\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.912868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.912772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-dshm\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.912868 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.912792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-home\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.913150 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.913114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-model-cache\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.913203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.913152    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tmp-dir\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.913203 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.913190    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-home\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.915116 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.915088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-dshm\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.915665 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.915639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tls-certs\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:17.924154 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:17.924125    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-662d4\" (UniqueName: \"kubernetes.io/projected/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-kube-api-access-662d4\") pod \"rate-test-model-b9a122-kserve-66b875d55-2bb64\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") " pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:18.065940 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:18.065851    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:18.200066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:18.200037    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"]
Jul 24 17:51:18.203376 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:51:18.203345    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82b9b6fd_40fc_4202_8d02_78bd07fb1b48.slice/crio-f2049f17881119f35c67373853cbf89810a692f864adbb1e4894e9352c1e33f7 WatchSource:0}: Error finding container f2049f17881119f35c67373853cbf89810a692f864adbb1e4894e9352c1e33f7: Status 404 returned error can't find the container with id f2049f17881119f35c67373853cbf89810a692f864adbb1e4894e9352c1e33f7
Jul 24 17:51:18.675004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:18.674968    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64" event={"ID":"82b9b6fd-40fc-4202-8d02-78bd07fb1b48","Type":"ContainerStarted","Data":"82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710"}
Jul 24 17:51:18.675004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:18.675015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64" event={"ID":"82b9b6fd-40fc-4202-8d02-78bd07fb1b48","Type":"ContainerStarted","Data":"f2049f17881119f35c67373853cbf89810a692f864adbb1e4894e9352c1e33f7"}
Jul 24 17:51:18.694119 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:18.694068    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64" podStartSLOduration=1.694051094 podStartE2EDuration="1.694051094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:51:18.691953038 +0000 UTC m=+2881.407106873" watchObservedRunningTime="2026-07-24 17:51:18.694051094 +0000 UTC m=+2881.409204879"
Jul 24 17:51:21.354999 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:21.354964    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:51:28.066913 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:28.066878    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:28.067446 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:28.067085    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:28.079451 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:28.079421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:28.733645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:28.733614    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:51:36.060234 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:36.060184    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:51:54.661951 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:51:54.661918    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:52:03.136885 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:03.136846    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"]
Jul 24 17:52:10.145036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:10.145000    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:52:18.144013 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.143985    2568 scope.go:117] "RemoveContainer" containerID="502b877ae05597eb743f7d4ee651f49652a4dd941b2e6e071e10a6e12357e8d5"
Jul 24 17:52:18.152848 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.152828    2568 scope.go:117] "RemoveContainer" containerID="5a843484e34c38ee26c8c9bab438716d9ffc3af824f40e86ccb30be712718e16"
Jul 24 17:52:18.155666 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.155602    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64" podUID="82b9b6fd-40fc-4202-8d02-78bd07fb1b48" containerName="main" containerID="cri-o://82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710" gracePeriod=45
Jul 24 17:52:18.409566 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.409543    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:52:18.464480 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464451    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-home\") pod \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") "
Jul 24 17:52:18.464690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464497    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-662d4\" (UniqueName: \"kubernetes.io/projected/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-kube-api-access-662d4\") pod \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") "
Jul 24 17:52:18.464690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464518    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-model-cache\") pod \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") "
Jul 24 17:52:18.464690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464594    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tmp-dir\") pod \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") "
Jul 24 17:52:18.464690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464616    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-dshm\") pod \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") "
Jul 24 17:52:18.464690 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464676    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tls-certs\") pod \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\" (UID: \"82b9b6fd-40fc-4202-8d02-78bd07fb1b48\") "
Jul 24 17:52:18.464982 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464807    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-home" (OuterVolumeSpecName: "home") pod "82b9b6fd-40fc-4202-8d02-78bd07fb1b48" (UID: "82b9b6fd-40fc-4202-8d02-78bd07fb1b48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:18.464982 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464854    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-model-cache" (OuterVolumeSpecName: "model-cache") pod "82b9b6fd-40fc-4202-8d02-78bd07fb1b48" (UID: "82b9b6fd-40fc-4202-8d02-78bd07fb1b48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:18.464982 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464866    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82b9b6fd-40fc-4202-8d02-78bd07fb1b48" (UID: "82b9b6fd-40fc-4202-8d02-78bd07fb1b48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:18.465132 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.464987    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-home\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:52:18.465132 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.465000    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-model-cache\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:52:18.465132 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.465029    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tmp-dir\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:52:18.466667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.466645    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-dshm" (OuterVolumeSpecName: "dshm") pod "82b9b6fd-40fc-4202-8d02-78bd07fb1b48" (UID: "82b9b6fd-40fc-4202-8d02-78bd07fb1b48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:52:18.466766 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.466710    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82b9b6fd-40fc-4202-8d02-78bd07fb1b48" (UID: "82b9b6fd-40fc-4202-8d02-78bd07fb1b48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:52:18.466840 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.466823    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-kube-api-access-662d4" (OuterVolumeSpecName: "kube-api-access-662d4") pod "82b9b6fd-40fc-4202-8d02-78bd07fb1b48" (UID: "82b9b6fd-40fc-4202-8d02-78bd07fb1b48"). InnerVolumeSpecName "kube-api-access-662d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:52:18.566274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.566237    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-662d4\" (UniqueName: \"kubernetes.io/projected/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-kube-api-access-662d4\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:52:18.566274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.566265    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-dshm\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:52:18.566274 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.566280    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b9b6fd-40fc-4202-8d02-78bd07fb1b48-tls-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:52:18.960212 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.960178    2568 generic.go:356] "Generic (PLEG): container finished" podID="82b9b6fd-40fc-4202-8d02-78bd07fb1b48" containerID="82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710" exitCode=0
Jul 24 17:52:18.960409 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.960225    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"
Jul 24 17:52:18.960409 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.960252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64" event={"ID":"82b9b6fd-40fc-4202-8d02-78bd07fb1b48","Type":"ContainerDied","Data":"82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710"}
Jul 24 17:52:18.960409 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.960290    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64" event={"ID":"82b9b6fd-40fc-4202-8d02-78bd07fb1b48","Type":"ContainerDied","Data":"f2049f17881119f35c67373853cbf89810a692f864adbb1e4894e9352c1e33f7"}
Jul 24 17:52:18.960409 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.960313    2568 scope.go:117] "RemoveContainer" containerID="82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710"
Jul 24 17:52:18.969286 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.969271    2568 scope.go:117] "RemoveContainer" containerID="82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710"
Jul 24 17:52:18.969567 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:52:18.969544    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710\": container with ID starting with 82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710 not found: ID does not exist" containerID="82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710"
Jul 24 17:52:18.969658 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.969575    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710"} err="failed to get container status \"82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710\": rpc error: code = NotFound desc = could not find container \"82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710\": container with ID starting with 82e2baade0ddd9e97a390ef115f70b213493cf31e3d17624f40610734af57710 not found: ID does not exist"
Jul 24 17:52:18.981860 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.981824    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"]
Jul 24 17:52:18.984223 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:18.984194    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b9a122/rate-test-model-b9a122-kserve-66b875d55-2bb64"]
Jul 24 17:52:19.905575 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:19.905540    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b9b6fd-40fc-4202-8d02-78bd07fb1b48" path="/var/lib/kubelet/pods/82b9b6fd-40fc-4202-8d02-78bd07fb1b48/volumes"
Jul 24 17:52:23.419544 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.419499    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"]
Jul 24 17:52:23.420869 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.420846    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b9b6fd-40fc-4202-8d02-78bd07fb1b48" containerName="main"
Jul 24 17:52:23.421027 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.421015    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b9b6fd-40fc-4202-8d02-78bd07fb1b48" containerName="main"
Jul 24 17:52:23.421308 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.421296    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b9b6fd-40fc-4202-8d02-78bd07fb1b48" containerName="main"
Jul 24 17:52:23.426468 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.426443    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.428905 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.428877    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-92693f-openshift-default-dockercfg-x4cdj\""
Jul 24 17:52:23.438088 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.438059    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"]
Jul 24 17:52:23.507262 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istiod-ca-cert\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507472 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-credential-socket\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507472 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507328    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-certs\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507472 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-data\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507472 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-podinfo\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507472 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-token\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507774 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507475    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-envoy\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507774 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glvsx\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-kube-api-access-glvsx\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.507774 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.507566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-socket\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.608875 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.608841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glvsx\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-kube-api-access-glvsx\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.608875 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.608881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-socket\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609099 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istiod-ca-cert\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609146 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-credential-socket\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609146 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-certs\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609307 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-data\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609307 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-podinfo\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609307 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-token\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609307 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609238    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-envoy\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609524 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-socket\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609524 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-credential-socket\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-certs\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609638 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609617    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-data\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.609810 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.609792    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istiod-ca-cert\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.611651 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.611626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-envoy\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.611935 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.611914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-podinfo\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.619910 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.619888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-token\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.624014 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.623988    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glvsx\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-kube-api-access-glvsx\") pod \"e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") " pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.739686 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.739601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:23.889136 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.889071    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"]
Jul 24 17:52:23.890776 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:52:23.890695    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9572c22b_3c93_42d2_b83f_3ddf9dd510b4.slice/crio-67fec5fc403365bcf7cc50326ebd10675fd3281987108666258acc9db0a0bc3e WatchSource:0}: Error finding container 67fec5fc403365bcf7cc50326ebd10675fd3281987108666258acc9db0a0bc3e: Status 404 returned error can't find the container with id 67fec5fc403365bcf7cc50326ebd10675fd3281987108666258acc9db0a0bc3e
Jul 24 17:52:23.895987 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.895953    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:52:23.896133 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.896022    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:52:23.896133 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.896052    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:52:23.987575 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.987530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" event={"ID":"9572c22b-3c93-42d2-b83f-3ddf9dd510b4","Type":"ContainerStarted","Data":"580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"}
Jul 24 17:52:23.987792 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:23.987591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" event={"ID":"9572c22b-3c93-42d2-b83f-3ddf9dd510b4","Type":"ContainerStarted","Data":"67fec5fc403365bcf7cc50326ebd10675fd3281987108666258acc9db0a0bc3e"}
Jul 24 17:52:24.007700 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:24.007588    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" podStartSLOduration=1.007570522 podStartE2EDuration="1.007570522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:24.006305734 +0000 UTC m=+2946.721459557" watchObservedRunningTime="2026-07-24 17:52:24.007570522 +0000 UTC m=+2946.722724376"
Jul 24 17:52:24.740052 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:24.740009    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:24.745240 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:24.745211    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:24.992735 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:24.992633    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:24.993595 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:24.993576    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:30.940922 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:30.940888    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:52:39.069878 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.069794    2568 generic.go:356] "Generic (PLEG): container finished" podID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerID="580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce" exitCode=0
Jul 24 17:52:39.070304 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.069869    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" event={"ID":"9572c22b-3c93-42d2-b83f-3ddf9dd510b4","Type":"ContainerDied","Data":"580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"}
Jul 24 17:52:39.070304 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.070248    2568 scope.go:117] "RemoveContainer" containerID="580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"
Jul 24 17:52:39.071310 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.071282    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:52:39.071377 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.071362    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:52:39.071420 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.071400    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 17:52:39.992966 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:39.992919    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:40.077685 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:40.077649    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" event={"ID":"9572c22b-3c93-42d2-b83f-3ddf9dd510b4","Type":"ContainerStarted","Data":"968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa"}
Jul 24 17:52:40.740139 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:40.740099    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:40.741413 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:40.741381    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:52:40.741741 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:40.741691    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:52:41.750740 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:41.741150    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:52:41.750740 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:41.741234    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:52:42.740408 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:42.740369    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:52:42.740747 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:42.740693    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:52:43.740838 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:43.740799    2568 patch_prober.go:28] interesting pod/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 24 17:52:43.741490 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:43.741457    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 24 17:52:44.744623 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.744594    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:44.745054 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.744948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:44.745551 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.745536    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:52:44.859251 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.859216    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"]
Jul 24 17:52:44.862373 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.862349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:44.864673 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.864646    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-ea8b57-serving-cert\""
Jul 24 17:52:44.878052 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.878027    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"]
Jul 24 17:52:44.911469 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.911434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:44.911656 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.911490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjnbk\" (UniqueName: \"kubernetes.io/projected/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-kube-api-access-gjnbk\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:44.911656 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:44.911578    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.012766 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.012629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjnbk\" (UniqueName: \"kubernetes.io/projected/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-kube-api-access-gjnbk\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.013004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.012790    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.013004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.012897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.013004 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:52:45.012936    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-serving-cert: secret "maas-api-e2e-ipp-b-ea8b57-serving-cert" not found
Jul 24 17:52:45.013141 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:52:45.013012    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls podName:e6a621ee-1d3d-49a3-adce-b6fb3b7644df nodeName:}" failed. No retries permitted until 2026-07-24 17:52:45.512991667 +0000 UTC m=+2968.228145438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls") pod "maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" (UID: "e6a621ee-1d3d-49a3-adce-b6fb3b7644df") : secret "maas-api-e2e-ipp-b-ea8b57-serving-cert" not found
Jul 24 17:52:45.013480 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.013462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.028946 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.028902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjnbk\" (UniqueName: \"kubernetes.io/projected/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-kube-api-access-gjnbk\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.516931 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.516892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.519463 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.519434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls\") pod \"maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.774010 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.773919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:45.928479 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.928438    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"]
Jul 24 17:52:45.932256 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:52:45.932233    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a621ee_1d3d_49a3_adce_b6fb3b7644df.slice/crio-d2abf385f6b5914b0c326a1559e7347b2992bf1ac382754f6d91c4454651473d WatchSource:0}: Error finding container d2abf385f6b5914b0c326a1559e7347b2992bf1ac382754f6d91c4454651473d: Status 404 returned error can't find the container with id d2abf385f6b5914b0c326a1559e7347b2992bf1ac382754f6d91c4454651473d
Jul 24 17:52:45.933669 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:45.933650    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:52:46.108827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:46.108731    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" event={"ID":"e6a621ee-1d3d-49a3-adce-b6fb3b7644df","Type":"ContainerStarted","Data":"d2abf385f6b5914b0c326a1559e7347b2992bf1ac382754f6d91c4454651473d"}
Jul 24 17:52:47.114823 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:47.114785    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" event={"ID":"e6a621ee-1d3d-49a3-adce-b6fb3b7644df","Type":"ContainerStarted","Data":"9041df01101d175ad7227976bd9a238bb754ed6aec4a881d91a0b5adfaa4c5ad"}
Jul 24 17:52:47.115202 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:47.114935    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:52:47.155758 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:47.155680    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" podStartSLOduration=2.630280656 podStartE2EDuration="3.155660035s" totalImagesPullingTime="525.379379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:47.15456146 +0000 UTC m=+2969.869715268" watchObservedRunningTime="2026-07-24 17:52:47.155660035 +0000 UTC m=+2969.870813813"
Jul 24 17:52:48.448450 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:48.448415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:52:53.125163 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:52:53.125132    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:53:17.976344 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:17.976318    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:53:17.983342 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:17.983322    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bwkhv_d8d1820b-db2a-428b-b6c5-fb6cb2d67ac4/ovn-acl-logging/0.log"
Jul 24 17:53:25.851641 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:25.851597    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:53:41.958144 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:41.958105    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:53:58.328017 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.327984    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"]
Jul 24 17:53:58.330253 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.330234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.333304 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.333284    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-201d60-serving-cert\""
Jul 24 17:53:58.353999 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.353960    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"]
Jul 24 17:53:58.481979 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.481942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b479f1-7a85-4e6b-adb3-071d4900ce17-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.482183 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.482002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9s6\" (UniqueName: \"kubernetes.io/projected/64b479f1-7a85-4e6b-adb3-071d4900ce17-kube-api-access-fq9s6\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.482183 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.482126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.583442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.583342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.583442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.583410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b479f1-7a85-4e6b-adb3-071d4900ce17-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.583703 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.583453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9s6\" (UniqueName: \"kubernetes.io/projected/64b479f1-7a85-4e6b-adb3-071d4900ce17-kube-api-access-fq9s6\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.583703 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:53:58.583502    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-serving-cert: secret "maas-api-e2e-ipp-cleanup-201d60-serving-cert" not found
Jul 24 17:53:58.583703 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:53:58.583598    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls podName:64b479f1-7a85-4e6b-adb3-071d4900ce17 nodeName:}" failed. No retries permitted until 2026-07-24 17:53:59.083575241 +0000 UTC m=+3041.798729018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" (UID: "64b479f1-7a85-4e6b-adb3-071d4900ce17") : secret "maas-api-e2e-ipp-cleanup-201d60-serving-cert" not found
Jul 24 17:53:58.584104 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.584084    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b479f1-7a85-4e6b-adb3-071d4900ce17-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:58.600372 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:58.600346    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9s6\" (UniqueName: \"kubernetes.io/projected/64b479f1-7a85-4e6b-adb3-071d4900ce17-kube-api-access-fq9s6\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:59.088031 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:53:59.087991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:53:59.088220 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:53:59.088132    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-serving-cert: secret "maas-api-e2e-ipp-cleanup-201d60-serving-cert" not found
Jul 24 17:53:59.088220 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:53:59.088218    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls podName:64b479f1-7a85-4e6b-adb3-071d4900ce17 nodeName:}" failed. No retries permitted until 2026-07-24 17:54:00.088196847 +0000 UTC m=+3042.803350618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" (UID: "64b479f1-7a85-4e6b-adb3-071d4900ce17") : secret "maas-api-e2e-ipp-cleanup-201d60-serving-cert" not found
Jul 24 17:54:00.097930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:00.097892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:00.100337 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:00.100303    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:00.140354 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:00.140317    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:00.286232 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:00.286195    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"]
Jul 24 17:54:00.288578 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:54:00.288549    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b479f1_7a85_4e6b_adb3_071d4900ce17.slice/crio-d98ab7c9186c7b5f6ddcc57bef0a90b65216bdac7c8319b56dd1b9bcc45c3fb8 WatchSource:0}: Error finding container d98ab7c9186c7b5f6ddcc57bef0a90b65216bdac7c8319b56dd1b9bcc45c3fb8: Status 404 returned error can't find the container with id d98ab7c9186c7b5f6ddcc57bef0a90b65216bdac7c8319b56dd1b9bcc45c3fb8
Jul 24 17:54:00.469940 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:00.469896    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" event={"ID":"64b479f1-7a85-4e6b-adb3-071d4900ce17","Type":"ContainerStarted","Data":"d98ab7c9186c7b5f6ddcc57bef0a90b65216bdac7c8319b56dd1b9bcc45c3fb8"}
Jul 24 17:54:01.476478 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:01.476441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" event={"ID":"64b479f1-7a85-4e6b-adb3-071d4900ce17","Type":"ContainerStarted","Data":"eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e"}
Jul 24 17:54:01.476914 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:01.476548    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:01.519929 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:01.519876    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" podStartSLOduration=3.081478349 podStartE2EDuration="3.519859349s" totalImagesPullingTime="438.381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:54:01.519307712 +0000 UTC m=+3044.234461498" watchObservedRunningTime="2026-07-24 17:54:01.519859349 +0000 UTC m=+3044.235013134"
Jul 24 17:54:03.069407 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:03.069371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:54:07.486650 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:07.486621    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:24.179012 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.178983    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"]
Jul 24 17:54:24.179542 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.179179    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" podUID="64b479f1-7a85-4e6b-adb3-071d4900ce17" containerName="maas-api" containerID="cri-o://eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e" gracePeriod=30
Jul 24 17:54:24.427385 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.427362    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:24.524805 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.524686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b479f1-7a85-4e6b-adb3-071d4900ce17-openshift-service-ca\") pod \"64b479f1-7a85-4e6b-adb3-071d4900ce17\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") "
Jul 24 17:54:24.524805 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.524763    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq9s6\" (UniqueName: \"kubernetes.io/projected/64b479f1-7a85-4e6b-adb3-071d4900ce17-kube-api-access-fq9s6\") pod \"64b479f1-7a85-4e6b-adb3-071d4900ce17\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") "
Jul 24 17:54:24.525019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.524838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") pod \"64b479f1-7a85-4e6b-adb3-071d4900ce17\" (UID: \"64b479f1-7a85-4e6b-adb3-071d4900ce17\") "
Jul 24 17:54:24.525111 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.525081    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b479f1-7a85-4e6b-adb3-071d4900ce17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64b479f1-7a85-4e6b-adb3-071d4900ce17" (UID: "64b479f1-7a85-4e6b-adb3-071d4900ce17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:54:24.525225 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.525195    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b479f1-7a85-4e6b-adb3-071d4900ce17-openshift-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:54:24.527025 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.526987    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64b479f1-7a85-4e6b-adb3-071d4900ce17" (UID: "64b479f1-7a85-4e6b-adb3-071d4900ce17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:54:24.527148 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.527000    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b479f1-7a85-4e6b-adb3-071d4900ce17-kube-api-access-fq9s6" (OuterVolumeSpecName: "kube-api-access-fq9s6") pod "64b479f1-7a85-4e6b-adb3-071d4900ce17" (UID: "64b479f1-7a85-4e6b-adb3-071d4900ce17"). InnerVolumeSpecName "kube-api-access-fq9s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:54:24.592282 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.592249    2568 generic.go:356] "Generic (PLEG): container finished" podID="64b479f1-7a85-4e6b-adb3-071d4900ce17" containerID="eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e" exitCode=0
Jul 24 17:54:24.592487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.592294    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"
Jul 24 17:54:24.592487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.592333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" event={"ID":"64b479f1-7a85-4e6b-adb3-071d4900ce17","Type":"ContainerDied","Data":"eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e"}
Jul 24 17:54:24.592487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.592389    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg" event={"ID":"64b479f1-7a85-4e6b-adb3-071d4900ce17","Type":"ContainerDied","Data":"d98ab7c9186c7b5f6ddcc57bef0a90b65216bdac7c8319b56dd1b9bcc45c3fb8"}
Jul 24 17:54:24.592487 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.592418    2568 scope.go:117] "RemoveContainer" containerID="eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e"
Jul 24 17:54:24.604540 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.604517    2568 scope.go:117] "RemoveContainer" containerID="eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e"
Jul 24 17:54:24.604860 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:54:24.604834    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e\": container with ID starting with eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e not found: ID does not exist" containerID="eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e"
Jul 24 17:54:24.604978 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.604867    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e"} err="failed to get container status \"eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e\": rpc error: code = NotFound desc = could not find container \"eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e\": container with ID starting with eff09063b281b84d2d1b6b8c42d0c28fadf93158fd94986cdd8bfad3ef9a8c7e not found: ID does not exist"
Jul 24 17:54:24.620356 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.620327    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"]
Jul 24 17:54:24.626194 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.626162    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-201d60-544466689d-t49zg"]
Jul 24 17:54:24.626432 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.626412    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b479f1-7a85-4e6b-adb3-071d4900ce17-maas-api-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:54:24.626502 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:24.626438    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq9s6\" (UniqueName: \"kubernetes.io/projected/64b479f1-7a85-4e6b-adb3-071d4900ce17-kube-api-access-fq9s6\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:54:25.905064 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:25.905032    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b479f1-7a85-4e6b-adb3-071d4900ce17" path="/var/lib/kubelet/pods/64b479f1-7a85-4e6b-adb3-071d4900ce17/volumes"
Jul 24 17:54:30.559998 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:30.559956    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:54:39.593689 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.593648    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"]
Jul 24 17:54:39.594189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.594054    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b479f1-7a85-4e6b-adb3-071d4900ce17" containerName="maas-api"
Jul 24 17:54:39.594189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.594067    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b479f1-7a85-4e6b-adb3-071d4900ce17" containerName="maas-api"
Jul 24 17:54:39.594189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.594152    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b479f1-7a85-4e6b-adb3-071d4900ce17" containerName="maas-api"
Jul 24 17:54:39.596116 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.596098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:39.599065 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.599044    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8llqd\""
Jul 24 17:54:39.606884 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.606861    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"]
Jul 24 17:54:39.670265 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.670229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eff3b49f-fe86-4cc9-925e-d67ccfba1589-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2\" (UID: \"eff3b49f-fe86-4cc9-925e-d67ccfba1589\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:39.771161 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.771124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eff3b49f-fe86-4cc9-925e-d67ccfba1589-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2\" (UID: \"eff3b49f-fe86-4cc9-925e-d67ccfba1589\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:39.771767 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.771750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eff3b49f-fe86-4cc9-925e-d67ccfba1589-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2\" (UID: \"eff3b49f-fe86-4cc9-925e-d67ccfba1589\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:39.907004 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:39.906960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:40.053162 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:40.053087    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"]
Jul 24 17:54:40.055872 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:54:40.055840    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff3b49f_fe86_4cc9_925e_d67ccfba1589.slice/crio-5c800b944d38109634b67cd68df8485504e5c75181a0f0a810226249a9f223bf WatchSource:0}: Error finding container 5c800b944d38109634b67cd68df8485504e5c75181a0f0a810226249a9f223bf: Status 404 returned error can't find the container with id 5c800b944d38109634b67cd68df8485504e5c75181a0f0a810226249a9f223bf
Jul 24 17:54:40.670490 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:40.670450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2" event={"ID":"eff3b49f-fe86-4cc9-925e-d67ccfba1589","Type":"ContainerStarted","Data":"bf161415bee5812522f5e4c189903de4e4f393f3f36cc8ae9746424e75d1d146"}
Jul 24 17:54:40.670908 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:40.670542    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2" event={"ID":"eff3b49f-fe86-4cc9-925e-d67ccfba1589","Type":"ContainerStarted","Data":"5c800b944d38109634b67cd68df8485504e5c75181a0f0a810226249a9f223bf"}
Jul 24 17:54:41.677706 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:41.677669    2568 generic.go:356] "Generic (PLEG): container finished" podID="eff3b49f-fe86-4cc9-925e-d67ccfba1589" containerID="bf161415bee5812522f5e4c189903de4e4f393f3f36cc8ae9746424e75d1d146" exitCode=0
Jul 24 17:54:41.678157 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:41.677772    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2" event={"ID":"eff3b49f-fe86-4cc9-925e-d67ccfba1589","Type":"ContainerDied","Data":"bf161415bee5812522f5e4c189903de4e4f393f3f36cc8ae9746424e75d1d146"}
Jul 24 17:54:42.816387 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:42.816363    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:42.902036 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:42.902006    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eff3b49f-fe86-4cc9-925e-d67ccfba1589-maas-api-service-ca\") pod \"eff3b49f-fe86-4cc9-925e-d67ccfba1589\" (UID: \"eff3b49f-fe86-4cc9-925e-d67ccfba1589\") "
Jul 24 17:54:42.902352 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:42.902331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eff3b49f-fe86-4cc9-925e-d67ccfba1589-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eff3b49f-fe86-4cc9-925e-d67ccfba1589" (UID: "eff3b49f-fe86-4cc9-925e-d67ccfba1589"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:54:43.003214 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:43.003131    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eff3b49f-fe86-4cc9-925e-d67ccfba1589-maas-api-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:54:43.689946 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:43.689912    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"
Jul 24 17:54:43.690126 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:43.689942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2" event={"ID":"eff3b49f-fe86-4cc9-925e-d67ccfba1589","Type":"ContainerDied","Data":"5c800b944d38109634b67cd68df8485504e5c75181a0f0a810226249a9f223bf"}
Jul 24 17:54:43.690126 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:43.689988    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c800b944d38109634b67cd68df8485504e5c75181a0f0a810226249a9f223bf"
Jul 24 17:54:53.883887 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:53.883849    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:54:59.723005 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:59.722969    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"]
Jul 24 17:54:59.728687 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:59.728662    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-92693f-4zfr2"]
Jul 24 17:54:59.905019 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:54:59.904984    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff3b49f-fe86-4cc9-925e-d67ccfba1589" path="/var/lib/kubelet/pods/eff3b49f-fe86-4cc9-925e-d67ccfba1589/volumes"
Jul 24 17:55:05.052836 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:05.052803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:55:49.643213 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:49.643131    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"]
Jul 24 17:55:49.643726 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:49.643421    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy" containerID="cri-o://968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa" gracePeriod=30
Jul 24 17:55:54.896150 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.896125    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:55:54.978404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978314    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glvsx\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-kube-api-access-glvsx\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978404 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978370    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-podinfo\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978419    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-data\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978446    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-token\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978471    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-socket\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978498    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istiod-ca-cert\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978557    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-envoy\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978582    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-certs\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.978645 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.978635    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-credential-socket\") pod \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\" (UID: \"9572c22b-3c93-42d2-b83f-3ddf9dd510b4\") "
Jul 24 17:55:54.979066 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.979033    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:55:54.979543 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.979124    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:55:54.979543 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.979045    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:55:54.979543 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.979331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:55:54.979930 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.979905    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:55:54.981267 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.981197    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-kube-api-access-glvsx" (OuterVolumeSpecName: "kube-api-access-glvsx") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "kube-api-access-glvsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:55:54.981391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.981314    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:55:54.981391 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.981356    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:55:54.981852 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:54.981819    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9572c22b-3c93-42d2-b83f-3ddf9dd510b4" (UID: "9572c22b-3c93-42d2-b83f-3ddf9dd510b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:55:55.044146 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.044114    2568 generic.go:356] "Generic (PLEG): container finished" podID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerID="968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa" exitCode=0
Jul 24 17:55:55.044341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.044174    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"
Jul 24 17:55:55.044341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.044179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" event={"ID":"9572c22b-3c93-42d2-b83f-3ddf9dd510b4","Type":"ContainerDied","Data":"968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa"}
Jul 24 17:55:55.044341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.044295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m" event={"ID":"9572c22b-3c93-42d2-b83f-3ddf9dd510b4","Type":"ContainerDied","Data":"67fec5fc403365bcf7cc50326ebd10675fd3281987108666258acc9db0a0bc3e"}
Jul 24 17:55:55.044341 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.044316    2568 scope.go:117] "RemoveContainer" containerID="968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa"
Jul 24 17:55:55.053079 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.053059    2568 scope.go:117] "RemoveContainer" containerID="580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"
Jul 24 17:55:55.061098 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.061078    2568 scope.go:117] "RemoveContainer" containerID="968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa"
Jul 24 17:55:55.061354 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:55:55.061334    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa\": container with ID starting with 968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa not found: ID does not exist" containerID="968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa"
Jul 24 17:55:55.061429 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.061367    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa"} err="failed to get container status \"968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa\": rpc error: code = NotFound desc = could not find container \"968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa\": container with ID starting with 968595399afe95767fc7496304adf440542f7011ba8e14b6345747952a9fa6fa not found: ID does not exist"
Jul 24 17:55:55.061429 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.061392    2568 scope.go:117] "RemoveContainer" containerID="580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"
Jul 24 17:55:55.061646 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:55:55.061628    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce\": container with ID starting with 580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce not found: ID does not exist" containerID="580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"
Jul 24 17:55:55.061685 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.061651    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce"} err="failed to get container status \"580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce\": rpc error: code = NotFound desc = could not find container \"580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce\": container with ID starting with 580a6714d09c993d2d367301d4b147ec46c01efc1922c49bb6d56a2709dce1ce not found: ID does not exist"
Jul 24 17:55:55.067276 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.067254    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"]
Jul 24 17:55:55.071971 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.071950    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-92693f-openshift-default-65fc9f67b8-xg46m"]
Jul 24 17:55:55.080435 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080417    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080440    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080449    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080458    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glvsx\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-kube-api-access-glvsx\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080468    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080480    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080490    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080499    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.080727 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.080508    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9572c22b-3c93-42d2-b83f-3ddf9dd510b4-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:55:55.904386 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:55:55.904346    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" path="/var/lib/kubelet/pods/9572c22b-3c93-42d2-b83f-3ddf9dd510b4/volumes"
Jul 24 17:56:00.926362 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:00.926321    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"]
Jul 24 17:56:00.926820 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:00.926600    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" podUID="e6a621ee-1d3d-49a3-adce-b6fb3b7644df" containerName="maas-api" containerID="cri-o://9041df01101d175ad7227976bd9a238bb754ed6aec4a881d91a0b5adfaa4c5ad" gracePeriod=30
Jul 24 17:56:01.076423 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.076390    2568 generic.go:356] "Generic (PLEG): container finished" podID="e6a621ee-1d3d-49a3-adce-b6fb3b7644df" containerID="9041df01101d175ad7227976bd9a238bb754ed6aec4a881d91a0b5adfaa4c5ad" exitCode=0
Jul 24 17:56:01.076423 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.076417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" event={"ID":"e6a621ee-1d3d-49a3-adce-b6fb3b7644df","Type":"ContainerDied","Data":"9041df01101d175ad7227976bd9a238bb754ed6aec4a881d91a0b5adfaa4c5ad"}
Jul 24 17:56:01.175504 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.175476    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:56:01.233608 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.233524    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls\") pod \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") "
Jul 24 17:56:01.233608 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.233579    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjnbk\" (UniqueName: \"kubernetes.io/projected/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-kube-api-access-gjnbk\") pod \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") "
Jul 24 17:56:01.233852 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.233614    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-openshift-service-ca\") pod \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\" (UID: \"e6a621ee-1d3d-49a3-adce-b6fb3b7644df\") "
Jul 24 17:56:01.234040 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.234018    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6a621ee-1d3d-49a3-adce-b6fb3b7644df" (UID: "e6a621ee-1d3d-49a3-adce-b6fb3b7644df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:56:01.235796 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.235770    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6a621ee-1d3d-49a3-adce-b6fb3b7644df" (UID: "e6a621ee-1d3d-49a3-adce-b6fb3b7644df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:56:01.235862 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.235801    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-kube-api-access-gjnbk" (OuterVolumeSpecName: "kube-api-access-gjnbk") pod "e6a621ee-1d3d-49a3-adce-b6fb3b7644df" (UID: "e6a621ee-1d3d-49a3-adce-b6fb3b7644df"). InnerVolumeSpecName "kube-api-access-gjnbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:01.334817 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.334784    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-maas-api-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:01.334817 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.334810    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjnbk\" (UniqueName: \"kubernetes.io/projected/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-kube-api-access-gjnbk\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:01.334817 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:01.334820    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a621ee-1d3d-49a3-adce-b6fb3b7644df-openshift-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:02.082167 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:02.082137    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"
Jul 24 17:56:02.082599 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:02.082175    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz" event={"ID":"e6a621ee-1d3d-49a3-adce-b6fb3b7644df","Type":"ContainerDied","Data":"d2abf385f6b5914b0c326a1559e7347b2992bf1ac382754f6d91c4454651473d"}
Jul 24 17:56:02.082599 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:02.082239    2568 scope.go:117] "RemoveContainer" containerID="9041df01101d175ad7227976bd9a238bb754ed6aec4a881d91a0b5adfaa4c5ad"
Jul 24 17:56:02.107176 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:02.107148    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"]
Jul 24 17:56:02.112431 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:02.112407    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-ea8b57-d7947dd65-cgrkz"]
Jul 24 17:56:03.904678 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:03.904646    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a621ee-1d3d-49a3-adce-b6fb3b7644df" path="/var/lib/kubelet/pods/e6a621ee-1d3d-49a3-adce-b6fb3b7644df/volumes"
Jul 24 17:56:04.359660 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:04.359576    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:56:23.253383 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.253333    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"]
Jul 24 17:56:23.253935 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.253598    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8" podUID="fdd8cea3-7410-411d-a385-99fefd17a60c" containerName="maas-api" containerID="cri-o://542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311" gracePeriod=30
Jul 24 17:56:23.508559 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.508492    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:56:23.539145 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.539101    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8cea3-7410-411d-a385-99fefd17a60c-openshift-service-ca\") pod \"fdd8cea3-7410-411d-a385-99fefd17a60c\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") "
Jul 24 17:56:23.539430 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.539411    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-679k2\" (UniqueName: \"kubernetes.io/projected/fdd8cea3-7410-411d-a385-99fefd17a60c-kube-api-access-679k2\") pod \"fdd8cea3-7410-411d-a385-99fefd17a60c\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") "
Jul 24 17:56:23.539967 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.539540    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd8cea3-7410-411d-a385-99fefd17a60c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fdd8cea3-7410-411d-a385-99fefd17a60c" (UID: "fdd8cea3-7410-411d-a385-99fefd17a60c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:56:23.540138 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.540124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd8cea3-7410-411d-a385-99fefd17a60c-maas-api-tls\") pod \"fdd8cea3-7410-411d-a385-99fefd17a60c\" (UID: \"fdd8cea3-7410-411d-a385-99fefd17a60c\") "
Jul 24 17:56:23.540766 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.540748    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd8cea3-7410-411d-a385-99fefd17a60c-openshift-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:23.543667 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.543629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd8cea3-7410-411d-a385-99fefd17a60c-kube-api-access-679k2" (OuterVolumeSpecName: "kube-api-access-679k2") pod "fdd8cea3-7410-411d-a385-99fefd17a60c" (UID: "fdd8cea3-7410-411d-a385-99fefd17a60c"). InnerVolumeSpecName "kube-api-access-679k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:23.545337 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.545311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd8cea3-7410-411d-a385-99fefd17a60c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fdd8cea3-7410-411d-a385-99fefd17a60c" (UID: "fdd8cea3-7410-411d-a385-99fefd17a60c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:56:23.642271 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.642239    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-679k2\" (UniqueName: \"kubernetes.io/projected/fdd8cea3-7410-411d-a385-99fefd17a60c-kube-api-access-679k2\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:23.642271 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:23.642271    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd8cea3-7410-411d-a385-99fefd17a60c-maas-api-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:24.194639 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.194549    2568 generic.go:356] "Generic (PLEG): container finished" podID="fdd8cea3-7410-411d-a385-99fefd17a60c" containerID="542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311" exitCode=0
Jul 24 17:56:24.194639 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.194596    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"
Jul 24 17:56:24.194639 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.194624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8" event={"ID":"fdd8cea3-7410-411d-a385-99fefd17a60c","Type":"ContainerDied","Data":"542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311"}
Jul 24 17:56:24.194909 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.194682    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8" event={"ID":"fdd8cea3-7410-411d-a385-99fefd17a60c","Type":"ContainerDied","Data":"ed69d4c962ff8012e5dd533529cd0d6c62eb271773dd3cb8583a2c244b431dcf"}
Jul 24 17:56:24.194909 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.194708    2568 scope.go:117] "RemoveContainer" containerID="542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311"
Jul 24 17:56:24.203164 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.203142    2568 scope.go:117] "RemoveContainer" containerID="542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311"
Jul 24 17:56:24.203436 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:56:24.203416    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311\": container with ID starting with 542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311 not found: ID does not exist" containerID="542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311"
Jul 24 17:56:24.203481 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.203446    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311"} err="failed to get container status \"542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311\": rpc error: code = NotFound desc = could not find container \"542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311\": container with ID starting with 542753424aa0e5dde468737beecf4bc06a6f635a5e87c9d5a41c4744287c5311 not found: ID does not exist"
Jul 24 17:56:24.217149 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.217119    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"]
Jul 24 17:56:24.223571 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:24.223545    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-13c2c7-5c4d98fb67-8xfj8"]
Jul 24 17:56:25.905294 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:25.905261    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd8cea3-7410-411d-a385-99fefd17a60c" path="/var/lib/kubelet/pods/fdd8cea3-7410-411d-a385-99fefd17a60c/volumes"
Jul 24 17:56:26.155791 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:26.155686    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:56:45.657225 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:45.657189    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"]
Jul 24 17:56:45.657846 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:45.657451    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp" podUID="fc2a2fab-24ff-47cc-8494-7de0758741d7" containerName="maas-api" containerID="cri-o://25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab" gracePeriod=30
Jul 24 17:56:45.915392 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:45.915321    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:56:46.041186 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.041153    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzg27\" (UniqueName: \"kubernetes.io/projected/fc2a2fab-24ff-47cc-8494-7de0758741d7-kube-api-access-mzg27\") pod \"fc2a2fab-24ff-47cc-8494-7de0758741d7\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") "
Jul 24 17:56:46.041370 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.041196    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a2fab-24ff-47cc-8494-7de0758741d7-openshift-service-ca\") pod \"fc2a2fab-24ff-47cc-8494-7de0758741d7\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") "
Jul 24 17:56:46.041370 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.041215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2a2fab-24ff-47cc-8494-7de0758741d7-maas-api-tls\") pod \"fc2a2fab-24ff-47cc-8494-7de0758741d7\" (UID: \"fc2a2fab-24ff-47cc-8494-7de0758741d7\") "
Jul 24 17:56:46.041564 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.041538    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc2a2fab-24ff-47cc-8494-7de0758741d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc2a2fab-24ff-47cc-8494-7de0758741d7" (UID: "fc2a2fab-24ff-47cc-8494-7de0758741d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:56:46.043237 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.043208    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc2a2fab-24ff-47cc-8494-7de0758741d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc2a2fab-24ff-47cc-8494-7de0758741d7" (UID: "fc2a2fab-24ff-47cc-8494-7de0758741d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:56:46.043360 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.043292    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2a2fab-24ff-47cc-8494-7de0758741d7-kube-api-access-mzg27" (OuterVolumeSpecName: "kube-api-access-mzg27") pod "fc2a2fab-24ff-47cc-8494-7de0758741d7" (UID: "fc2a2fab-24ff-47cc-8494-7de0758741d7"). InnerVolumeSpecName "kube-api-access-mzg27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:56:46.142271 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.142234    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzg27\" (UniqueName: \"kubernetes.io/projected/fc2a2fab-24ff-47cc-8494-7de0758741d7-kube-api-access-mzg27\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:46.142454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.142286    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a2fab-24ff-47cc-8494-7de0758741d7-openshift-service-ca\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:46.142454 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.142297    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2a2fab-24ff-47cc-8494-7de0758741d7-maas-api-tls\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:56:46.299442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.299346    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc2a2fab-24ff-47cc-8494-7de0758741d7" containerID="25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab" exitCode=0
Jul 24 17:56:46.299442 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.299399    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"
Jul 24 17:56:46.299681 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.299436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp" event={"ID":"fc2a2fab-24ff-47cc-8494-7de0758741d7","Type":"ContainerDied","Data":"25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab"}
Jul 24 17:56:46.299681 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.299492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp" event={"ID":"fc2a2fab-24ff-47cc-8494-7de0758741d7","Type":"ContainerDied","Data":"d6096801247a19664c586dd491299ee67a734f56223a2a75a9df052081744f8a"}
Jul 24 17:56:46.299681 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.299522    2568 scope.go:117] "RemoveContainer" containerID="25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab"
Jul 24 17:56:46.308704 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.308682    2568 scope.go:117] "RemoveContainer" containerID="25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab"
Jul 24 17:56:46.309035 ip-10-0-139-244 kubenswrapper[2568]: E0724 17:56:46.309015    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab\": container with ID starting with 25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab not found: ID does not exist" containerID="25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab"
Jul 24 17:56:46.309101 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.309047    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab"} err="failed to get container status \"25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab\": rpc error: code = NotFound desc = could not find container \"25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab\": container with ID starting with 25bf150439fab336bbeaf80bb0c8005527cfb4e9be8492cc4148a9830c18b2ab not found: ID does not exist"
Jul 24 17:56:46.325083 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.325054    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"]
Jul 24 17:56:46.326473 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:46.326454    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b9a122-dc98f4d4d-s5whp"]
Jul 24 17:56:47.904950 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:47.904917    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2a2fab-24ff-47cc-8494-7de0758741d7" path="/var/lib/kubelet/pods/fc2a2fab-24ff-47cc-8494-7de0758741d7/volumes"
Jul 24 17:56:48.441384 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:48.441351    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vck9n"]
Jul 24 17:56:57.237872 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:57.237838    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"]
Jul 24 17:56:57.238498 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:56:57.238075    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy" containerID="cri-o://c92d137234f94a28b37c8f4b65f828191d67be429438a18e2501727c8ea3132e" gracePeriod=30
Jul 24 17:57:02.378078 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.378040    2568 generic.go:356] "Generic (PLEG): container finished" podID="c137f7f6-a68b-4708-b048-64921ff37caf" containerID="c92d137234f94a28b37c8f4b65f828191d67be429438a18e2501727c8ea3132e" exitCode=0
Jul 24 17:57:02.378614 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.378120    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" event={"ID":"c137f7f6-a68b-4708-b048-64921ff37caf","Type":"ContainerDied","Data":"c92d137234f94a28b37c8f4b65f828191d67be429438a18e2501727c8ea3132e"}
Jul 24 17:57:02.378614 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.378184    2568 scope.go:117] "RemoveContainer" containerID="54234a8bc5e9369f8e1e7d17579ed88457da1a919539dda923e9d3803746216a"
Jul 24 17:57:02.496827 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.496804    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:57:02.592050 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.591946    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c137f7f6-a68b-4708-b048-64921ff37caf-istiod-ca-cert\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592050 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592000    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-certs\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592050 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592027    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-envoy\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592180    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-credential-socket\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592243    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-socket\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592274    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-istio-token\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592270    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:57:02.592349 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592329    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-data\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592363    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c137f7f6-a68b-4708-b048-64921ff37caf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:57:02.592602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592376    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glc9w\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-kube-api-access-glc9w\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.592602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592480    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:57:02.592602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592496    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:57:02.592602 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592521    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c137f7f6-a68b-4708-b048-64921ff37caf-istio-podinfo\") pod \"c137f7f6-a68b-4708-b048-64921ff37caf\" (UID: \"c137f7f6-a68b-4708-b048-64921ff37caf\") "
Jul 24 17:57:02.593061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592972    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c137f7f6-a68b-4708-b048-64921ff37caf-istiod-ca-cert\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.593061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.592999    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-certs\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.593061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.593013    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-credential-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.593061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.593026    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-workload-socket\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.593414 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.593387    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-data" (OuterVolumeSpecName: "istio-data") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:57:02.594288 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.594265    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:57:02.594460 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.594440    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-istio-token" (OuterVolumeSpecName: "istio-token") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:57:02.594519 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.594465    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-kube-api-access-glc9w" (OuterVolumeSpecName: "kube-api-access-glc9w") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "kube-api-access-glc9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:57:02.594567 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.594550    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c137f7f6-a68b-4708-b048-64921ff37caf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c137f7f6-a68b-4708-b048-64921ff37caf" (UID: "c137f7f6-a68b-4708-b048-64921ff37caf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 17:57:02.693683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.693646    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-istio-token\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.693683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.693677    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-data\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.693683 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.693686    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glc9w\" (UniqueName: \"kubernetes.io/projected/c137f7f6-a68b-4708-b048-64921ff37caf-kube-api-access-glc9w\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.693945 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.693695    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c137f7f6-a68b-4708-b048-64921ff37caf-istio-podinfo\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:02.693945 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:02.693705    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c137f7f6-a68b-4708-b048-64921ff37caf-istio-envoy\") on node \"ip-10-0-139-244.ec2.internal\" DevicePath \"\""
Jul 24 17:57:03.384077 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:03.384042    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5" event={"ID":"c137f7f6-a68b-4708-b048-64921ff37caf","Type":"ContainerDied","Data":"9272b77abb1681e65bbe52bf23c02d45e96ce8e56600a77f4da0f5c41d3c919f"}
Jul 24 17:57:03.384505 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:03.384103    2568 scope.go:117] "RemoveContainer" containerID="c92d137234f94a28b37c8f4b65f828191d67be429438a18e2501727c8ea3132e"
Jul 24 17:57:03.384505 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:03.384047    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"
Jul 24 17:57:03.406260 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:03.406232    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"]
Jul 24 17:57:03.408864 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:03.408837    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b9a122-openshift-default-7649d9947b-6bpb5"]
Jul 24 17:57:03.905129 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:03.905091    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" path="/var/lib/kubelet/pods/c137f7f6-a68b-4708-b048-64921ff37caf/volumes"
Jul 24 17:57:04.621119 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:04.621092    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-65qv5_dc537c19-a3a3-4398-9a83-b2b728e5a842/copy-manifests/0.log"
Jul 24 17:57:04.629061 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:04.629037    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-65qv5_dc537c19-a3a3-4398-9a83-b2b728e5a842/manager/0.log"
Jul 24 17:57:05.423333 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:05.423308    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748570-249jx_46ef64dc-8ba2-494a-9a21-88c8a5eda429/cleanup/0.log"
Jul 24 17:57:07.908644 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:07.908614    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vck9n_10a7af83-1c46-427b-96b0-8e9e05bb3bf6/limitador/0.log"
Jul 24 17:57:08.561233 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:08.561204    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dx52n_9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db/discovery/0.log"
Jul 24 17:57:10.220725 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:10.220697    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-74h9f_545cf848-00b3-4654-adfa-a5a4620fc0bd/main/0.log"
Jul 24 17:57:19.225726 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:19.225685    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-89hrh_fafc04bd-803f-4aed-93e5-a0a54bd0407e/global-pull-secret-syncer/0.log"
Jul 24 17:57:19.360397 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:19.360366    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pjfn2_1f27fd31-580b-4761-8a69-cc461697c7fb/konnectivity-agent/0.log"
Jul 24 17:57:19.406548 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:19.406523    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-244.ec2.internal_3d1c8ea34a92f47a9f2b52347e44f84a/haproxy/0.log"
Jul 24 17:57:25.673475 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:25.673446    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vck9n_10a7af83-1c46-427b-96b0-8e9e05bb3bf6/limitador/0.log"
Jul 24 17:57:27.612755 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:27.612724    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-r5wvh_a53f4531-7c23-4e5a-8dfd-688c73b21926/cluster-monitoring-operator/0.log"
Jul 24 17:57:27.636895 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:27.636869    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rmlq2_2ccb4105-c942-4992-9d67-6c6ac724ae08/kube-state-metrics/0.log"
Jul 24 17:57:27.662197 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:27.662171    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rmlq2_2ccb4105-c942-4992-9d67-6c6ac724ae08/kube-rbac-proxy-main/0.log"
Jul 24 17:57:27.699468 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:27.699438    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rmlq2_2ccb4105-c942-4992-9d67-6c6ac724ae08/kube-rbac-proxy-self/0.log"
Jul 24 17:57:27.731646 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:27.731617    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bdc76bf-gg2tq_4aac036a-de6f-49be-a520-35b0d0b6bd89/metrics-server/0.log"
Jul 24 17:57:28.049823 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.049794    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9q6z9_571334db-fe24-4494-97ad-75e1414d71b6/node-exporter/0.log"
Jul 24 17:57:28.080609 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.080572    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9q6z9_571334db-fe24-4494-97ad-75e1414d71b6/kube-rbac-proxy/0.log"
Jul 24 17:57:28.109542 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.109516    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9q6z9_571334db-fe24-4494-97ad-75e1414d71b6/init-textfile/0.log"
Jul 24 17:57:28.614762 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.614738    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-648c9c8698-mp2vm_ee6cb250-120c-48da-ba44-641ce2dd262c/thanos-query/0.log"
Jul 24 17:57:28.643112 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.643087    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-648c9c8698-mp2vm_ee6cb250-120c-48da-ba44-641ce2dd262c/kube-rbac-proxy-web/0.log"
Jul 24 17:57:28.675697 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.675669    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-648c9c8698-mp2vm_ee6cb250-120c-48da-ba44-641ce2dd262c/kube-rbac-proxy/0.log"
Jul 24 17:57:28.699578 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.699542    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-648c9c8698-mp2vm_ee6cb250-120c-48da-ba44-641ce2dd262c/prom-label-proxy/0.log"
Jul 24 17:57:28.722736 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.722696    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-648c9c8698-mp2vm_ee6cb250-120c-48da-ba44-641ce2dd262c/kube-rbac-proxy-rules/0.log"
Jul 24 17:57:28.745412 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:28.745382    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-648c9c8698-mp2vm_ee6cb250-120c-48da-ba44-641ce2dd262c/kube-rbac-proxy-metrics/0.log"
Jul 24 17:57:29.189189 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189157    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"]
Jul 24 17:57:29.189499 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189487    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy"
Jul 24 17:57:29.189546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189500    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy"
Jul 24 17:57:29.189546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189511    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy"
Jul 24 17:57:29.189546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189516    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy"
Jul 24 17:57:29.189546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189532    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff3b49f-fe86-4cc9-925e-d67ccfba1589" containerName="revoke-keys"
Jul 24 17:57:29.189546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189539    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff3b49f-fe86-4cc9-925e-d67ccfba1589" containerName="revoke-keys"
Jul 24 17:57:29.189546 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189547    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2a2fab-24ff-47cc-8494-7de0758741d7" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189552    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2a2fab-24ff-47cc-8494-7de0758741d7" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189566    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd8cea3-7410-411d-a385-99fefd17a60c" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189571    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd8cea3-7410-411d-a385-99fefd17a60c" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189576    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a621ee-1d3d-49a3-adce-b6fb3b7644df" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189581    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a621ee-1d3d-49a3-adce-b6fb3b7644df" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189589    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189594    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189600    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189605    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189652    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189659    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a621ee-1d3d-49a3-adce-b6fb3b7644df" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189665    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c137f7f6-a68b-4708-b048-64921ff37caf" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189670    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2a2fab-24ff-47cc-8494-7de0758741d7" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189675    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189681    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd8cea3-7410-411d-a385-99fefd17a60c" containerName="maas-api"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189686    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9572c22b-3c93-42d2-b83f-3ddf9dd510b4" containerName="istio-proxy"
Jul 24 17:57:29.189744 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.189691    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff3b49f-fe86-4cc9-925e-d67ccfba1589" containerName="revoke-keys"
Jul 24 17:57:29.192483 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.192463    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.195988 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.195966    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sr8cd\"/\"openshift-service-ca.crt\""
Jul 24 17:57:29.196873 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.196854    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sr8cd\"/\"default-dockercfg-6zpqp\""
Jul 24 17:57:29.196967 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.196856    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sr8cd\"/\"kube-root-ca.crt\""
Jul 24 17:57:29.204122 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.204098    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"]
Jul 24 17:57:29.219881 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.219857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-sys\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.220017 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.219890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qsg\" (UniqueName: \"kubernetes.io/projected/f831e61d-43de-4786-96e2-c3acb3bd5213-kube-api-access-t5qsg\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.220017 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.219996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-proc\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.220097 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.220049    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-lib-modules\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.220146 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.220078    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-podres\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.320971 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.320928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-sys\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.320971 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.320971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qsg\" (UniqueName: \"kubernetes.io/projected/f831e61d-43de-4786-96e2-c3acb3bd5213-kube-api-access-t5qsg\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321230 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-proc\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321230 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-lib-modules\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321230 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321069    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-sys\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321230 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-podres\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321230 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-proc\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321230 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-lib-modules\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.321451 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.321260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f831e61d-43de-4786-96e2-c3acb3bd5213-podres\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.329693 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.329673    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qsg\" (UniqueName: \"kubernetes.io/projected/f831e61d-43de-4786-96e2-c3acb3bd5213-kube-api-access-t5qsg\") pod \"perf-node-gather-daemonset-s77g2\" (UID: \"f831e61d-43de-4786-96e2-c3acb3bd5213\") " pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.502144 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.502063    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:29.640073 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:29.640040    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"]
Jul 24 17:57:29.642593 ip-10-0-139-244 kubenswrapper[2568]: W0724 17:57:29.642565    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf831e61d_43de_4786_96e2_c3acb3bd5213.slice/crio-083cd05bcbcb8deb49e31aa36ce9267d684ebb85eb4202a08969a9395673f6d6 WatchSource:0}: Error finding container 083cd05bcbcb8deb49e31aa36ce9267d684ebb85eb4202a08969a9395673f6d6: Status 404 returned error can't find the container with id 083cd05bcbcb8deb49e31aa36ce9267d684ebb85eb4202a08969a9395673f6d6
Jul 24 17:57:30.509969 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:30.509936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2" event={"ID":"f831e61d-43de-4786-96e2-c3acb3bd5213","Type":"ContainerStarted","Data":"5c412ef89b3b0c9bd3f222e674ac6bb8cd4bc680acf290d0bbefb602f5ba4789"}
Jul 24 17:57:30.510168 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:30.509988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2" event={"ID":"f831e61d-43de-4786-96e2-c3acb3bd5213","Type":"ContainerStarted","Data":"083cd05bcbcb8deb49e31aa36ce9267d684ebb85eb4202a08969a9395673f6d6"}
Jul 24 17:57:30.510168 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:30.510046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:30.526119 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:30.525707    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2" podStartSLOduration=1.525687346 podStartE2EDuration="1.525687346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:57:30.524412168 +0000 UTC m=+3253.239565954" watchObservedRunningTime="2026-07-24 17:57:30.525687346 +0000 UTC m=+3253.240841133"
Jul 24 17:57:31.537091 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:31.537060    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-gn7nm_9e64a2e2-dd0b-438b-9943-bb93d9df62e3/volume-data-source-validator/0.log"
Jul 24 17:57:32.659681 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:32.659656    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zj2fs_9d2e535b-c7ea-49fb-8a57-1dc047fffd4f/dns/0.log"
Jul 24 17:57:32.695244 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:32.695217    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zj2fs_9d2e535b-c7ea-49fb-8a57-1dc047fffd4f/kube-rbac-proxy/0.log"
Jul 24 17:57:32.784000 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:32.783970    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8jvkl_86eba38d-538f-4515-b955-a2f67d965f63/dns-node-resolver/0.log"
Jul 24 17:57:33.511095 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:33.511068    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bb4f87d8f-xcgkq_ae9795cd-88f0-47f8-8706-77d9e280b978/registry/0.log"
Jul 24 17:57:33.560071 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:33.560040    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v6bq9_534760f6-ef14-456f-bd3b-798234068cf6/node-ca/0.log"
Jul 24 17:57:34.738222 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:34.738185    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dx52n_9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db/discovery/0.log"
Jul 24 17:57:35.808857 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:35.808826    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2grtk_f5c52a0b-3e52-47d5-a8ab-934c2c353316/serve-healthcheck-canary/0.log"
Jul 24 17:57:36.349976 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:36.349937    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-h4ftz_e81dffed-6bda-49da-878c-ac256e5c437e/insights-operator/0.log"
Jul 24 17:57:36.350677 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:36.350655    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-h4ftz_e81dffed-6bda-49da-878c-ac256e5c437e/insights-operator/1.log"
Jul 24 17:57:36.476883 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:36.476854    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdfhf_136f67ed-9779-4ebf-aa28-585f5278a1a6/kube-rbac-proxy/0.log"
Jul 24 17:57:36.505691 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:36.505664    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdfhf_136f67ed-9779-4ebf-aa28-585f5278a1a6/exporter/0.log"
Jul 24 17:57:36.523464 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:36.523442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sr8cd/perf-node-gather-daemonset-s77g2"
Jul 24 17:57:36.532074 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:36.532041    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdfhf_136f67ed-9779-4ebf-aa28-585f5278a1a6/extractor/0.log"
Jul 24 17:57:39.805223 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:39.805197    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-65qv5_dc537c19-a3a3-4398-9a83-b2b728e5a842/manager/0.log"
Jul 24 17:57:39.830350 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:39.830320    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-645867896-65qv5_dc537c19-a3a3-4398-9a83-b2b728e5a842/copy-manifests/0.log"
Jul 24 17:57:40.011211 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:40.011162    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dx52n_9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db/discovery/0.log"
Jul 24 17:57:41.397215 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:41.397183    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f7bfdc884-zrxm9_a730b6f6-35fe-40ec-a050-dafa5ab961a9/manager/0.log"
Jul 24 17:57:41.425379 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:41.425346    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-88qdm_a983b229-20bb-4243-825d-9a4c30ef9795/openshift-lws-operator/0.log"
Jul 24 17:57:41.786401 ip-10-0-139-244 kubenswrapper[2568]: I0724 17:57:41.786307    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dx52n_9a2b5ae1-775c-4e66-9d33-14b5cdb2b6db/discovery/0.log"