Jul 28 19:29:39.633792 ip-10-0-137-245 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 19:29:40.041099 ip-10-0-137-245 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:29:40.041099 ip-10-0-137-245 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 19:29:40.041099 ip-10-0-137-245 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:29:40.041099 ip-10-0-137-245 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 19:29:40.041099 ip-10-0-137-245 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:29:40.041851 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.041167    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048703    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048728    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048732    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048736    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048739    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048742    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048745    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:40.048734 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048748    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048751    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048754    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048760    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048762    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048765    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048768    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048773    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048777    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048781    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048784    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048787    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048790    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048794    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048797    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048803    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048806    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048808    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048811    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:40.049036 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048814    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048817    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048819    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048822    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048825    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048828    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048831    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048834    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048836    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048842    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048844    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048847    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048851    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048854    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048856    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048860    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048863    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048865    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048868    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:40.049507 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048871    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048873    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048880    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048884    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048888    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048891    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048894    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048897    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048899    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048902    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048905    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048907    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048910    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048913    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048915    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048921    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048923    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048926    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048929    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:40.050113 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048932    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048934    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048937    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048941    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048944    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048947    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048949    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048954    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048957    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048961    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048964    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048967    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048970    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048972    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048975    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048978    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048980    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048983    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048986    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048989    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048994    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:40.050603 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.048997    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049000    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049002    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049005    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049008    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049012    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049016    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049019    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049022    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049024    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049027    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049032    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049035    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.049038    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050267    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050276    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050279    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050282    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050285    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:40.051118 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050288    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050294    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050297    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050300    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050303    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050306    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050309    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050311    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050314    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050317    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050320    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050328    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050331    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050334    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050339    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050343    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050345    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050348    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050350    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050353    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:40.051717 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050356    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050359    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050362    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050365    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050369    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050374    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050380    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050383    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050386    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050389    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050391    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050394    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050397    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050400    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050403    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050405    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050408    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050410    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050413    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050418    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:40.052598 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050421    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050424    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050426    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050430    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050441    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050445    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050449    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050451    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050454    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050456    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050462    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050464    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050467    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050470    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050472    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050475    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050478    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050481    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050484    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:40.053524 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050486    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050489    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050491    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050495    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050500    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050502    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050505    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050509    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050511    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050514    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050517    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050519    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050522    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050525    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050527    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050530    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050532    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050537    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050547    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050550    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:40.054142 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050553    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050556    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050559    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050561    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050564    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050567    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050569    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050572    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050577    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050579    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050582    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050585    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050588    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050590    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.050594    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051645    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051662    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051669    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051674    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:40.054782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051679    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051684    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051689    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051694    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051698    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051702    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051707    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051711    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051716    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051720    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051724    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051729    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051733    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051737    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051741    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051745    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051749    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051753    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051758    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:40.055431 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051763    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051767    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051774    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051778    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051785    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051792    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051799    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051806    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051814    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051819    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051826    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051832    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051839    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051846    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051852    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051858    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051864    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051870    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051876    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051880    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:40.056033 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051886    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051893    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051899    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051906    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051911    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051915    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051920    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051924    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051928    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051933    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051937    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051942    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051946    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051951    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051955    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051959    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051963    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051968    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051972    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051976    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:40.056553 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051980    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051986    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051991    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.051996    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052000    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052005    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052013    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052017    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052021    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052026    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052030    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052034    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052039    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052043    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052048    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052052    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052056    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052061    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052065    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052071    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:40.057133 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052077    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052081    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052086    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052095    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052103    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052108    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052113    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052118    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052122    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052129    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052135    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052140    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052166    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052173    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052178    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.052183    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052293    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052305    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052318    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052325    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 19:29:40.057648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052332    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052338    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052345    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052353    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052358    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052364    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052370    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052376    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052381    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052386    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052390    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052395    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052401    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052407    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052419    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052424    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052429    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052435    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052440    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052450    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052455    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052460    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052466    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052471    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 19:29:40.058156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052475    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052480    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052485    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052491    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052498    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052502    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052508    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052512    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052517    2574 flags.go:64] FLAG: --enable-server="true"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052522    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052530    2574 flags.go:64] FLAG: --event-burst="100"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052535    2574 flags.go:64] FLAG: --event-qps="50"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052540    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052545    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052550    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052556    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052561    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052566    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052572    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052577    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052581    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052587    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052592    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052596    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052601    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 19:29:40.058743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052605    2574 flags.go:64] FLAG: --feature-gates=""
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052611    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052616    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052621    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052626    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052632    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052637    2574 flags.go:64] FLAG: --help="false"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052642    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-137-245.ec2.internal"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052647    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052652    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052657    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052663    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052668    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052673    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052678    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052682    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052687    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052692    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052699    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052703    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052708    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052712    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052718    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052723    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 19:29:40.059429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052727    2574 flags.go:64] FLAG: --lock-file=""
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052732    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052737    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052742    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052751    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052757    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052762    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052767    2574 flags.go:64] FLAG: --logging-format="text"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052771    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052777    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052782    2574 flags.go:64] FLAG: --manifest-url=""
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052787    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052794    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052799    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052805    2574 flags.go:64] FLAG: --max-pods="110"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052811    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052818    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052824    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052830    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052835    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052840    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052845    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052860    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052865    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052870    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 19:29:40.060026 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052875    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052880    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052889    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052893    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052899    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052904    2574 flags.go:64] FLAG: --port="10250"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052909    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052914    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08a8f387c00f77827"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052919    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052924    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052929    2574 flags.go:64] FLAG: --register-node="true"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052934    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052940    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052947    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052952    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052957    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052964    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052969    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052974    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052979    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052984    2574 flags.go:64] FLAG: --runonce="false"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052989    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.052994    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053001    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053006    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 19:29:40.060746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053013    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053018    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053023    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053029    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053034    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053039    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053043    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053048    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053053    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053058    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053062    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053073    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053078    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053083    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053090    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053095    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053099    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053104    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053109    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053114    2574 flags.go:64] FLAG: --v="2"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053121    2574 flags.go:64] FLAG: --version="false"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053128    2574 flags.go:64] FLAG: --vmodule=""
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053134    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.053140    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053370    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:40.061376 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053378    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053383    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053387    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053392    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053396    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053400    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053407    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053415    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053420    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053425    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053430    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053434    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053438    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053442    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053446    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053451    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053455    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053459    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053463    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:40.061988 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053467    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053471    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053476    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053483    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053487    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053492    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053496    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053501    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053505    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053509    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053516    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053520    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053524    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053528    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053532    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053535    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053540    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053544    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053548    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:40.062483 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053551    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053558    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053563    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053568    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053572    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053576    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053580    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053584    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053589    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053593    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053597    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053601    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053606    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053610    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053614    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053618    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053627    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053631    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053635    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:40.062973 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053639    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053646    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053652    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053656    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053661    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053666    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053671    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053675    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053679    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053683    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053688    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053692    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053697    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053701    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053707    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053711    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053715    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053719    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053724    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053727    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:40.063513 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053732    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053737    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053741    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053745    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053749    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053753    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053757    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053761    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053766    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053772    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053777    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053781    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053786    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053790    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053794    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053798    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053805    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053810    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053816    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053821    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:40.064009 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.053825    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.054360    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.061842    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.061863    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.062707    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.062715    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062796    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062801    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062806    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062815    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062819    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062822    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062825    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062828    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:40.064523 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062831    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062834    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062837    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062839    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062842    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062845    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062848    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062850    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062853    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062855    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062858    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062860    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062863    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062866    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062868    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062871    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062876    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062878    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062881    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062884    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:40.064882 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062886    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062889    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062893    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062895    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062898    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062901    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062904    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062906    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062909    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062911    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062914    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062916    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062919    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062922    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062925    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062927    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062930    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062932    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062935    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062937    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:40.065409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062940    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062942    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062945    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062947    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062950    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062953    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062956    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062958    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062961    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062965    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062967    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062970    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062972    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062975    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062978    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062981    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062984    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062986    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062991    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:40.065894 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062995    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.062998    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063001    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063004    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063006    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063009    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063012    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063015    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063017    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063020    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063022    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063026    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063028    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063031    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063034    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063036    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063039    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063042    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063046    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063050    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:40.066392 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063053    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063056    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063058    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063061    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063064    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063067    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063070    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063072    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063075    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063078    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063081    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063085    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.063091    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063255    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:29:40.066914 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063260    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063264    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063267    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063270    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063273    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063276    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063279    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063281    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063284    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063287    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063290    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063293    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063296    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063299    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063301    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063304    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063307    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063309    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063312    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063315    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:29:40.067283 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063317    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063320    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063323    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063325    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063329    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063331    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063334    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063336    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063338    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063341    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063343    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063345    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063348    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063350    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063353    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063355    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063358    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063360    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063363    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063365    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:29:40.067780 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063368    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063371    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063374    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063377    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063379    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063382    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063385    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063387    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063390    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063392    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063394    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063397    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063399    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063402    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063404    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063408    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063410    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063413    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063416    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063418    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:29:40.068293 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063421    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063425    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063428    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063430    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063433    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063437    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063440    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063443    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063446    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063449    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063451    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063453    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063456    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063459    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063461    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063464    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063467    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063469    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063472    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:29:40.068782 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063474    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063477    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063479    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063482    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063484    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063487    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063489    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063492    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063495    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063498    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063501    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063503    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063506    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063508    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063511    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063513    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063517    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063521    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:29:40.069307 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:40.063524    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:29:40.069745 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.063529    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:29:40.069745 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.063670    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 19:29:40.069745 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.065692    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 19:29:40.069745 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.067083    2574 server.go:1019] "Starting client certificate rotation"
Jul 28 19:29:40.069745 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.067184    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:29:40.069745 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.067946    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:29:40.070039 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.070023    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:29:40.073207 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.073180    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:29:40.084609 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.084580    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 28 19:29:40.086884 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.086866    2574 log.go:25] "Validated CRI v1 image API"
Jul 28 19:29:40.088880 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.088859    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 19:29:40.091554 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.091520    2574 fs.go:135] Filesystem UUIDs: map[1e76ae2e-5feb-4716-9231-939e30a48116:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b2f4b7f8-a086-43e6-a561-889a650b3af3:/dev/nvme0n1p4]
Jul 28 19:29:40.091670 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.091552    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 19:29:40.098613 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.098587    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:29:40.098800 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.098675    2574 manager.go:216] Machine: {Timestamp:2026-07-28 19:29:40.097390991 +0000 UTC m=+0.347139582 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099767 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238b04e724e912a6e4e2101a6fb615 SystemUUID:ec238b04-e724-e912-a6e4-e2101a6fb615 BootID:7f55bcd3-22e1-4395-9d8f-55216774c234 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b1:26:d2:f6:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b1:26:d2:f6:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:d1:79:8f:77:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 19:29:40.098886 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.098802    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 19:29:40.098933 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.098920    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 19:29:40.102734 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.102702    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 19:29:40.102890 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.102735    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 19:29:40.103854 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.103842    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 19:29:40.103905 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.103855    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 19:29:40.103905 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.103863    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:29:40.103905 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.103881    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:29:40.105219 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.105205    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 19:29:40.108984 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.108966    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:29:40.109120 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109110    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 19:29:40.109175 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109157    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 19:29:40.109175 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109169    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 19:29:40.109240 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109188    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 19:29:40.109240 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109200    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 28 19:29:40.109240 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109216    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 19:29:40.109659 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109643    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:29:40.109705 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:40.109671    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:29:41.513117 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.513099    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 19:29:41.514552 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.514539    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 19:29:41.514603 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.514570    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 19:29:41.515134 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515116    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sm5c5"
Jul 28 19:29:41.515249 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515238    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 19:29:41.515281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515257    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 19:29:41.515281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515268    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 19:29:41.515281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515277    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 19:29:41.515376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515288    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 19:29:41.515376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515298    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 19:29:41.515376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515324    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 19:29:41.515376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515339    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 19:29:41.515376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515347    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 19:29:41.515376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515352    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 19:29:41.515539 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515380    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 19:29:41.515539 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.515387    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 19:29:41.516720 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.516707    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 19:29:41.516720 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.516721    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 19:29:41.520104 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.520084    2574 server.go:1268] "Started kubelet"
Jul 28 19:29:41.520221 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.520192    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 19:29:41.520822 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.520401    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 19:29:41.520822 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.520508    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 19:29:41.520959 ip-10-0-137-245 systemd[1]: Started Kubernetes Kubelet.
Jul 28 19:29:41.522355 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.522331    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 19:29:41.522646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.522619    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 19:29:41.522752 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.522653    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sm5c5"
Jul 28 19:29:41.522918 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.522906    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 19:29:41.523253 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.523227    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 19:29:41.523253 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.523228    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 19:29:41.525491 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.525453    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 19:29:41.527158 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.526263    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-245.ec2.internal.18c68adc66bbba2b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-245.ec2.internal,UID:ip-10-0-137-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-245.ec2.internal,},FirstTimestamp:2026-07-28 19:29:41.519997483 +0000 UTC m=+0.368530941,LastTimestamp:2026-07-28 19:29:41.519997483 +0000 UTC m=+0.368530941,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-245.ec2.internal,}"
Jul 28 19:29:41.530778 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.530755    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 19:29:41.530900 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.530752    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 19:29:41.530900 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.530883    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:41.531422 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.531401    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 19:29:41.531422 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.531424    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 19:29:41.531553 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.531467    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 19:29:41.531601 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.531594    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 19:29:41.531659 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.531602    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 19:29:41.532590 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532573    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:41.532590 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532580    2574 factory.go:55] Registering systemd factory
Jul 28 19:29:41.532718 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532604    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 28 19:29:41.532840 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532821    2574 factory.go:153] Registering CRI-O factory
Jul 28 19:29:41.532885 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532855    2574 factory.go:223] Registration of the crio container factory successfully
Jul 28 19:29:41.532924 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532913    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 19:29:41.532965 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532944    2574 factory.go:103] Registering Raw factory
Jul 28 19:29:41.532965 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.532957    2574 manager.go:1196] Started watching for new ooms in manager
Jul 28 19:29:41.533581 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.533563    2574 manager.go:349] Starting recovery of all containers
Jul 28 19:29:41.534623 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.534601    2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-245.ec2.internal\" not found" node="ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.544177 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.544153    2574 manager.go:354] Recovery completed
Jul 28 19:29:41.546161 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.546136    2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 19:29:41.549243 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.549228    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.551158 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551142    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.551226 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551171    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.551226 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551183    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.551746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551730    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 19:29:41.551746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551744    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 19:29:41.551896 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551749    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.551896 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.551766    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:29:41.552590 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.552576    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.552666 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.552602    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.552666 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.552621    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.553135 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.553122    2574 policy_none.go:49] "None policy: Start"
Jul 28 19:29:41.553168 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.553140    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 19:29:41.553168 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.553150    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 19:29:41.554107 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.554097    2574 policy_none.go:47] "Start"
Jul 28 19:29:41.592757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.592739    2574 manager.go:337] "Starting Device Plugin manager"
Jul 28 19:29:41.592842 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.592777    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 19:29:41.592842 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.592791    2574 server.go:87] "Starting device plugin registration server"
Jul 28 19:29:41.593124 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.593111    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 19:29:41.593177 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.593127    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 19:29:41.593246 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.593221    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 19:29:41.593345 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.593318    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 19:29:41.593345 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.593329    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 19:29:41.593918 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.593895    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 19:29:41.593988 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.593961    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:41.693669 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.693594    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.694709 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.694614    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.694709 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.694642    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.694709 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.694652    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.694709 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.694704    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.701616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.701573    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 19:29:41.702274 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.702247    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.702410 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.702285    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-245.ec2.internal\": node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:41.702926 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.702909    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 19:29:41.702991 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.702947    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 19:29:41.702991 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.702970    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 19:29:41.703078 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.703007    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 19:29:41.704520 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.704502    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:41.752378 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.752329    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:41.803542 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.803503    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"]
Jul 28 19:29:41.803686 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.803585    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.805817 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.805800    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.805908 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.805833    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.805908 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.805844    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.807206 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807192    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.807311 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807297    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.807373 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807327    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.807964 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807943    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.808071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807979    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.808071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807990    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.808071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.807943    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.808071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.808060    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.808209 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.808074    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.809337 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.809321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.809405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.809355    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:29:41.810127 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.810112    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:29:41.810207 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.810133    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:29:41.810207 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.810143    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:29:41.825112 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.825087    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-245.ec2.internal\" not found" node="ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.829222 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.829205    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-245.ec2.internal\" not found" node="ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.833471 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.833431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d0e1ef05613d307243fa9dd278c14a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal\" (UID: \"0d0e1ef05613d307243fa9dd278c14a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.833471 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.833479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d0e1ef05613d307243fa9dd278c14a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal\" (UID: \"0d0e1ef05613d307243fa9dd278c14a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.833638 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.833498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f82d0ea6d17a563c4b7940ec7927ea2a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-245.ec2.internal\" (UID: \"f82d0ea6d17a563c4b7940ec7927ea2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.852644 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.852609    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:41.934632 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.934588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d0e1ef05613d307243fa9dd278c14a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal\" (UID: \"0d0e1ef05613d307243fa9dd278c14a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.934632 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.934611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0d0e1ef05613d307243fa9dd278c14a9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal\" (UID: \"0d0e1ef05613d307243fa9dd278c14a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.934850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.934642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d0e1ef05613d307243fa9dd278c14a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal\" (UID: \"0d0e1ef05613d307243fa9dd278c14a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.934850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.934662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f82d0ea6d17a563c4b7940ec7927ea2a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-245.ec2.internal\" (UID: \"f82d0ea6d17a563c4b7940ec7927ea2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.934850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.934700    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f82d0ea6d17a563c4b7940ec7927ea2a-config\") pod \"kube-apiserver-proxy-ip-10-0-137-245.ec2.internal\" (UID: \"f82d0ea6d17a563c4b7940ec7927ea2a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.934850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:41.934753    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d0e1ef05613d307243fa9dd278c14a9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal\" (UID: \"0d0e1ef05613d307243fa9dd278c14a9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:41.953785 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:41.953703    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.054603 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.054562    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.127803 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.127775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:42.132237 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.132021    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:42.155209 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.155174    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.255825 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.255735    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.356255 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.356210    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.456851 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.456816    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.467987 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.467965    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 19:29:42.468139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.468122    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:29:42.468187 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.468143    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:29:42.527022 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.526914    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 19:24:41 +0000 UTC" deadline="2028-04-16 22:34:35.197828196 +0000 UTC"
Jul 28 19:29:42.527022 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.526963    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15075h4m52.670868812s"
Jul 28 19:29:42.557827 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.557791    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.658448 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.658411    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.731010 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:42.730971    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82d0ea6d17a563c4b7940ec7927ea2a.slice/crio-34773fd5ec413bfd70d003d95cbee021d786416e4bcf196045afbd73cb87698a WatchSource:0}: Error finding container 34773fd5ec413bfd70d003d95cbee021d786416e4bcf196045afbd73cb87698a: Status 404 returned error can't find the container with id 34773fd5ec413bfd70d003d95cbee021d786416e4bcf196045afbd73cb87698a
Jul 28 19:29:42.731271 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:42.731245    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0e1ef05613d307243fa9dd278c14a9.slice/crio-310f4ca886991ede34c01c7647571ce0883f4c8df476090d3ae8d68ad99f8abe WatchSource:0}: Error finding container 310f4ca886991ede34c01c7647571ce0883f4c8df476090d3ae8d68ad99f8abe: Status 404 returned error can't find the container with id 310f4ca886991ede34c01c7647571ce0883f4c8df476090d3ae8d68ad99f8abe
Jul 28 19:29:42.737039 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.737023    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:29:42.758513 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.758481    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.795668 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:42.795595    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:42.859375 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.859325    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:42.959867 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:42.959836    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:43.060691 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.060616    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-245.ec2.internal\" not found"
Jul 28 19:29:43.085527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.085496    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:43.131662 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.131627    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:43.142553 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.142523    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:29:43.143596 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.143576    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal"
Jul 28 19:29:43.152538 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.152515    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:29:43.431260 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.431178    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:43.511560 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.511515    2574 apiserver.go:52] "Watching apiserver"
Jul 28 19:29:43.524128 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.524099    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 19:29:43.525278 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.525064    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hv5wt","kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal","openshift-dns/node-resolver-44t57","openshift-multus/multus-additional-cni-plugins-m58qf","openshift-multus/network-metrics-daemon-p4kq2","openshift-network-diagnostics/network-check-target-gkf5m","openshift-ovn-kubernetes/ovnkube-node-trv9n","kube-system/konnectivity-agent-kjkvl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97","openshift-cluster-node-tuning-operator/tuned-bq8ss","openshift-image-registry/node-ca-k9jcd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal","openshift-multus/multus-jbrfq","openshift-network-operator/iptables-alerter-jcfnq"]
Jul 28 19:29:43.527092 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.527061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.529644 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.529619    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.530920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.530895    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 19:29:43.531042 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.530963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.531121 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.531106    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 19:29:43.531187 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.531169    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 19:29:43.531347 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.531326    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvhr5\""
Jul 28 19:29:43.531493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.531474    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.531493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.531488    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 19:29:43.531624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.531604    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.532888 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.532685    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.533145 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.533126    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 19:29:43.533523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.533399    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8fzhd\""
Jul 28 19:29:43.533523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.533408    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 19:29:43.533523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.533414    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.533523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.533469    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.534504 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.534417    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:43.534610 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.534496    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:43.534972 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.534945    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 19:29:43.535077 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.534994    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.535197 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.535175    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.535297 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.535179    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7kwwt\""
Jul 28 19:29:43.535511 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.535490    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zxskh\""
Jul 28 19:29:43.536844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.535763    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:43.536844 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.535837    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:43.536844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.536215    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 19:29:43.536844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.536567    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 19:29:43.537489 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.537471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.538235 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.538216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.538326 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.538289    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:43.539710 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.539689    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.540172 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.540151    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 19:29:43.540253 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.540156    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.540253 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.540206    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pxpfr\""
Jul 28 19:29:43.540479 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.540463    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.541377 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.541348    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-run-netns\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-env-overrides\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8xc\" (UniqueName: \"kubernetes.io/projected/04f36433-c99b-4c6a-8825-e94b771ecbe4-kube-api-access-fl8xc\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542237    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-cni-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-cnibin\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-cni-bin\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-os-release\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-netns\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-cni-bin\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542422    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-kubelet\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-etc-kubernetes\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cnibin\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542503    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-systemd-units\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-hostroot\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/592865ab-8346-4df2-bb41-fd71b6ddb268-hosts-file\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-system-cni-dir\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cni-binary-copy\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542712    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lskxq\""
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-var-lib-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-etc-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.542776 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-node-log\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542792    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542833    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zg7h\" (UniqueName: \"kubernetes.io/projected/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-kube-api-access-2zg7h\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-ovn\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542916    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-system-cni-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542968    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.542970    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-k8s-cni-cncf-io\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44265658-6628-454e-9ccc-a77e776cce4c-multus-daemon-config\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543029    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmz4\" (UniqueName: \"kubernetes.io/projected/44265658-6628-454e-9ccc-a77e776cce4c-kube-api-access-2bmz4\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-systemd\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovnkube-config\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovn-node-metrics-cert\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592865ab-8346-4df2-bb41-fd71b6ddb268-tmp-dir\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-os-release\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-kubelet\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.543579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-socket-dir-parent\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-multus-certs\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8hd\" (UniqueName: \"kubernetes.io/projected/592865ab-8346-4df2-bb41-fd71b6ddb268-kube-api-access-rr8hd\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-log-socket\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-run-ovn-kubernetes\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-cni-netd\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovnkube-script-lib\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543428    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44265658-6628-454e-9ccc-a77e776cce4c-cni-binary-copy\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-cni-multus\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543459    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-conf-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-slash\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.544398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.543972    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.544956 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.544764    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nm4d9\""
Jul 28 19:29:43.544956 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.544816    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.545153 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.545133    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.546821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.546794    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 19:29:43.546917 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.546856    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 19:29:43.546979 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.546917    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6zlp5\""
Jul 28 19:29:43.547148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.547130    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 19:29:43.547542 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.547526    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 19:29:43.547808 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.547790    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zljrt\""
Jul 28 19:29:43.547957 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.547938    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 19:29:43.564774 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.564748    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9j49"
Jul 28 19:29:43.572054 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.571978    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9j49"
Jul 28 19:29:43.632782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.632750    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 19:29:43.643846 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.643815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-node-log\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644008 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.643864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-kubernetes\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.644008 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.643892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-run\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.644008 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.643928    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-node-log\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644008 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.643939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-registration-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.644008 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.643994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-ovn\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-k8s-cni-cncf-io\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44265658-6628-454e-9ccc-a77e776cce4c-multus-daemon-config\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644062    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-ovn\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-kubelet-config\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40b02357-d725-4899-bcf2-995b9994823e-iptables-alerter-script\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-k8s-cni-cncf-io\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysctl-conf\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-kubelet\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-socket-dir-parent\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8hd\" (UniqueName: \"kubernetes.io/projected/592865ab-8346-4df2-bb41-fd71b6ddb268-kube-api-access-rr8hd\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40b02357-d725-4899-bcf2-995b9994823e-host-slash\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-modprobe-d\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.644263 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-socket-dir-parent\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-log-socket\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644295    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-log-socket\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644303    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-run-ovn-kubernetes\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovnkube-script-lib\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644338    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44265658-6628-454e-9ccc-a77e776cce4c-cni-binary-copy\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-cni-multus\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/592865ab-8346-4df2-bb41-fd71b6ddb268-hosts-file\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-system-cni-dir\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8xc\" (UniqueName: \"kubernetes.io/projected/04f36433-c99b-4c6a-8825-e94b771ecbe4-kube-api-access-fl8xc\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-cni-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-netns\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644547    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3c2e81-415a-4612-9f08-04cebfa4bba0-tmp\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95qc\" (UniqueName: \"kubernetes.io/projected/dd3c2e81-415a-4612-9f08-04cebfa4bba0-kube-api-access-r95qc\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/456fe185-63e2-497a-b3e0-61c0e23294a5-host\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-etc-selinux\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644627    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/592865ab-8346-4df2-bb41-fd71b6ddb268-hosts-file\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.644786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-cni-bin\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-kubelet\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-cni-bin\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644672    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44265658-6628-454e-9ccc-a77e776cce4c-multus-daemon-config\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-systemd\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644780    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-cni-multus\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-cni-bin\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-run-ovn-kubernetes\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644956    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-cni-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.644992    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645000    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-cni-bin\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-system-cni-dir\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-var-lib-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zg7h\" (UniqueName: \"kubernetes.io/projected/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-kube-api-access-2zg7h\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645167    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-var-lib-kubelet\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-system-cni-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmz4\" (UniqueName: \"kubernetes.io/projected/44265658-6628-454e-9ccc-a77e776cce4c-kube-api-access-2bmz4\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.645679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysconfig\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-device-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645317    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-var-lib-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovnkube-script-lib\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-netns\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-systemd\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645218    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44265658-6628-454e-9ccc-a77e776cce4c-cni-binary-copy\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-systemd\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovnkube-config\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645666    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-system-cni-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovn-node-metrics-cert\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645718    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592865ab-8346-4df2-bb41-fd71b6ddb268-tmp-dir\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-os-release\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbzh9\" (UniqueName: \"kubernetes.io/projected/40b02357-d725-4899-bcf2-995b9994823e-kube-api-access-qbzh9\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645978    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-os-release\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.645984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:43.646616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646013    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-multus-certs\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rj6\" (UniqueName: \"kubernetes.io/projected/649d116e-0b54-474e-b93e-4b14c5ce56d0-kube-api-access-p9rj6\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysctl-d\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592865ab-8346-4df2-bb41-fd71b6ddb268-tmp-dir\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646119    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovnkube-config\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646149    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-run-multus-certs\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-host\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-socket-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-sys-fs\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-cni-netd\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-conf-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-cni-netd\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646403    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-multus-conf-dir\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647271 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-sys\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-lib-modules\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjmkq\" (UniqueName: \"kubernetes.io/projected/692d634d-861a-4267-ab57-b85a755c5692-kube-api-access-pjmkq\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-slash\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646606    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-slash\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646658    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-run-netns\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-host-run-netns\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-env-overrides\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646732    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-run-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-cnibin\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-os-release\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-cnibin\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-etc-kubernetes\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-kubelet\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.647920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cnibin\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-etc-kubernetes\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-tuned\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cnibin\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/456fe185-63e2-497a-b3e0-61c0e23294a5-serviceca\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fplh\" (UniqueName: \"kubernetes.io/projected/456fe185-63e2-497a-b3e0-61c0e23294a5-kube-api-access-4fplh\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-host-var-lib-kubelet\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646846    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-os-release\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646972    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1-konnectivity-ca\") pod \"konnectivity-agent-kjkvl\" (UID: \"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1\") " pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.646997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-systemd-units\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-hostroot\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647059    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cni-binary-copy\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-dbus\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04f36433-c99b-4c6a-8825-e94b771ecbe4-env-overrides\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647095    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1-agent-certs\") pod \"konnectivity-agent-kjkvl\" (UID: \"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1\") " pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.648714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647117    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.649293 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-etc-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.649293 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44265658-6628-454e-9ccc-a77e776cce4c-hostroot\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.649293 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-etc-openvswitch\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.649293 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04f36433-c99b-4c6a-8825-e94b771ecbe4-systemd-units\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.649293 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.647528    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-cni-binary-copy\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.649710 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.649689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04f36433-c99b-4c6a-8825-e94b771ecbe4-ovn-node-metrics-cert\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.653182 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.653158    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8hd\" (UniqueName: \"kubernetes.io/projected/592865ab-8346-4df2-bb41-fd71b6ddb268-kube-api-access-rr8hd\") pod \"node-resolver-44t57\" (UID: \"592865ab-8346-4df2-bb41-fd71b6ddb268\") " pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.653798 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.653776    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zg7h\" (UniqueName: \"kubernetes.io/projected/0e6dc457-fa80-4782-bc1d-beeb7a7cf49a-kube-api-access-2zg7h\") pod \"multus-additional-cni-plugins-m58qf\" (UID: \"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a\") " pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.654421 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.654401    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmz4\" (UniqueName: \"kubernetes.io/projected/44265658-6628-454e-9ccc-a77e776cce4c-kube-api-access-2bmz4\") pod \"multus-jbrfq\" (UID: \"44265658-6628-454e-9ccc-a77e776cce4c\") " pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.654796 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.654778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8xc\" (UniqueName: \"kubernetes.io/projected/04f36433-c99b-4c6a-8825-e94b771ecbe4-kube-api-access-fl8xc\") pod \"ovnkube-node-trv9n\" (UID: \"04f36433-c99b-4c6a-8825-e94b771ecbe4\") " pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.709087 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.708981    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal" event={"ID":"f82d0ea6d17a563c4b7940ec7927ea2a","Type":"ContainerStarted","Data":"34773fd5ec413bfd70d003d95cbee021d786416e4bcf196045afbd73cb87698a"}
Jul 28 19:29:43.710056 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.710024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal" event={"ID":"0d0e1ef05613d307243fa9dd278c14a9","Type":"ContainerStarted","Data":"310f4ca886991ede34c01c7647571ce0883f4c8df476090d3ae8d68ad99f8abe"}
Jul 28 19:29:43.747527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-var-lib-kubelet\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.747527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysconfig\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-device-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbzh9\" (UniqueName: \"kubernetes.io/projected/40b02357-d725-4899-bcf2-995b9994823e-kube-api-access-qbzh9\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rj6\" (UniqueName: \"kubernetes.io/projected/649d116e-0b54-474e-b93e-4b14c5ce56d0-kube-api-access-p9rj6\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747627    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysconfig\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747627    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-var-lib-kubelet\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysctl-d\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-device-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-host\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-socket-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-sys-fs\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.747757 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.747756    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-host\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747775    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysctl-d\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-sys\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.747828    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:44.247803285 +0000 UTC m=+3.096336745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-sys-fs\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-sys\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-lib-modules\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmkq\" (UniqueName: \"kubernetes.io/projected/692d634d-861a-4267-ab57-b85a755c5692-kube-api-access-pjmkq\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-socket-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.747985    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-tuned\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/456fe185-63e2-497a-b3e0-61c0e23294a5-serviceca\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-lib-modules\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748050    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fplh\" (UniqueName: \"kubernetes.io/projected/456fe185-63e2-497a-b3e0-61c0e23294a5-kube-api-access-4fplh\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1-konnectivity-ca\") pod \"konnectivity-agent-kjkvl\" (UID: \"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1\") " pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.748381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-dbus\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1-agent-certs\") pod \"konnectivity-agent-kjkvl\" (UID: \"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1\") " pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-dbus\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-kubernetes\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-run\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748469    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-kubernetes\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748482    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-run\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-registration-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-kubelet-config\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748549    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/456fe185-63e2-497a-b3e0-61c0e23294a5-serviceca\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40b02357-d725-4899-bcf2-995b9994823e-iptables-alerter-script\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysctl-conf\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-registration-dir\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40b02357-d725-4899-bcf2-995b9994823e-host-slash\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-kubelet-config\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-modprobe-d\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748658    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1-konnectivity-ca\") pod \"konnectivity-agent-kjkvl\" (UID: \"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1\") " pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.749156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748668    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40b02357-d725-4899-bcf2-995b9994823e-host-slash\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3c2e81-415a-4612-9f08-04cebfa4bba0-tmp\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.748758    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r95qc\" (UniqueName: \"kubernetes.io/projected/dd3c2e81-415a-4612-9f08-04cebfa4bba0-kube-api-access-r95qc\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/456fe185-63e2-497a-b3e0-61c0e23294a5-host\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-sysctl-conf\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.748804    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:44.248787498 +0000 UTC m=+3.097320949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748822    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/456fe185-63e2-497a-b3e0-61c0e23294a5-host\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-modprobe-d\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-etc-selinux\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.748950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-systemd\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.749024    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-systemd\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.749072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/692d634d-861a-4267-ab57-b85a755c5692-etc-selinux\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.749882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.749087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40b02357-d725-4899-bcf2-995b9994823e-iptables-alerter-script\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.750626 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.750608    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1-agent-certs\") pod \"konnectivity-agent-kjkvl\" (UID: \"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1\") " pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.750626 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.750618    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd3c2e81-415a-4612-9f08-04cebfa4bba0-etc-tuned\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.751040 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.751018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3c2e81-415a-4612-9f08-04cebfa4bba0-tmp\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.757206 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.757174    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:43.757206 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.757197    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:43.757206 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.757210    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:43.757473 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:43.757270    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:29:44.257254853 +0000 UTC m=+3.105788310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:43.758600 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.758573    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fplh\" (UniqueName: \"kubernetes.io/projected/456fe185-63e2-497a-b3e0-61c0e23294a5-kube-api-access-4fplh\") pod \"node-ca-k9jcd\" (UID: \"456fe185-63e2-497a-b3e0-61c0e23294a5\") " pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.758913 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.758894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbzh9\" (UniqueName: \"kubernetes.io/projected/40b02357-d725-4899-bcf2-995b9994823e-kube-api-access-qbzh9\") pod \"iptables-alerter-jcfnq\" (UID: \"40b02357-d725-4899-bcf2-995b9994823e\") " pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.758978 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.758898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rj6\" (UniqueName: \"kubernetes.io/projected/649d116e-0b54-474e-b93e-4b14c5ce56d0-kube-api-access-p9rj6\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:43.759752 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.759730    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmkq\" (UniqueName: \"kubernetes.io/projected/692d634d-861a-4267-ab57-b85a755c5692-kube-api-access-pjmkq\") pod \"aws-ebs-csi-driver-node-gnk97\" (UID: \"692d634d-861a-4267-ab57-b85a755c5692\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.760050 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.760035    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95qc\" (UniqueName: \"kubernetes.io/projected/dd3c2e81-415a-4612-9f08-04cebfa4bba0-kube-api-access-r95qc\") pod \"tuned-bq8ss\" (UID: \"dd3c2e81-415a-4612-9f08-04cebfa4bba0\") " pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.840036 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.839986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:29:43.848962 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.848938    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbrfq"
Jul 28 19:29:43.858711 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.858684    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44t57"
Jul 28 19:29:43.865691 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.865672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m58qf"
Jul 28 19:29:43.873717 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.873697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97"
Jul 28 19:29:43.881445 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.881424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jcfnq"
Jul 28 19:29:43.890056 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.890030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bq8ss"
Jul 28 19:29:43.897894 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.897871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9jcd"
Jul 28 19:29:43.904697 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.904673    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:29:43.937091 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:43.937059    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:29:44.252629 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.252596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:44.252787 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.252650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:44.252787 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.252754    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:44.252877 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.252826    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:45.252808386 +0000 UTC m=+4.101341831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:44.252877 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.252762    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:44.252954 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.252890    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:45.252878401 +0000 UTC m=+4.101411850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:44.353589 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.353551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:44.353743 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.353695    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:44.353743 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.353709    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:44.353743 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.353720    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:44.353869 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:44.353772    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:29:45.353757458 +0000 UTC m=+4.202290903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:44.575148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.575047    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:24:43 +0000 UTC" deadline="2027-12-24 19:13:05.748783949 +0000 UTC"
Jul 28 19:29:44.575148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.575086    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12335h43m21.173701727s"
Jul 28 19:29:44.633982 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.633944    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6dc457_fa80_4782_bc1d_beeb7a7cf49a.slice/crio-1b353a7d959ba5ece74a019dadc42e436c0658f9d0d4414b3d0953a4c4aae225 WatchSource:0}: Error finding container 1b353a7d959ba5ece74a019dadc42e436c0658f9d0d4414b3d0953a4c4aae225: Status 404 returned error can't find the container with id 1b353a7d959ba5ece74a019dadc42e436c0658f9d0d4414b3d0953a4c4aae225
Jul 28 19:29:44.635291 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.635249    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456fe185_63e2_497a_b3e0_61c0e23294a5.slice/crio-93b33f09691af17ed30578367a5cc79fbbf17933174922bc42043b6157710d71 WatchSource:0}: Error finding container 93b33f09691af17ed30578367a5cc79fbbf17933174922bc42043b6157710d71: Status 404 returned error can't find the container with id 93b33f09691af17ed30578367a5cc79fbbf17933174922bc42043b6157710d71
Jul 28 19:29:44.636868 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.636846    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662f3693_4294_4f5e_b8d9_6fe5f7f0f4e1.slice/crio-f732bddc929d6d42aaa7ef15f011be812366abe66777abf431f307bdb6afdebc WatchSource:0}: Error finding container f732bddc929d6d42aaa7ef15f011be812366abe66777abf431f307bdb6afdebc: Status 404 returned error can't find the container with id f732bddc929d6d42aaa7ef15f011be812366abe66777abf431f307bdb6afdebc
Jul 28 19:29:44.640479 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.640454    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692d634d_861a_4267_ab57_b85a755c5692.slice/crio-5bbdda4053f141337af65a9bb176a1b3eebbdc77e36cdc860998e521e0bb77d6 WatchSource:0}: Error finding container 5bbdda4053f141337af65a9bb176a1b3eebbdc77e36cdc860998e521e0bb77d6: Status 404 returned error can't find the container with id 5bbdda4053f141337af65a9bb176a1b3eebbdc77e36cdc860998e521e0bb77d6
Jul 28 19:29:44.641917 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.641891    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44265658_6628_454e_9ccc_a77e776cce4c.slice/crio-9642dbc923f4d275b9d5c60574e2a0869bf1306816a488c1e70b219369230e4c WatchSource:0}: Error finding container 9642dbc923f4d275b9d5c60574e2a0869bf1306816a488c1e70b219369230e4c: Status 404 returned error can't find the container with id 9642dbc923f4d275b9d5c60574e2a0869bf1306816a488c1e70b219369230e4c
Jul 28 19:29:44.643051 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.643028    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592865ab_8346_4df2_bb41_fd71b6ddb268.slice/crio-7fdea8fcd94daa0dc4a690428a3908eb28a364d748361c9b22004094c4fcec76 WatchSource:0}: Error finding container 7fdea8fcd94daa0dc4a690428a3908eb28a364d748361c9b22004094c4fcec76: Status 404 returned error can't find the container with id 7fdea8fcd94daa0dc4a690428a3908eb28a364d748361c9b22004094c4fcec76
Jul 28 19:29:44.644046 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.643931    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b02357_d725_4899_bcf2_995b9994823e.slice/crio-169b7c77b1ae2d1645f846c83ae5868fc6ca96ad772b137b4fcdab2437cceec2 WatchSource:0}: Error finding container 169b7c77b1ae2d1645f846c83ae5868fc6ca96ad772b137b4fcdab2437cceec2: Status 404 returned error can't find the container with id 169b7c77b1ae2d1645f846c83ae5868fc6ca96ad772b137b4fcdab2437cceec2
Jul 28 19:29:44.645939 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.645914    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f36433_c99b_4c6a_8825_e94b771ecbe4.slice/crio-e7d87921bbfde7e2fcea8503d6b80c2aa5a0fa3a3af198834d9b677e63b25832 WatchSource:0}: Error finding container e7d87921bbfde7e2fcea8503d6b80c2aa5a0fa3a3af198834d9b677e63b25832: Status 404 returned error can't find the container with id e7d87921bbfde7e2fcea8503d6b80c2aa5a0fa3a3af198834d9b677e63b25832
Jul 28 19:29:44.647954 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:29:44.647916    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3c2e81_415a_4612_9f08_04cebfa4bba0.slice/crio-b39be3c48532444122ac9ccdfe6af59f759b26a660fd066ac8b606383afe68b8 WatchSource:0}: Error finding container b39be3c48532444122ac9ccdfe6af59f759b26a660fd066ac8b606383afe68b8: Status 404 returned error can't find the container with id b39be3c48532444122ac9ccdfe6af59f759b26a660fd066ac8b606383afe68b8
Jul 28 19:29:44.713475 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.713440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerStarted","Data":"1b353a7d959ba5ece74a019dadc42e436c0658f9d0d4414b3d0953a4c4aae225"}
Jul 28 19:29:44.714698 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.714659    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bq8ss" event={"ID":"dd3c2e81-415a-4612-9f08-04cebfa4bba0","Type":"ContainerStarted","Data":"b39be3c48532444122ac9ccdfe6af59f759b26a660fd066ac8b606383afe68b8"}
Jul 28 19:29:44.715819 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.715790    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jcfnq" event={"ID":"40b02357-d725-4899-bcf2-995b9994823e","Type":"ContainerStarted","Data":"169b7c77b1ae2d1645f846c83ae5868fc6ca96ad772b137b4fcdab2437cceec2"}
Jul 28 19:29:44.717068 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.717037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44t57" event={"ID":"592865ab-8346-4df2-bb41-fd71b6ddb268","Type":"ContainerStarted","Data":"7fdea8fcd94daa0dc4a690428a3908eb28a364d748361c9b22004094c4fcec76"}
Jul 28 19:29:44.718212 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.718178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjkvl" event={"ID":"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1","Type":"ContainerStarted","Data":"f732bddc929d6d42aaa7ef15f011be812366abe66777abf431f307bdb6afdebc"}
Jul 28 19:29:44.719148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.719129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9jcd" event={"ID":"456fe185-63e2-497a-b3e0-61c0e23294a5","Type":"ContainerStarted","Data":"93b33f09691af17ed30578367a5cc79fbbf17933174922bc42043b6157710d71"}
Jul 28 19:29:44.720549 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.720514    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"e7d87921bbfde7e2fcea8503d6b80c2aa5a0fa3a3af198834d9b677e63b25832"}
Jul 28 19:29:44.721813 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.721715    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbrfq" event={"ID":"44265658-6628-454e-9ccc-a77e776cce4c","Type":"ContainerStarted","Data":"9642dbc923f4d275b9d5c60574e2a0869bf1306816a488c1e70b219369230e4c"}
Jul 28 19:29:44.723208 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:44.723184    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97" event={"ID":"692d634d-861a-4267-ab57-b85a755c5692","Type":"ContainerStarted","Data":"5bbdda4053f141337af65a9bb176a1b3eebbdc77e36cdc860998e521e0bb77d6"}
Jul 28 19:29:45.261182 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.261085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:45.261340 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.261190    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:45.261421 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.261380    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:45.261485 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.261448    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:47.261428917 +0000 UTC m=+6.109962380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:45.261869 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.261849    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:45.261942 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.261906    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:47.261891071 +0000 UTC m=+6.110424533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:45.362086 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.362051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:45.362286 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.362247    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:45.362286 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.362285    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:45.362447 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.362299    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:45.362447 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.362377    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:29:47.362342408 +0000 UTC m=+6.210875856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:45.576311 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.576182    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:24:43 +0000 UTC" deadline="2028-04-14 01:21:54.847819492 +0000 UTC"
Jul 28 19:29:45.576311 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.576251    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15005h52m9.271572007s"
Jul 28 19:29:45.705881 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.705763    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:45.706047 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.705913    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:45.706400 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.706377    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:45.706503 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.706476    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:45.706560 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.706539    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:45.706624 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:45.706607    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:45.744415 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.744356    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal" event={"ID":"f82d0ea6d17a563c4b7940ec7927ea2a","Type":"ContainerStarted","Data":"ff22c29b0417c7cd3597442527752c841ec87bad2f2f14b04ea04217bff24b57"}
Jul 28 19:29:45.755959 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.755266    2574 generic.go:356] "Generic (PLEG): container finished" podID="0d0e1ef05613d307243fa9dd278c14a9" containerID="92cf55836b1ae1c8478436fd08fd7804dff27eeca9c054711c178aac11e4eee2" exitCode=0
Jul 28 19:29:45.755959 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.755319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal" event={"ID":"0d0e1ef05613d307243fa9dd278c14a9","Type":"ContainerDied","Data":"92cf55836b1ae1c8478436fd08fd7804dff27eeca9c054711c178aac11e4eee2"}
Jul 28 19:29:45.759344 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:45.758297    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-245.ec2.internal" podStartSLOduration=2.758280476 podStartE2EDuration="2.758280476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:29:45.757936364 +0000 UTC m=+4.606469832" watchObservedRunningTime="2026-07-28 19:29:45.758280476 +0000 UTC m=+4.606813946"
Jul 28 19:29:46.773406 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:46.773332    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal" event={"ID":"0d0e1ef05613d307243fa9dd278c14a9","Type":"ContainerStarted","Data":"071c998124cfbf1648f0452f1f5d07b481de8cf3e3e0b26dd66c6d7395984456"}
Jul 28 19:29:46.792106 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:46.791952    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-245.ec2.internal" podStartSLOduration=3.791929502 podStartE2EDuration="3.791929502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:29:46.791632577 +0000 UTC m=+5.640166045" watchObservedRunningTime="2026-07-28 19:29:46.791929502 +0000 UTC m=+5.640462976"
Jul 28 19:29:47.279155 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:47.279116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:47.279332 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:47.279212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:47.279332 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.279293    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:47.279548 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.279335    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:47.279548 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.279391    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:51.279355029 +0000 UTC m=+10.127888498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:47.279548 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.279411    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:51.279402279 +0000 UTC m=+10.127935725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:47.380107 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:47.380069    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:47.380308 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.380257    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:47.380308 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.380280    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:47.380308 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.380293    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:47.380489 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.380348    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:29:51.380331198 +0000 UTC m=+10.228864663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:47.708415 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:47.707587    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:47.708415 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.707722    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:47.708415 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:47.708089    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:47.708415 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.708179    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:47.708415 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:47.708224    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:47.708415 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:47.708294    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:49.704619 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:49.704355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:49.704619 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:49.704530    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:49.705105 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:49.704952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:49.705105 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:49.705050    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:49.705227 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:49.705191    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:49.705322 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:49.705283    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:51.313317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:51.313274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:51.313793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:51.313391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:51.313793 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.313424    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:51.313793 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.313506    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:59.313485545 +0000 UTC m=+18.162018990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:51.313793 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.313515    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:51.313793 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.313567    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:29:59.313551597 +0000 UTC m=+18.162085045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:51.414680 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:51.414611    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:51.414847 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.414800    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:51.414847 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.414831    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:51.414847 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.414845    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:51.415014 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.414912    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:29:59.414892779 +0000 UTC m=+18.263426227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:51.705278 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:51.704513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:51.705278 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.704639    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:51.705278 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:51.704998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:51.705278 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.705083    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:51.705278 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:51.705124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:51.705278 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:51.705194    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:53.703861 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:53.703827    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:53.704321 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:53.703827    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:53.704321 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:53.703991    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:53.704321 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:53.704102    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:53.704321 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:53.704155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:53.704321 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:53.704254    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:55.704055 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:55.704017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:55.704055 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:55.704059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:55.704549 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:55.704017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:55.704549 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:55.704139    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:55.704549 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:55.704198    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:55.704549 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:55.704289    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:57.704073 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:57.704039    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:57.704538 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:57.704042    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:57.704538 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:57.704170    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:57.704538 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:57.704272    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:29:57.704538 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:57.704043    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:57.704538 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:57.704393    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:59.376435 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:59.376387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:59.376864 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:59.376451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:59.376864 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.376603    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:59.376864 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.376664    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:15.376649734 +0000 UTC m=+34.225183178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:29:59.376864 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.376603    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:59.376864 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.376729    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:15.376717525 +0000 UTC m=+34.225250977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:29:59.477676 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:59.477623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:59.477898 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.477831    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:29:59.477898 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.477859    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:29:59.477898 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.477870    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:59.478062 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.477931    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:30:15.477912513 +0000 UTC m=+34.326445975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:29:59.704055 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:59.703970    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:29:59.704224 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:59.703970    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:29:59.704224 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.704102    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:29:59.704224 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:29:59.703988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:29:59.704224 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.704146    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:29:59.704465 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:29:59.704275    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:01.704629 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:01.704587    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:01.705096 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:01.704688    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:01.705096 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:01.704721    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:01.705096 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:01.704738    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:01.705096 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:01.704801    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:01.705096 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:01.704877    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:03.703838 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.703525    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:03.703838 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.703524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:03.703838 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:03.703808    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:03.704500 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.703524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:03.704500 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:03.703892    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:03.704500 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:03.703952    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:03.809987 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.809901    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"e979cfcb379196aa5cf0c9b060c1c2f1b04339c0c5bd8f5c0122b75e37eff524"}
Jul 28 19:30:03.810138 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.809990    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"2efd0d4fd3c24f53247bcbef500326e5d57f36cecf117f09cc6ab2217b325d09"}
Jul 28 19:30:03.810138 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.810034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"201a021d6d854316244fee1fdceb99073c48021169b09bbdc80af06e2946a9a9"}
Jul 28 19:30:03.810138 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.810077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"84440b44e147df134c296bc451ee28dabd456b72f93c03abd21cb1cb78215490"}
Jul 28 19:30:03.810138 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.810135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"b41cd9efc1c4da8e8a31cdab9d34e610a42fa1597f15815c1f4c658c0e31bf0a"}
Jul 28 19:30:03.810333 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.810180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"a2a637f3c6ff41dbe8738c2ce9620b82584aa9602398b713c81ca8c7580c92d0"}
Jul 28 19:30:03.811490 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.811453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbrfq" event={"ID":"44265658-6628-454e-9ccc-a77e776cce4c","Type":"ContainerStarted","Data":"c6d65eb76c876cdf6b3d0fea52522258c475b79dcae4ab65edf0e8d87b88b6f8"}
Jul 28 19:30:03.813206 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.813180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97" event={"ID":"692d634d-861a-4267-ab57-b85a755c5692","Type":"ContainerStarted","Data":"a9f7d6caf25787fec34e15a92448e07c8be6717801a6c3e7d68b9ff236ac3b27"}
Jul 28 19:30:03.814824 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.814797    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e6dc457-fa80-4782-bc1d-beeb7a7cf49a" containerID="f986010bad749591b22f885b5abdf686386f069e42e3a1133a9a97f524f3caa0" exitCode=0
Jul 28 19:30:03.814952 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.814889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerDied","Data":"f986010bad749591b22f885b5abdf686386f069e42e3a1133a9a97f524f3caa0"}
Jul 28 19:30:03.816717 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.816692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bq8ss" event={"ID":"dd3c2e81-415a-4612-9f08-04cebfa4bba0","Type":"ContainerStarted","Data":"c3de44ee544577660d4a06e831d01e4afd5449f6b3fb4f116b5269609c6921cf"}
Jul 28 19:30:03.818270 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.818251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44t57" event={"ID":"592865ab-8346-4df2-bb41-fd71b6ddb268","Type":"ContainerStarted","Data":"c206bd04660123df371ec905d96c427cbf6c03228eca62a1731e803fd8ac465d"}
Jul 28 19:30:03.819782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.819755    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjkvl" event={"ID":"662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1","Type":"ContainerStarted","Data":"d51403bcfe6fdfbbe91b67c062a4a65974d2e300dcbb072c976f289535580242"}
Jul 28 19:30:03.821310 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.821288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9jcd" event={"ID":"456fe185-63e2-497a-b3e0-61c0e23294a5","Type":"ContainerStarted","Data":"fa014dd422225b28cfe7beb6fcdfd68535c0fe1fd84bcddd3323cb995532dbe0"}
Jul 28 19:30:03.831321 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.831266    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbrfq" podStartSLOduration=4.367796395 podStartE2EDuration="22.831251931s" totalImagesPullingTime="18.463455536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:03.829837731 +0000 UTC m=+22.678371203" watchObservedRunningTime="2026-07-28 19:30:03.831251931 +0000 UTC m=+22.679785395"
Jul 28 19:30:03.845240 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.845189    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-44t57" podStartSLOduration=4.451850685 podStartE2EDuration="22.845176816s" totalImagesPullingTime="18.393326131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:03.844748742 +0000 UTC m=+22.693282208" watchObservedRunningTime="2026-07-28 19:30:03.845176816 +0000 UTC m=+22.693710280"
Jul 28 19:30:03.884131 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.884083    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bq8ss" podStartSLOduration=4.493199922 podStartE2EDuration="22.884067366s" totalImagesPullingTime="18.390867444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:03.883839392 +0000 UTC m=+22.732372858" watchObservedRunningTime="2026-07-28 19:30:03.884067366 +0000 UTC m=+22.732600832"
Jul 28 19:30:03.899944 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.899888    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kjkvl" podStartSLOduration=12.324588007 podStartE2EDuration="22.899877057s" totalImagesPullingTime="10.57528905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:03.899489018 +0000 UTC m=+22.748022463" watchObservedRunningTime="2026-07-28 19:30:03.899877057 +0000 UTC m=+22.748410575"
Jul 28 19:30:03.915072 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:03.915019    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k9jcd" podStartSLOduration=4.515291985 podStartE2EDuration="22.915001488s" totalImagesPullingTime="18.399709503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:03.914482323 +0000 UTC m=+22.763015781" watchObservedRunningTime="2026-07-28 19:30:03.915001488 +0000 UTC m=+22.763534954"
Jul 28 19:30:04.825872 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:04.825838    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jcfnq" event={"ID":"40b02357-d725-4899-bcf2-995b9994823e","Type":"ContainerStarted","Data":"af14a35895bc49796065e3015e977c641c8e466f8f33dc1b00a242e63f545dbc"}
Jul 28 19:30:04.840860 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:04.840806    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jcfnq" podStartSLOduration=5.448520451 podStartE2EDuration="23.840788858s" totalImagesPullingTime="18.392268407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:04.840283282 +0000 UTC m=+23.688816749" watchObservedRunningTime="2026-07-28 19:30:04.840788858 +0000 UTC m=+23.689322316"
Jul 28 19:30:04.937097 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:04.937071    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 19:30:05.606962 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.606811    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T19:30:04.937089882Z","UUID":"55fcaf1e-0771-419f-953c-c6f3f7d6735b","Handler":null,"Name":"","Endpoint":""}
Jul 28 19:30:05.608544 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.608520    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 19:30:05.608679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.608563    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 19:30:05.703639 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.703605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:05.703823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.703605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:05.703823 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:05.703744    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:05.703823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.703606    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:05.703978 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:05.703853    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:05.703978 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:05.703950    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:05.831376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:05.831331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97" event={"ID":"692d634d-861a-4267-ab57-b85a755c5692","Type":"ContainerStarted","Data":"336733cda8762889b319e9388ba26a64fae4350e1e4de1cb4b498fe52e988532"}
Jul 28 19:30:06.837400 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:06.837351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"b7af182df41462e34992836efefd28723abcd3e7474892ce18800a13ad628c39"}
Jul 28 19:30:07.703587 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:07.703549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:07.703778 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:07.703549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:07.703778 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:07.703682    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:07.703778 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:07.703549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:07.703937 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:07.703793    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:07.703937 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:07.703836    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:08.436643 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.436616    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:30:08.437347 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.437150    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:30:08.845935 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.845897    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" event={"ID":"04f36433-c99b-4c6a-8825-e94b771ecbe4","Type":"ContainerStarted","Data":"6acc97fbc6964d632a740a5280295ab6d79dfea725ae3191874a84889917b7b4"}
Jul 28 19:30:08.846178 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.846154    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:30:08.848152 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.848117    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97" event={"ID":"692d634d-861a-4267-ab57-b85a755c5692","Type":"ContainerStarted","Data":"48dadc9b24ebc796862e15c1a9ddcc6681d6a9f1aeab6d2720cdbd16ed7bead7"}
Jul 28 19:30:08.850117 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.849955    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e6dc457-fa80-4782-bc1d-beeb7a7cf49a" containerID="59508effeb82a48b614b97f6f9c0b975cf2b39ae2a7c7ddf005a623c32f785e7" exitCode=0
Jul 28 19:30:08.850230 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.850035    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerDied","Data":"59508effeb82a48b614b97f6f9c0b975cf2b39ae2a7c7ddf005a623c32f785e7"}
Jul 28 19:30:08.850352 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.850335    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:30:08.850994 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.850905    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kjkvl"
Jul 28 19:30:08.863208 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.863186    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:30:08.872373 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.872321    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n" podStartSLOduration=9.401225472 podStartE2EDuration="27.872306596s" totalImagesPullingTime="18.471081124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:08.870958956 +0000 UTC m=+27.719492424" watchObservedRunningTime="2026-07-28 19:30:08.872306596 +0000 UTC m=+27.720840048"
Jul 28 19:30:08.887772 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:08.887719    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gnk97" podStartSLOduration=4.788961194 podStartE2EDuration="27.887703207s" totalImagesPullingTime="23.098742013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:08.887485888 +0000 UTC m=+27.736019337" watchObservedRunningTime="2026-07-28 19:30:08.887703207 +0000 UTC m=+27.736236674"
Jul 28 19:30:09.704096 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:09.704068    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:09.704617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:09.704076    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:09.704617 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:09.704171    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:09.704617 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:09.704258    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:09.704617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:09.704076    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:09.704617 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:09.704330    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:09.852814 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:09.852774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:30:09.853384 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:09.853344    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:30:09.868908 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:09.868877    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:30:10.137975 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.137891    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4kq2"]
Jul 28 19:30:10.138156 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.138077    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:10.138224 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:10.138205    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:10.141205 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.141173    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hv5wt"]
Jul 28 19:30:10.141399 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.141305    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:10.141476 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:10.141451    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:10.141895 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.141871    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gkf5m"]
Jul 28 19:30:10.142018 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.141981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:10.142107 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:10.142087    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:10.856754 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.856721    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e6dc457-fa80-4782-bc1d-beeb7a7cf49a" containerID="98a65bcd8b9a8c18e72aa83ab8091cb37d73a431bfc7de64e9d32fcff55f7a84" exitCode=0
Jul 28 19:30:10.857209 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:10.856801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerDied","Data":"98a65bcd8b9a8c18e72aa83ab8091cb37d73a431bfc7de64e9d32fcff55f7a84"}
Jul 28 19:30:11.704837 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:11.704628    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:11.705023 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:11.704695    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:11.705023 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:11.704898    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:11.705124 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:11.705024    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:11.705124 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:11.704713    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:11.705191 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:11.705136    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:12.863309 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:12.863270    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e6dc457-fa80-4782-bc1d-beeb7a7cf49a" containerID="3fe785fc95117786c2917de7ead78e0cbf3a855730d9e5ffb8c05dae6faa9e71" exitCode=0
Jul 28 19:30:12.863309 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:12.863312    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerDied","Data":"3fe785fc95117786c2917de7ead78e0cbf3a855730d9e5ffb8c05dae6faa9e71"}
Jul 28 19:30:13.703283 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:13.703244    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:13.703648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:13.703379    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:13.703648 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:13.703387    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:13.703648 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:13.703482    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:13.703648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:13.703535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:13.703648 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:13.703608    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:15.394055 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.394018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:15.394484 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.394091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:15.394484 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.394195    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:30:15.394484 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.394263    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret podName:7242a83b-7c5d-42b4-a16e-76dbb67db5b5 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:47.394244258 +0000 UTC m=+66.242777719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret") pod "global-pull-secret-syncer-hv5wt" (UID: "7242a83b-7c5d-42b4-a16e-76dbb67db5b5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:30:15.394484 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.394193    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:30:15.394484 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.394344    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:47.394326903 +0000 UTC m=+66.242860348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:30:15.494909 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.494876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:15.495087 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.495035    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:30:15.495087 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.495065    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:30:15.495087 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.495078    2574 projected.go:196] Error preparing data for projected volume kube-api-access-r6v7t for pod openshift-network-diagnostics/network-check-target-gkf5m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:30:15.495222 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.495148    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t podName:d89fcc11-aff4-45a7-949f-68b6c921d98b nodeName:}" failed. No retries permitted until 2026-07-28 19:30:47.495126001 +0000 UTC m=+66.343659448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6v7t" (UniqueName: "kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t") pod "network-check-target-gkf5m" (UID: "d89fcc11-aff4-45a7-949f-68b6c921d98b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:30:15.703985 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.703908    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:15.704135 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.703908    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:15.704135 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.704048    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gkf5m" podUID="d89fcc11-aff4-45a7-949f-68b6c921d98b"
Jul 28 19:30:15.704135 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.704100    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:15.704316 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.704227    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:30:15.704392 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:15.704315    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hv5wt" podUID="7242a83b-7c5d-42b4-a16e-76dbb67db5b5"
Jul 28 19:30:15.952536 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.952507    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-245.ec2.internal" event="NodeReady"
Jul 28 19:30:15.952733 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.952697    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 19:30:15.996306 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.996214    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vj7vk"]
Jul 28 19:30:15.999247 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.999217    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f97hk"]
Jul 28 19:30:15.999409 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:15.999335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.001062 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.001042    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.002353 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.002149    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 19:30:16.002353 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.002183    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwrtc\""
Jul 28 19:30:16.002353 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.002295    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 19:30:16.003674 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.003608    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 19:30:16.003674 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.003631    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-75bnq\""
Jul 28 19:30:16.004047 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.003888    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 19:30:16.004047 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.004044    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 19:30:16.009555 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.009496    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj7vk"]
Jul 28 19:30:16.012023 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.011959    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f97hk"]
Jul 28 19:30:16.099731 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.099690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97tm\" (UniqueName: \"kubernetes.io/projected/f2bf292e-4ef1-4d23-88bb-235f1e5c5672-kube-api-access-z97tm\") pod \"ingress-canary-f97hk\" (UID: \"f2bf292e-4ef1-4d23-88bb-235f1e5c5672\") " pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.099904 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.099733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfn9q\" (UniqueName: \"kubernetes.io/projected/88f015c2-1349-4491-803c-310e227415d1-kube-api-access-cfn9q\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.099904 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.099812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88f015c2-1349-4491-803c-310e227415d1-config-volume\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.099904 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.099886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.100062 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.099918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f015c2-1349-4491-803c-310e227415d1-tmp-dir\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.100062 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.099937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2bf292e-4ef1-4d23-88bb-235f1e5c5672-cert\") pod \"ingress-canary-f97hk\" (UID: \"f2bf292e-4ef1-4d23-88bb-235f1e5c5672\") " pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.201127 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201095    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97tm\" (UniqueName: \"kubernetes.io/projected/f2bf292e-4ef1-4d23-88bb-235f1e5c5672-kube-api-access-z97tm\") pod \"ingress-canary-f97hk\" (UID: \"f2bf292e-4ef1-4d23-88bb-235f1e5c5672\") " pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.201127 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfn9q\" (UniqueName: \"kubernetes.io/projected/88f015c2-1349-4491-803c-310e227415d1-kube-api-access-cfn9q\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.201381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88f015c2-1349-4491-803c-310e227415d1-config-volume\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.201381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.201381 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:16.201321    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:16.201536 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:16.201391    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:16.701357162 +0000 UTC m=+35.549890608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:16.201536 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f015c2-1349-4491-803c-310e227415d1-tmp-dir\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.201536 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2bf292e-4ef1-4d23-88bb-235f1e5c5672-cert\") pod \"ingress-canary-f97hk\" (UID: \"f2bf292e-4ef1-4d23-88bb-235f1e5c5672\") " pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.201802 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201779    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f015c2-1349-4491-803c-310e227415d1-tmp-dir\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.201915 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.201895    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88f015c2-1349-4491-803c-310e227415d1-config-volume\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.206396 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.206351    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2bf292e-4ef1-4d23-88bb-235f1e5c5672-cert\") pod \"ingress-canary-f97hk\" (UID: \"f2bf292e-4ef1-4d23-88bb-235f1e5c5672\") " pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.212348 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.212311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfn9q\" (UniqueName: \"kubernetes.io/projected/88f015c2-1349-4491-803c-310e227415d1-kube-api-access-cfn9q\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.212840 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.212821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97tm\" (UniqueName: \"kubernetes.io/projected/f2bf292e-4ef1-4d23-88bb-235f1e5c5672-kube-api-access-z97tm\") pod \"ingress-canary-f97hk\" (UID: \"f2bf292e-4ef1-4d23-88bb-235f1e5c5672\") " pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.320743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.320652    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f97hk"
Jul 28 19:30:16.705539 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:16.705500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:16.706127 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:16.705684    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:16.706127 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:16.705780    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:17.705757835 +0000 UTC m=+36.554291286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:17.138015 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.137843    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f97hk"]
Jul 28 19:30:17.140965 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:30:17.140938    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2bf292e_4ef1_4d23_88bb_235f1e5c5672.slice/crio-46ff7af3d25a3dcf253f3d8c6c17a99624b4a3d1538907eb50ca99b5c927760b WatchSource:0}: Error finding container 46ff7af3d25a3dcf253f3d8c6c17a99624b4a3d1538907eb50ca99b5c927760b: Status 404 returned error can't find the container with id 46ff7af3d25a3dcf253f3d8c6c17a99624b4a3d1538907eb50ca99b5c927760b
Jul 28 19:30:17.707031 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.706998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:17.707536 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.707038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:17.707536 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.707107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:17.711973 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.711944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:17.712107 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:17.712053    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:17.712165 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:17.712133    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:19.712113761 +0000 UTC m=+38.560647208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:17.712317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.712298    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zz5d7\""
Jul 28 19:30:17.712358 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.712340    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:30:17.712553 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.712538    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:30:17.712602 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.712539    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:30:17.712602 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.712583    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:30:17.712675 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.712541    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8krh\""
Jul 28 19:30:17.879757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.879716    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e6dc457-fa80-4782-bc1d-beeb7a7cf49a" containerID="c46fa8a9f43a2deba867da57acfcefa2a5aa9a7cddfe622d02859f9e7aa1f680" exitCode=0
Jul 28 19:30:17.879922 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.879752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerDied","Data":"c46fa8a9f43a2deba867da57acfcefa2a5aa9a7cddfe622d02859f9e7aa1f680"}
Jul 28 19:30:17.881221 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:17.881175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f97hk" event={"ID":"f2bf292e-4ef1-4d23-88bb-235f1e5c5672","Type":"ContainerStarted","Data":"46ff7af3d25a3dcf253f3d8c6c17a99624b4a3d1538907eb50ca99b5c927760b"}
Jul 28 19:30:18.887847 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:18.887811    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e6dc457-fa80-4782-bc1d-beeb7a7cf49a" containerID="b0606e7dfeb651833be4dc8681f569b28e2ea367aabfbf534948765f200f1307" exitCode=0
Jul 28 19:30:18.888261 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:18.887871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerDied","Data":"b0606e7dfeb651833be4dc8681f569b28e2ea367aabfbf534948765f200f1307"}
Jul 28 19:30:19.728953 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:19.728770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:19.729111 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:19.728929    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:19.729111 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:19.729010    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:23.728995362 +0000 UTC m=+42.577528806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:19.893602 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:19.893516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m58qf" event={"ID":"0e6dc457-fa80-4782-bc1d-beeb7a7cf49a","Type":"ContainerStarted","Data":"8a34c7614f76d858793569f6ebf68b8e1ef5eb4df626b7baf69d1aa293456ae3"}
Jul 28 19:30:19.894948 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:19.894925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f97hk" event={"ID":"f2bf292e-4ef1-4d23-88bb-235f1e5c5672","Type":"ContainerStarted","Data":"29468f5deb278a0ff2e967e9aa198a6a8a7c1fcf7e22f6aa0c0632e923c49116"}
Jul 28 19:30:19.917273 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:19.917230    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m58qf" podStartSLOduration=9.676989949 podStartE2EDuration="38.917211191s" totalImagesPullingTime="29.240221242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:19.91523149 +0000 UTC m=+38.763764958" watchObservedRunningTime="2026-07-28 19:30:19.917211191 +0000 UTC m=+38.765744655"
Jul 28 19:30:19.931154 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:19.931112    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f97hk" podStartSLOduration=2.476883039 podStartE2EDuration="4.931102061s" totalImagesPullingTime="2.454219022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:19.930766237 +0000 UTC m=+38.779299706" watchObservedRunningTime="2026-07-28 19:30:19.931102061 +0000 UTC m=+38.779635528"
Jul 28 19:30:23.759797 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:23.759758    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:23.760537 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:23.759944    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:23.760537 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:23.760027    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:31.760004678 +0000 UTC m=+50.608538123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:31.815381 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:31.815334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:31.815775 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:31.815464    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:31.815775 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:31.815536    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:30:47.815522081 +0000 UTC m=+66.664055526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:41.877201 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:41.877170    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trv9n"
Jul 28 19:30:47.425944 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.425887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:47.425944 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.425951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:30:47.428827 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.428809    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:30:47.428827 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.428819    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:30:47.436452 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:47.436435    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 19:30:47.436517 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:47.436493    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:31:51.436477533 +0000 UTC m=+130.285010977 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : secret "metrics-daemon-secret" not found
Jul 28 19:30:47.440194 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.440174    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7242a83b-7c5d-42b4-a16e-76dbb67db5b5-original-pull-secret\") pod \"global-pull-secret-syncer-hv5wt\" (UID: \"7242a83b-7c5d-42b4-a16e-76dbb67db5b5\") " pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:47.527033 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.526980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:47.530291 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.530269    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:30:47.540533 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.540509    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:30:47.550207 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.550181    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6v7t\" (UniqueName: \"kubernetes.io/projected/d89fcc11-aff4-45a7-949f-68b6c921d98b-kube-api-access-r6v7t\") pod \"network-check-target-gkf5m\" (UID: \"d89fcc11-aff4-45a7-949f-68b6c921d98b\") " pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:47.726915 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.726821    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hv5wt"
Jul 28 19:30:47.736293 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.736270    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8krh\""
Jul 28 19:30:47.743616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.743592    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:47.828874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.828842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:30:47.829031 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:47.829010    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:30:47.829147 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:30:47.829133    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:31:19.829108344 +0000 UTC m=+98.677641809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:30:47.855819 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.854818    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"]
Jul 28 19:30:47.858203 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.857097    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:47.868098 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.867937    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 19:30:47.868098 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.867947    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 19:30:47.868098 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.867984    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 19:30:47.869346 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.869167    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 19:30:47.870637 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.870564    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hv5wt"]
Jul 28 19:30:47.871522 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.871499    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"]
Jul 28 19:30:47.872756 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:30:47.872733    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7242a83b_7c5d_42b4_a16e_76dbb67db5b5.slice/crio-292e50dd51ee9c44d548f45ae6512bec77e812f5383d2f5e7bf35480e0a15076 WatchSource:0}: Error finding container 292e50dd51ee9c44d548f45ae6512bec77e812f5383d2f5e7bf35480e0a15076: Status 404 returned error can't find the container with id 292e50dd51ee9c44d548f45ae6512bec77e812f5383d2f5e7bf35480e0a15076
Jul 28 19:30:47.887957 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.887930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gkf5m"]
Jul 28 19:30:47.890690 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:30:47.890668    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89fcc11_aff4_45a7_949f_68b6c921d98b.slice/crio-1e0a11a21880060ccda373ac8f62e9493e133c9b35901e96c510dabe58b58877 WatchSource:0}: Error finding container 1e0a11a21880060ccda373ac8f62e9493e133c9b35901e96c510dabe58b58877: Status 404 returned error can't find the container with id 1e0a11a21880060ccda373ac8f62e9493e133c9b35901e96c510dabe58b58877
Jul 28 19:30:47.958559 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.958520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gkf5m" event={"ID":"d89fcc11-aff4-45a7-949f-68b6c921d98b","Type":"ContainerStarted","Data":"1e0a11a21880060ccda373ac8f62e9493e133c9b35901e96c510dabe58b58877"}
Jul 28 19:30:47.959530 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:47.959509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hv5wt" event={"ID":"7242a83b-7c5d-42b4-a16e-76dbb67db5b5","Type":"ContainerStarted","Data":"292e50dd51ee9c44d548f45ae6512bec77e812f5383d2f5e7bf35480e0a15076"}
Jul 28 19:30:48.030334 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.030254    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-klusterlet-config\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.030334 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.030292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-tmp\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.030334 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.030319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ztxf\" (UniqueName: \"kubernetes.io/projected/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-kube-api-access-8ztxf\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.130842 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.130804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ztxf\" (UniqueName: \"kubernetes.io/projected/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-kube-api-access-8ztxf\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.130997 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.130888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-klusterlet-config\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.130997 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.130914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-tmp\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.131330 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.131312    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-tmp\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.133299 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.133280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-klusterlet-config\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.140063 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.140037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ztxf\" (UniqueName: \"kubernetes.io/projected/0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64-kube-api-access-8ztxf\") pod \"klusterlet-addon-workmgr-754865ff7b-f2mfc\" (UID: \"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.178952 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.178921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:30:48.301051 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.300958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"]
Jul 28 19:30:48.307317 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:30:48.307187    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccf6ee3_a4b8_4297_a6bc_7f495a17ce64.slice/crio-e084d8d49a872d50c960bb4f913c642c44eae51e74f7bafe5c4bfa1f652a22e9 WatchSource:0}: Error finding container e084d8d49a872d50c960bb4f913c642c44eae51e74f7bafe5c4bfa1f652a22e9: Status 404 returned error can't find the container with id e084d8d49a872d50c960bb4f913c642c44eae51e74f7bafe5c4bfa1f652a22e9
Jul 28 19:30:48.963870 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:48.963823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc" event={"ID":"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64","Type":"ContainerStarted","Data":"e084d8d49a872d50c960bb4f913c642c44eae51e74f7bafe5c4bfa1f652a22e9"}
Jul 28 19:30:52.976489 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:52.976448    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hv5wt" event={"ID":"7242a83b-7c5d-42b4-a16e-76dbb67db5b5","Type":"ContainerStarted","Data":"0b11020ec6852a6dad2fca18b54ed48bd9c32f820107c9e6ac9ccba3c32fdae2"}
Jul 28 19:30:52.977938 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:52.977918    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gkf5m" event={"ID":"d89fcc11-aff4-45a7-949f-68b6c921d98b","Type":"ContainerStarted","Data":"54a784536f3988cc4ca8c202db9fcd70f36309588b3538fcdcc8b4011af7c7b3"}
Jul 28 19:30:52.978057 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:52.978042    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:30:52.992870 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:52.992830    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hv5wt" podStartSLOduration=67.45017725 podStartE2EDuration="1m11.992816491s" totalImagesPullingTime="4.542639241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:52.992275283 +0000 UTC m=+71.840808750" watchObservedRunningTime="2026-07-28 19:30:52.992816491 +0000 UTC m=+71.841349951"
Jul 28 19:30:53.010107 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:30:53.010064    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gkf5m" podStartSLOduration=67.489585934 podStartE2EDuration="1m12.010048364s" totalImagesPullingTime="4.52046243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:30:53.009685926 +0000 UTC m=+71.858219405" watchObservedRunningTime="2026-07-28 19:30:53.010048364 +0000 UTC m=+71.858581831"
Jul 28 19:31:05.010850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:05.010811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc" event={"ID":"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64","Type":"ContainerStarted","Data":"301cb8d92975ebea9eedbc59e1d724dd32939fea086be9a1be989f6888651be7"}
Jul 28 19:31:05.011340 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:05.011023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:31:05.012770 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:05.012747    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:31:05.027815 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:05.027758    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc" podStartSLOduration=1.78424195 podStartE2EDuration="18.027740374s" totalImagesPullingTime="16.243498424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:31:05.026539865 +0000 UTC m=+83.875073329" watchObservedRunningTime="2026-07-28 19:31:05.027740374 +0000 UTC m=+83.876273840"
Jul 28 19:31:19.848228 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:19.848173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:31:19.848700 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:31:19.848347    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:31:19.848700 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:31:19.848431    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:32:23.848413897 +0000 UTC m=+162.696947342 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:31:23.983378 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:23.983330    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gkf5m"
Jul 28 19:31:51.464086 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:31:51.464025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:31:51.464645 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:31:51.464186    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 19:31:51.464645 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:31:51.464271    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:53.464254631 +0000 UTC m=+252.312788080 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : secret "metrics-daemon-secret" not found
Jul 28 19:32:19.013423 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:32:19.013351    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vj7vk" podUID="88f015c2-1349-4491-803c-310e227415d1"
Jul 28 19:32:19.190153 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:32:19.190124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:32:20.719521 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:32:20.719470    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:32:23.899055 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:32:23.898999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:32:23.899490 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:32:23.899141    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:32:23.899490 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:32:23.899203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls podName:88f015c2-1349-4491-803c-310e227415d1 nodeName:}" failed. No retries permitted until 2026-07-28 19:34:25.899186962 +0000 UTC m=+284.747720407 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls") pod "dns-default-vj7vk" (UID: "88f015c2-1349-4491-803c-310e227415d1") : secret "dns-default-metrics-tls" not found
Jul 28 19:32:35.703900 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:32:35.703808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:33:05.012316 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:05.012222    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc" podUID="0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 28 19:33:05.300170 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:05.300084    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64" containerID="301cb8d92975ebea9eedbc59e1d724dd32939fea086be9a1be989f6888651be7" exitCode=1
Jul 28 19:33:05.300170 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:05.300142    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc" event={"ID":"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64","Type":"ContainerDied","Data":"301cb8d92975ebea9eedbc59e1d724dd32939fea086be9a1be989f6888651be7"}
Jul 28 19:33:05.300459 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:05.300445    2574 scope.go:117] "RemoveContainer" containerID="301cb8d92975ebea9eedbc59e1d724dd32939fea086be9a1be989f6888651be7"
Jul 28 19:33:06.304701 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:06.304665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc" event={"ID":"0ccf6ee3-a4b8-4297-a6bc-7f495a17ce64","Type":"ContainerStarted","Data":"a0046f3ffcb967806c1d61386a3cc4e7a487e1fd52ed1ed3b61a774047935a3d"}
Jul 28 19:33:06.305150 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:06.304966    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:33:06.305628 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:06.305613    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-754865ff7b-f2mfc"
Jul 28 19:33:39.846565 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.846530    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"]
Jul 28 19:33:39.848473 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.848454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:39.851129 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.851111    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kz869\""
Jul 28 19:33:39.851393 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.851358    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 19:33:39.851393 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.851385    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:33:39.852527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.852508    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 19:33:39.852886 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.852721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 19:33:39.854419 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.854399    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-684df9fdb5-78brx"]
Jul 28 19:33:39.856393 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.856375    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.860014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.859984    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 19:33:39.860747 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.860557    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 19:33:39.862389 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.862215    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qrcf\""
Jul 28 19:33:39.862660 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.862603    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"]
Jul 28 19:33:39.863487 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.863460    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 19:33:39.868804 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.868787    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 19:33:39.875701 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.875678    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684df9fdb5-78brx"]
Jul 28 19:33:39.911476 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f91f96b-2d93-48a7-86a4-051d697a025d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:39.911476 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911480    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-ca-trust-extracted\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rk4\" (UniqueName: \"kubernetes.io/projected/3f91f96b-2d93-48a7-86a4-051d697a025d-kube-api-access-r8rk4\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-image-registry-private-configuration\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lmgz\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-kube-api-access-7lmgz\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-trusted-ca\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-installation-pull-secrets\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f91f96b-2d93-48a7-86a4-051d697a025d-config\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:39.911688 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-bound-sa-token\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.911947 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.911702    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-certificates\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:39.942378 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.942330    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"]
Jul 28 19:33:39.945735 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.945718    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"
Jul 28 19:33:39.948652 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.948590    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 19:33:39.948652 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.948644    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-btfv4\""
Jul 28 19:33:39.948831 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.948666    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:33:39.950338 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.950317    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"]
Jul 28 19:33:39.952110 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.952078    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c6d8b4d89-5zl6n"]
Jul 28 19:33:39.952180 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.952153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:39.954061 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.954043    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:39.954312 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.954262    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"]
Jul 28 19:33:39.955525 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.955504    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 19:33:39.955664 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.955547    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 19:33:39.955834 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.955793    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 19:33:39.955993 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.955845    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:33:39.956153 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.956137    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-75m56\""
Jul 28 19:33:39.956775 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.956758    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwdxp\""
Jul 28 19:33:39.957030 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.957011    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 19:33:39.957132 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.957050    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 19:33:39.957279 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.957260    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 19:33:39.957414 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.957382    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 19:33:39.957486 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.957412    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 19:33:39.957540 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.957531    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 19:33:39.969425 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.969395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"]
Jul 28 19:33:39.970159 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:39.970138    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c6d8b4d89-5zl6n"]
Jul 28 19:33:40.012645 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngb64\" (UniqueName: \"kubernetes.io/projected/6b53eb30-7fb4-4c25-90d6-3936183fcea7-kube-api-access-ngb64\") pod \"volume-data-source-validator-549c6d54cf-589sh\" (UID: \"6b53eb30-7fb4-4c25-90d6-3936183fcea7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-certificates\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-stats-auth\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c5483f6-ef83-4ec3-9cb6-715138b48401-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx296\" (UniqueName: \"kubernetes.io/projected/8c5483f6-ef83-4ec3-9cb6-715138b48401-kube-api-access-mx296\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.012771    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-bound-sa-token\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.012784    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684df9fdb5-78brx: secret "image-registry-tls" not found
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f91f96b-2d93-48a7-86a4-051d697a025d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.012821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-default-certificate\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.012846    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls podName:ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:40.512826938 +0000 UTC m=+239.361360384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls") pod "image-registry-684df9fdb5-78brx" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0") : secret "image-registry-tls" not found
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012928    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-ca-trust-extracted\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.012970    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c5483f6-ef83-4ec3-9cb6-715138b48401-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rk4\" (UniqueName: \"kubernetes.io/projected/3f91f96b-2d93-48a7-86a4-051d697a025d-kube-api-access-r8rk4\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lmgz\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-kube-api-access-7lmgz\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-image-registry-private-configuration\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013208    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-trusted-ca\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-installation-pull-secrets\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013238    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.013719 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgwlj\" (UniqueName: \"kubernetes.io/projected/c72abebf-4474-49c9-930b-cafd40be40ca-kube-api-access-dgwlj\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.013719 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013271    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-ca-trust-extracted\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013719 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f91f96b-2d93-48a7-86a4-051d697a025d-config\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.013719 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-certificates\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.013916 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.013844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f91f96b-2d93-48a7-86a4-051d697a025d-config\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.014291 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.014267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-trusted-ca\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.015233 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.015213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f91f96b-2d93-48a7-86a4-051d697a025d-serving-cert\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.015559 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.015543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-installation-pull-secrets\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.015743 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.015724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-image-registry-private-configuration\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.021785 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.021768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lmgz\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-kube-api-access-7lmgz\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.022329 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.022307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-bound-sa-token\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.022750 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.022735    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rk4\" (UniqueName: \"kubernetes.io/projected/3f91f96b-2d93-48a7-86a4-051d697a025d-kube-api-access-r8rk4\") pod \"service-ca-operator-5d6c75f84f-dqv22\" (UID: \"3f91f96b-2d93-48a7-86a4-051d697a025d\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.114093 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.114093 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgwlj\" (UniqueName: \"kubernetes.io/projected/c72abebf-4474-49c9-930b-cafd40be40ca-kube-api-access-dgwlj\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.114093 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngb64\" (UniqueName: \"kubernetes.io/projected/6b53eb30-7fb4-4c25-90d6-3936183fcea7-kube-api-access-ngb64\") pod \"volume-data-source-validator-549c6d54cf-589sh\" (UID: \"6b53eb30-7fb4-4c25-90d6-3936183fcea7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"
Jul 28 19:33:40.114093 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-stats-auth\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c5483f6-ef83-4ec3-9cb6-715138b48401-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.114151    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx296\" (UniqueName: \"kubernetes.io/projected/8c5483f6-ef83-4ec3-9cb6-715138b48401-kube-api-access-mx296\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.114225    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:40.614205632 +0000 UTC m=+239.462739087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : secret "router-metrics-certs-default" not found
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-default-certificate\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114307    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c5483f6-ef83-4ec3-9cb6-715138b48401-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.114470 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.114863 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.114523    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:40.614508119 +0000 UTC m=+239.463041584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : configmap references non-existent config key: service-ca.crt
Jul 28 19:33:40.114863 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.114785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c5483f6-ef83-4ec3-9cb6-715138b48401-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.116520 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.116497    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c5483f6-ef83-4ec3-9cb6-715138b48401-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.116646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.116615    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-stats-auth\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.116758 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.116737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-default-certificate\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.124594 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.124565    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx296\" (UniqueName: \"kubernetes.io/projected/8c5483f6-ef83-4ec3-9cb6-715138b48401-kube-api-access-mx296\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt\" (UID: \"8c5483f6-ef83-4ec3-9cb6-715138b48401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.125702 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.125685    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgwlj\" (UniqueName: \"kubernetes.io/projected/c72abebf-4474-49c9-930b-cafd40be40ca-kube-api-access-dgwlj\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.126077 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.126060    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngb64\" (UniqueName: \"kubernetes.io/projected/6b53eb30-7fb4-4c25-90d6-3936183fcea7-kube-api-access-ngb64\") pod \"volume-data-source-validator-549c6d54cf-589sh\" (UID: \"6b53eb30-7fb4-4c25-90d6-3936183fcea7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"
Jul 28 19:33:40.157903 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.157872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"
Jul 28 19:33:40.255950 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.255919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"
Jul 28 19:33:40.264076 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.264030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"
Jul 28 19:33:40.280058 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.280037    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22"]
Jul 28 19:33:40.283132 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:33:40.283105    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f91f96b_2d93_48a7_86a4_051d697a025d.slice/crio-0bb1b59c859acbf6d512d263a0f403dda8b822cfdcf0143c4d4c9b1df28c507c WatchSource:0}: Error finding container 0bb1b59c859acbf6d512d263a0f403dda8b822cfdcf0143c4d4c9b1df28c507c: Status 404 returned error can't find the container with id 0bb1b59c859acbf6d512d263a0f403dda8b822cfdcf0143c4d4c9b1df28c507c
Jul 28 19:33:40.381440 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.381327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22" event={"ID":"3f91f96b-2d93-48a7-86a4-051d697a025d","Type":"ContainerStarted","Data":"0bb1b59c859acbf6d512d263a0f403dda8b822cfdcf0143c4d4c9b1df28c507c"}
Jul 28 19:33:40.381579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.381536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh"]
Jul 28 19:33:40.386409 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:33:40.386380    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b53eb30_7fb4_4c25_90d6_3936183fcea7.slice/crio-b4ab84930f8355203aaa1227b02cdd924cb09e2e1beaba0feb9aa451812b6f4f WatchSource:0}: Error finding container b4ab84930f8355203aaa1227b02cdd924cb09e2e1beaba0feb9aa451812b6f4f: Status 404 returned error can't find the container with id b4ab84930f8355203aaa1227b02cdd924cb09e2e1beaba0feb9aa451812b6f4f
Jul 28 19:33:40.399714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.399670    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt"]
Jul 28 19:33:40.401870 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:33:40.401850    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5483f6_ef83_4ec3_9cb6_715138b48401.slice/crio-5a6d9111fcd600f0c0772951cf11db6987ce1436096cc79d6417fcb5cfb7a0e1 WatchSource:0}: Error finding container 5a6d9111fcd600f0c0772951cf11db6987ce1436096cc79d6417fcb5cfb7a0e1: Status 404 returned error can't find the container with id 5a6d9111fcd600f0c0772951cf11db6987ce1436096cc79d6417fcb5cfb7a0e1
Jul 28 19:33:40.518416 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.518356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:40.518591 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.518507    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:33:40.518591 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.518526    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684df9fdb5-78brx: secret "image-registry-tls" not found
Jul 28 19:33:40.518591 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.518581    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls podName:ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:41.518564826 +0000 UTC m=+240.367098271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls") pod "image-registry-684df9fdb5-78brx" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0") : secret "image-registry-tls" not found
Jul 28 19:33:40.619236 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.619203    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.619422 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:40.619257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:40.619422 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.619382    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 19:33:40.619505 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.619386    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:41.619354653 +0000 UTC m=+240.467888098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : configmap references non-existent config key: service-ca.crt
Jul 28 19:33:40.619505 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:40.619451    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:41.619433427 +0000 UTC m=+240.467966874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : secret "router-metrics-certs-default" not found
Jul 28 19:33:41.385795 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:41.385746    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt" event={"ID":"8c5483f6-ef83-4ec3-9cb6-715138b48401","Type":"ContainerStarted","Data":"5a6d9111fcd600f0c0772951cf11db6987ce1436096cc79d6417fcb5cfb7a0e1"}
Jul 28 19:33:41.387049 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:41.387012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh" event={"ID":"6b53eb30-7fb4-4c25-90d6-3936183fcea7","Type":"ContainerStarted","Data":"b4ab84930f8355203aaa1227b02cdd924cb09e2e1beaba0feb9aa451812b6f4f"}
Jul 28 19:33:41.527042 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:41.526871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:41.527042 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:41.527037    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:33:41.527311 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:41.527058    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684df9fdb5-78brx: secret "image-registry-tls" not found
Jul 28 19:33:41.527311 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:41.527125    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls podName:ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:43.527101406 +0000 UTC m=+242.375634874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls") pod "image-registry-684df9fdb5-78brx" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0") : secret "image-registry-tls" not found
Jul 28 19:33:41.627615 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:41.627582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:41.627791 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:41.627683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:41.627791 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:41.627770    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:43.627747915 +0000 UTC m=+242.476281374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : configmap references non-existent config key: service-ca.crt
Jul 28 19:33:41.627791 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:41.627783    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 19:33:41.627964 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:41.627819    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:43.62780922 +0000 UTC m=+242.476342665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : secret "router-metrics-certs-default" not found
Jul 28 19:33:42.392129 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:42.392091    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh" event={"ID":"6b53eb30-7fb4-4c25-90d6-3936183fcea7","Type":"ContainerStarted","Data":"e89b3015cd62ef54137377689a2cd22b8738d17d3da24c21c84c315617374be2"}
Jul 28 19:33:42.407982 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:42.407921    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-589sh" podStartSLOduration=2.041936435 podStartE2EDuration="3.407898718s" totalImagesPullingTime="1.365962283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:33:42.407842298 +0000 UTC m=+241.256375779" watchObservedRunningTime="2026-07-28 19:33:42.407898718 +0000 UTC m=+241.256432187"
Jul 28 19:33:43.396682 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.396641    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22" event={"ID":"3f91f96b-2d93-48a7-86a4-051d697a025d","Type":"ContainerStarted","Data":"4ea1d05e9c33c8a57991da274f30125134b7a4dc4f96579af34352357d091247"}
Jul 28 19:33:43.398043 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.398013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt" event={"ID":"8c5483f6-ef83-4ec3-9cb6-715138b48401","Type":"ContainerStarted","Data":"13d7e4634a904ad944f3c76bdd05b81c67bd8d68c2e5d35c8bbf6bdbd51eecc7"}
Jul 28 19:33:43.411270 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.411219    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22" podStartSLOduration=1.751214707 podStartE2EDuration="4.411204657s" totalImagesPullingTime="2.65998995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:33:43.41101366 +0000 UTC m=+242.259547129" watchObservedRunningTime="2026-07-28 19:33:43.411204657 +0000 UTC m=+242.259738123"
Jul 28 19:33:43.429237 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.429184    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt" podStartSLOduration=1.886756149 podStartE2EDuration="4.429166342s" totalImagesPullingTime="2.542410193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:33:43.428532595 +0000 UTC m=+242.277066063" watchObservedRunningTime="2026-07-28 19:33:43.429166342 +0000 UTC m=+242.277699859"
Jul 28 19:33:43.499972 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.499940    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5qcxl"]
Jul 28 19:33:43.502187 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.502169    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.505512 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.505340    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 19:33:43.506067 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.505648    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 19:33:43.506067 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.505883    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 19:33:43.506067 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.505914    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 19:33:43.506526 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.506174    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9sbqm\""
Jul 28 19:33:43.518379 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.518339    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5qcxl"]
Jul 28 19:33:43.548343 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.548306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49x8s\" (UniqueName: \"kubernetes.io/projected/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-api-access-49x8s\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.548343 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.548345    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/388fb7cc-2204-448d-8b14-c61b7209c65d-data-volume\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.548624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.548424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:43.548624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.548467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.548624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.548539    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/388fb7cc-2204-448d-8b14-c61b7209c65d-crio-socket\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.548624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.548565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.548819 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.548628    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:33:43.548819 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.548652    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684df9fdb5-78brx: secret "image-registry-tls" not found
Jul 28 19:33:43.548819 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.548714    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls podName:ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.548694301 +0000 UTC m=+246.397227751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls") pod "image-registry-684df9fdb5-78brx" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0") : secret "image-registry-tls" not found
Jul 28 19:33:43.649705 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49x8s\" (UniqueName: \"kubernetes.io/projected/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-api-access-49x8s\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.649705 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/388fb7cc-2204-448d-8b14-c61b7209c65d-data-volume\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/388fb7cc-2204-448d-8b14-c61b7209c65d-crio-socket\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.649869    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.649940 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.649929    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.649946    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.649924619 +0000 UTC m=+246.498458076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : configmap references non-existent config key: service-ca.crt
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.649984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/388fb7cc-2204-448d-8b14-c61b7209c65d-crio-socket\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.650007    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:44.149988042 +0000 UTC m=+242.998521499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.650013    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/388fb7cc-2204-448d-8b14-c61b7209c65d-data-volume\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.650031    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.650034    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:44.150023678 +0000 UTC m=+242.998557123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:43.650284 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:43.650073    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.650063162 +0000 UTC m=+246.498596612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : secret "router-metrics-certs-default" not found
Jul 28 19:33:43.658670 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:43.658646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49x8s\" (UniqueName: \"kubernetes.io/projected/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-api-access-49x8s\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:44.154290 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:44.154234    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:44.154519 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:44.154389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:44.154519 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:44.154425    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:44.154519 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:44.154488    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:45.154474026 +0000 UTC m=+244.003007475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:44.154519 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:44.154504    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:44.154682 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:44.154571    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:45.154553088 +0000 UTC m=+244.003086566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:45.165757 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:45.165715    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:45.166235 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:45.165822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:45.166235 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:45.165867    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:45.166235 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:45.165898    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:45.166235 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:45.165938    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.165923443 +0000 UTC m=+246.014456888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:45.166235 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:45.165952    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:47.165945972 +0000 UTC m=+246.014479416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:45.271620 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:45.271592    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44t57_592865ab-8346-4df2-bb41-fd71b6ddb268/dns-node-resolver/0.log"
Jul 28 19:33:46.472121 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:46.472096    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9jcd_456fe185-63e2-497a-b3e0-61c0e23294a5/node-ca/0.log"
Jul 28 19:33:47.182828 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:47.182791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:47.183014 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.182961    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:47.183014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:47.182980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:47.183093 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.183035    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:51.183016486 +0000 UTC m=+250.031549948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:47.183093 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.183076    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:47.183161 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.183118    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:51.183107904 +0000 UTC m=+250.031641349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:47.273087 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:47.273061    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f97hk_f2bf292e-4ef1-4d23-88bb-235f1e5c5672/serve-healthcheck-canary/0.log"
Jul 28 19:33:47.585952 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:47.585851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:47.586331 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.586001    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:33:47.586331 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.586023    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684df9fdb5-78brx: secret "image-registry-tls" not found
Jul 28 19:33:47.586331 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.586076    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls podName:ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:33:55.586061053 +0000 UTC m=+254.434594497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls") pod "image-registry-684df9fdb5-78brx" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0") : secret "image-registry-tls" not found
Jul 28 19:33:47.686230 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:47.686186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:47.686457 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:47.686286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:47.686457 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.686345    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 19:33:47.686457 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.686439    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:55.68641956 +0000 UTC m=+254.534953024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : secret "router-metrics-certs-default" not found
Jul 28 19:33:47.686457 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:47.686460    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:33:55.686450887 +0000 UTC m=+254.534984331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : configmap references non-existent config key: service-ca.crt
Jul 28 19:33:51.216310 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:51.216269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:51.216782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:51.216354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:51.216782 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:51.216407    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:33:51.216782 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:51.216478    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:59.216459848 +0000 UTC m=+258.064993297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : configmap "kube-rbac-proxy" not found
Jul 28 19:33:51.216782 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:51.216505    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:51.216782 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:51.216566    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:33:59.216552929 +0000 UTC m=+258.065086374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:53.531788 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:53.531751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:33:53.532182 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:53.531901    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 19:33:53.532182 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:53.531963    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs podName:649d116e-0b54-474e-b93e-4b14c5ce56d0 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:55.531947806 +0000 UTC m=+374.380481255 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs") pod "network-metrics-daemon-p4kq2" (UID: "649d116e-0b54-474e-b93e-4b14c5ce56d0") : secret "metrics-daemon-secret" not found
Jul 28 19:33:55.649422 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.649381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:55.651847 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.651823    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"image-registry-684df9fdb5-78brx\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") " pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:55.750000 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.749969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:55.750177 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.750049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:55.750219 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:55.750188    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle podName:c72abebf-4474-49c9-930b-cafd40be40ca nodeName:}" failed. No retries permitted until 2026-07-28 19:34:11.750169319 +0000 UTC m=+270.598702787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle") pod "router-default-c6d8b4d89-5zl6n" (UID: "c72abebf-4474-49c9-930b-cafd40be40ca") : configmap references non-existent config key: service-ca.crt
Jul 28 19:33:55.752456 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.752427    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c72abebf-4474-49c9-930b-cafd40be40ca-metrics-certs\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:33:55.768346 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.768323    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qrcf\""
Jul 28 19:33:55.776640 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.776619    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:55.912657 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:55.912631    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684df9fdb5-78brx"]
Jul 28 19:33:55.914428 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:33:55.914404    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba59e62e_b72f_47d1_ae1d_08ce4ea71fe0.slice/crio-3a6564f8f5e9bec25e0c09ca7a241ab4e324c3cc597ba1aeaee5f85424cad474 WatchSource:0}: Error finding container 3a6564f8f5e9bec25e0c09ca7a241ab4e324c3cc597ba1aeaee5f85424cad474: Status 404 returned error can't find the container with id 3a6564f8f5e9bec25e0c09ca7a241ab4e324c3cc597ba1aeaee5f85424cad474
Jul 28 19:33:56.438171 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:56.438139    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" event={"ID":"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0","Type":"ContainerStarted","Data":"8f1eadf532d9b0aabebe24437d2c40cb2f512b90f5c1364b9551c4fd763b5a1b"}
Jul 28 19:33:56.438350 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:56.438187    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" event={"ID":"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0","Type":"ContainerStarted","Data":"3a6564f8f5e9bec25e0c09ca7a241ab4e324c3cc597ba1aeaee5f85424cad474"}
Jul 28 19:33:56.438350 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:56.438215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:33:56.458096 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:56.458054    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" podStartSLOduration=17.458037562 podStartE2EDuration="17.458037562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:33:56.457644005 +0000 UTC m=+255.306177472" watchObservedRunningTime="2026-07-28 19:33:56.458037562 +0000 UTC m=+255.306571028"
Jul 28 19:33:59.280087 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:59.280042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:59.280525 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:59.280111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:33:59.280525 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:59.280226    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:59.280525 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:33:59.280294    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls podName:388fb7cc-2204-448d-8b14-c61b7209c65d nodeName:}" failed. No retries permitted until 2026-07-28 19:34:15.280278583 +0000 UTC m=+274.128812028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5qcxl" (UID: "388fb7cc-2204-448d-8b14-c61b7209c65d") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:33:59.280636 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:33:59.280609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/388fb7cc-2204-448d-8b14-c61b7209c65d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:34:07.201612 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.201528    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-9p5vr"]
Jul 28 19:34:07.204094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.204071    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:07.207283 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.207263    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 19:34:07.207854 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.207836    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 19:34:07.208091 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.208076    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zvngp\""
Jul 28 19:34:07.208091 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.208083    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684df9fdb5-78brx"]
Jul 28 19:34:07.214552 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.214532    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9p5vr"]
Jul 28 19:34:07.349894 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.349855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5cfm\" (UniqueName: \"kubernetes.io/projected/9051c059-405f-4d7a-8fe8-ffda13c52653-kube-api-access-m5cfm\") pod \"downloads-7c97dc4555-9p5vr\" (UID: \"9051c059-405f-4d7a-8fe8-ffda13c52653\") " pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:07.450484 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.450436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5cfm\" (UniqueName: \"kubernetes.io/projected/9051c059-405f-4d7a-8fe8-ffda13c52653-kube-api-access-m5cfm\") pod \"downloads-7c97dc4555-9p5vr\" (UID: \"9051c059-405f-4d7a-8fe8-ffda13c52653\") " pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:07.460146 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.460072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5cfm\" (UniqueName: \"kubernetes.io/projected/9051c059-405f-4d7a-8fe8-ffda13c52653-kube-api-access-m5cfm\") pod \"downloads-7c97dc4555-9p5vr\" (UID: \"9051c059-405f-4d7a-8fe8-ffda13c52653\") " pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:07.514042 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.514008    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:07.640061 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:07.640028    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-9p5vr"]
Jul 28 19:34:07.644402 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:07.644375    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9051c059_405f_4d7a_8fe8_ffda13c52653.slice/crio-6dbd7f71fb8ee24dd8426a1763eaf6b8aa6e30d726145b8a4f52b21a78f46cd7 WatchSource:0}: Error finding container 6dbd7f71fb8ee24dd8426a1763eaf6b8aa6e30d726145b8a4f52b21a78f46cd7: Status 404 returned error can't find the container with id 6dbd7f71fb8ee24dd8426a1763eaf6b8aa6e30d726145b8a4f52b21a78f46cd7
Jul 28 19:34:08.475833 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:08.475760    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9p5vr" event={"ID":"9051c059-405f-4d7a-8fe8-ffda13c52653","Type":"ContainerStarted","Data":"6dbd7f71fb8ee24dd8426a1763eaf6b8aa6e30d726145b8a4f52b21a78f46cd7"}
Jul 28 19:34:11.790034 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:11.789991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:11.790727 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:11.790696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c72abebf-4474-49c9-930b-cafd40be40ca-service-ca-bundle\") pod \"router-default-c6d8b4d89-5zl6n\" (UID: \"c72abebf-4474-49c9-930b-cafd40be40ca\") " pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:12.071875 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:12.071796    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qwdxp\""
Jul 28 19:34:12.079236 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:12.079207    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:12.226695 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:12.226657    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c6d8b4d89-5zl6n"]
Jul 28 19:34:12.229560 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:12.229529    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72abebf_4474_49c9_930b_cafd40be40ca.slice/crio-fc01a9875341ed06700ba6bd580667867e36712d54e19e15bf5b5569566ac13d WatchSource:0}: Error finding container fc01a9875341ed06700ba6bd580667867e36712d54e19e15bf5b5569566ac13d: Status 404 returned error can't find the container with id fc01a9875341ed06700ba6bd580667867e36712d54e19e15bf5b5569566ac13d
Jul 28 19:34:12.492721 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:12.492685    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n" event={"ID":"c72abebf-4474-49c9-930b-cafd40be40ca","Type":"ContainerStarted","Data":"c3906c30a125ac17776a02fe974225b542a9b4b2cda8029c46674ba8241cfd38"}
Jul 28 19:34:12.492888 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:12.492735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n" event={"ID":"c72abebf-4474-49c9-930b-cafd40be40ca","Type":"ContainerStarted","Data":"fc01a9875341ed06700ba6bd580667867e36712d54e19e15bf5b5569566ac13d"}
Jul 28 19:34:12.511065 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:12.511005    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n" podStartSLOduration=33.510989392 podStartE2EDuration="33.510989392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:12.51038528 +0000 UTC m=+271.358918748" watchObservedRunningTime="2026-07-28 19:34:12.510989392 +0000 UTC m=+271.359522860"
Jul 28 19:34:13.080353 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:13.080310    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:13.083724 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:13.083692    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:13.496354 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:13.496326    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:13.497647 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:13.497623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c6d8b4d89-5zl6n"
Jul 28 19:34:14.639376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.639337    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"]
Jul 28 19:34:14.642814 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.642788    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:14.645593 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.645571    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 19:34:14.645593 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.645589    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cqjqj\""
Jul 28 19:34:14.651682 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.651659    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"]
Jul 28 19:34:14.715341 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.715298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34970343-959f-4540-8137-07c29f6c5b66-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-khcrn\" (UID: \"34970343-959f-4540-8137-07c29f6c5b66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:14.816072 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:14.816031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34970343-959f-4540-8137-07c29f6c5b66-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-khcrn\" (UID: \"34970343-959f-4540-8137-07c29f6c5b66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:14.816247 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:34:14.816199    2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 19:34:14.816319 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:34:14.816284    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34970343-959f-4540-8137-07c29f6c5b66-tls-certificates podName:34970343-959f-4540-8137-07c29f6c5b66 nodeName:}" failed. No retries permitted until 2026-07-28 19:34:15.316264958 +0000 UTC m=+274.164798431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/34970343-959f-4540-8137-07c29f6c5b66-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-khcrn" (UID: "34970343-959f-4540-8137-07c29f6c5b66") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 19:34:15.321730 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.321693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34970343-959f-4540-8137-07c29f6c5b66-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-khcrn\" (UID: \"34970343-959f-4540-8137-07c29f6c5b66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:15.321907 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.321749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:34:15.324540 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.324507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/388fb7cc-2204-448d-8b14-c61b7209c65d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5qcxl\" (UID: \"388fb7cc-2204-448d-8b14-c61b7209c65d\") " pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:34:15.324665 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.324597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34970343-959f-4540-8137-07c29f6c5b66-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-khcrn\" (UID: \"34970343-959f-4540-8137-07c29f6c5b66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:15.553897 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.553864    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:15.613048 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.613012    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5qcxl"
Jul 28 19:34:15.710523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.710499    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"]
Jul 28 19:34:15.712349 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:15.712315    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34970343_959f_4540_8137_07c29f6c5b66.slice/crio-d76b41703dc2d1a6c4477abbdf93c7d4f6fe48fa226163981d00c9d8633637da WatchSource:0}: Error finding container d76b41703dc2d1a6c4477abbdf93c7d4f6fe48fa226163981d00c9d8633637da: Status 404 returned error can't find the container with id d76b41703dc2d1a6c4477abbdf93c7d4f6fe48fa226163981d00c9d8633637da
Jul 28 19:34:15.767820 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:15.767740    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5qcxl"]
Jul 28 19:34:15.769776 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:15.769748    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388fb7cc_2204_448d_8b14_c61b7209c65d.slice/crio-7ab630fbf59d5ff7f98260e519b3e205a3273aa9154ba6decc430e5c4cac88c9 WatchSource:0}: Error finding container 7ab630fbf59d5ff7f98260e519b3e205a3273aa9154ba6decc430e5c4cac88c9: Status 404 returned error can't find the container with id 7ab630fbf59d5ff7f98260e519b3e205a3273aa9154ba6decc430e5c4cac88c9
Jul 28 19:34:16.512282 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:16.512186    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn" event={"ID":"34970343-959f-4540-8137-07c29f6c5b66","Type":"ContainerStarted","Data":"d76b41703dc2d1a6c4477abbdf93c7d4f6fe48fa226163981d00c9d8633637da"}
Jul 28 19:34:16.514469 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:16.514438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qcxl" event={"ID":"388fb7cc-2204-448d-8b14-c61b7209c65d","Type":"ContainerStarted","Data":"7ab630fbf59d5ff7f98260e519b3e205a3273aa9154ba6decc430e5c4cac88c9"}
Jul 28 19:34:17.215947 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.215913    2574 patch_prober.go:28] interesting pod/image-registry-684df9fdb5-78brx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 19:34:17.216347 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.215974    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 19:34:17.520683 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.520605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn" event={"ID":"34970343-959f-4540-8137-07c29f6c5b66","Type":"ContainerStarted","Data":"596fce0a1ff8acdbd126aa9200477d460959f6f28530b2b1ccacfe7b0aa8f780"}
Jul 28 19:34:17.521213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.521145    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:17.527760 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.527737    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn"
Jul 28 19:34:17.538619 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.538537    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-khcrn" podStartSLOduration=2.119686392 podStartE2EDuration="3.538515522s" totalImagesPullingTime="1.41882913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:17.537984965 +0000 UTC m=+276.386518427" watchObservedRunningTime="2026-07-28 19:34:17.538515522 +0000 UTC m=+276.387048987"
Jul 28 19:34:17.697585 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.697551    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hqllz"]
Jul 28 19:34:17.700985 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.700959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.703997 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.703818    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 19:34:17.703997 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.703853    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 19:34:17.704184 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.704140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 19:34:17.704184 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.704178    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 19:34:17.704289 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.704186    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 19:34:17.704289 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.704144    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-67fsc\""
Jul 28 19:34:17.709274 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.709216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hqllz"]
Jul 28 19:34:17.744110 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.744027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.744110 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.744102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.744387 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.744162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvf6l\" (UniqueName: \"kubernetes.io/projected/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-kube-api-access-gvf6l\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.744387 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.744229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.845434 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.845395    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.846011 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.845963    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.846148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.846031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvf6l\" (UniqueName: \"kubernetes.io/projected/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-kube-api-access-gvf6l\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.846148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.846106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.846258 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.846175    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.849176 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.849129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.849945 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.849905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:17.855281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:17.855255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvf6l\" (UniqueName: \"kubernetes.io/projected/7d748d3a-cc2f-4277-a9bc-f8551ec8f25b-kube-api-access-gvf6l\") pod \"prometheus-operator-84d69f794d-hqllz\" (UID: \"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:18.014892 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:18.014854    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz"
Jul 28 19:34:22.190694 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:34:22.190653    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vj7vk" podUID="88f015c2-1349-4491-803c-310e227415d1"
Jul 28 19:34:22.538735 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:22.538653    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:34:25.916005 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:25.915962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:34:25.918809 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:25.918785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88f015c2-1349-4491-803c-310e227415d1-metrics-tls\") pod \"dns-default-vj7vk\" (UID: \"88f015c2-1349-4491-803c-310e227415d1\") " pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:34:26.142686 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:26.142654    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwrtc\""
Jul 28 19:34:26.150100 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:26.150077    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:34:27.214989 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:27.214709    2574 patch_prober.go:28] interesting pod/image-registry-684df9fdb5-78brx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 19:34:27.214989 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:27.214777    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 19:34:27.303336 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:27.303296    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hqllz"]
Jul 28 19:34:27.516441 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:27.516350    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d748d3a_cc2f_4277_a9bc_f8551ec8f25b.slice/crio-be2004bc49c2c907268773d21186a9496b7cf641fc8d4b69d89218e0fb98ab63 WatchSource:0}: Error finding container be2004bc49c2c907268773d21186a9496b7cf641fc8d4b69d89218e0fb98ab63: Status 404 returned error can't find the container with id be2004bc49c2c907268773d21186a9496b7cf641fc8d4b69d89218e0fb98ab63
Jul 28 19:34:27.560964 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:27.560624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz" event={"ID":"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b","Type":"ContainerStarted","Data":"be2004bc49c2c907268773d21186a9496b7cf641fc8d4b69d89218e0fb98ab63"}
Jul 28 19:34:27.642710 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:27.642685    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj7vk"]
Jul 28 19:34:27.645121 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:27.645093    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f015c2_1349_4491_803c_310e227415d1.slice/crio-a48f15baad1432b7b38ca35bfe932eeb8215e57f1a1e93d655b401a8fb067ecb WatchSource:0}: Error finding container a48f15baad1432b7b38ca35bfe932eeb8215e57f1a1e93d655b401a8fb067ecb: Status 404 returned error can't find the container with id a48f15baad1432b7b38ca35bfe932eeb8215e57f1a1e93d655b401a8fb067ecb
Jul 28 19:34:28.589437 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:28.589226    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-9p5vr" event={"ID":"9051c059-405f-4d7a-8fe8-ffda13c52653","Type":"ContainerStarted","Data":"843e3134161c6a2e46ea8cfa09c60db5e202a563b11a832500b62aeb0a0eeafe"}
Jul 28 19:34:28.590003 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:28.589980    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:28.595585 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:28.595551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qcxl" event={"ID":"388fb7cc-2204-448d-8b14-c61b7209c65d","Type":"ContainerStarted","Data":"4d7b572b35457c4d67d73a83368fa455660fcfff5c81b45e6c95162f650843bc"}
Jul 28 19:34:28.598273 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:28.598242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj7vk" event={"ID":"88f015c2-1349-4491-803c-310e227415d1","Type":"ContainerStarted","Data":"a48f15baad1432b7b38ca35bfe932eeb8215e57f1a1e93d655b401a8fb067ecb"}
Jul 28 19:34:28.601873 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:28.601822    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-9p5vr"
Jul 28 19:34:28.611753 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:28.611603    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-9p5vr" podStartSLOduration=1.741539291 podStartE2EDuration="21.611582538s" totalImagesPullingTime="19.870043247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:28.611509028 +0000 UTC m=+287.460042497" watchObservedRunningTime="2026-07-28 19:34:28.611582538 +0000 UTC m=+287.460115988"
Jul 28 19:34:32.227793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:32.227741    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerName="registry" containerID="cri-o://8f1eadf532d9b0aabebe24437d2c40cb2f512b90f5c1364b9551c4fd763b5a1b" gracePeriod=30
Jul 28 19:34:32.619092 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:32.619052    2574 generic.go:356] "Generic (PLEG): container finished" podID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerID="8f1eadf532d9b0aabebe24437d2c40cb2f512b90f5c1364b9551c4fd763b5a1b" exitCode=0
Jul 28 19:34:32.619282 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:32.619141    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" event={"ID":"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0","Type":"ContainerDied","Data":"8f1eadf532d9b0aabebe24437d2c40cb2f512b90f5c1364b9551c4fd763b5a1b"}
Jul 28 19:34:33.330504 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.330465    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:34:33.385390 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-bound-sa-token\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.385390 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385329    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-installation-pull-secrets\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.385390 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385400    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-ca-trust-extracted\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.386314 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385437    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-certificates\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.386314 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-trusted-ca\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.386314 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385495    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.386314 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385520    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lmgz\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-kube-api-access-7lmgz\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.386314 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.385550    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-image-registry-private-configuration\") pod \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\" (UID: \"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0\") "
Jul 28 19:34:33.386314 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.386019    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:34:33.387299 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.387249    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:34:33.391902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.391866    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-kube-api-access-7lmgz" (OuterVolumeSpecName: "kube-api-access-7lmgz") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "kube-api-access-7lmgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:34:33.392487 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.392346    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:34:33.392487 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.392443    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:34:33.393107 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.393025    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:34:33.395899 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.394528    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:34:33.398187 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.398162    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" (UID: "ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:34:33.486054 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486032    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-installation-pull-secrets\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486054 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486057    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-ca-trust-extracted\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486054 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486072    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-certificates\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486256 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486086    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-trusted-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486256 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486098    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-registry-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486256 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486111    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lmgz\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-kube-api-access-7lmgz\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486256 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486123    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-image-registry-private-configuration\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.486256 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.486138    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0-bound-sa-token\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:34:33.625780 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.625717    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj7vk" event={"ID":"88f015c2-1349-4491-803c-310e227415d1","Type":"ContainerStarted","Data":"9dbec31fcb18720d3a34ab0df869b6b2d54ef05760e24ae93a620131b21d1f51"}
Jul 28 19:34:33.627414 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.627182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684df9fdb5-78brx" event={"ID":"ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0","Type":"ContainerDied","Data":"3a6564f8f5e9bec25e0c09ca7a241ab4e324c3cc597ba1aeaee5f85424cad474"}
Jul 28 19:34:33.627414 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.627216    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684df9fdb5-78brx"
Jul 28 19:34:33.627414 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.627249    2574 scope.go:117] "RemoveContainer" containerID="8f1eadf532d9b0aabebe24437d2c40cb2f512b90f5c1364b9551c4fd763b5a1b"
Jul 28 19:34:33.629716 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.629690    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz" event={"ID":"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b","Type":"ContainerStarted","Data":"4a9fa676812cc2a4da47264a3727964cfe2a7dbc825ff7a471b871515ef7439f"}
Jul 28 19:34:33.661836 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.661797    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684df9fdb5-78brx"]
Jul 28 19:34:33.668555 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.668519    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-684df9fdb5-78brx"]
Jul 28 19:34:33.710099 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:33.710065    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" path="/var/lib/kubelet/pods/ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0/volumes"
Jul 28 19:34:34.636069 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:34.636004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz" event={"ID":"7d748d3a-cc2f-4277-a9bc-f8551ec8f25b","Type":"ContainerStarted","Data":"966200ed0b7810eb7213dd93d8e9b142679f57e1975aab1dbc571092c7ef9ca5"}
Jul 28 19:34:34.638580 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:34.638479    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qcxl" event={"ID":"388fb7cc-2204-448d-8b14-c61b7209c65d","Type":"ContainerStarted","Data":"e87766fba55f5264892b4cfc5296e1f5ca070474046fc0540e04e61e53fd7dd6"}
Jul 28 19:34:34.641678 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:34.641649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj7vk" event={"ID":"88f015c2-1349-4491-803c-310e227415d1","Type":"ContainerStarted","Data":"a66b0cdc0dbe03d85a8dbe80dce4c225a5fe303ba4e1317edc435af38f59b10a"}
Jul 28 19:34:34.642180 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:34.642158    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:34:34.655288 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:34.655217    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-hqllz" podStartSLOduration=11.711720179 podStartE2EDuration="17.655197712s" totalImagesPullingTime="5.943477533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:34.654050707 +0000 UTC m=+293.502584175" watchObservedRunningTime="2026-07-28 19:34:34.655197712 +0000 UTC m=+293.503731179"
Jul 28 19:34:36.033670 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.033599    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vj7vk" podStartSLOduration=255.217639447 podStartE2EDuration="4m21.033572486s" totalImagesPullingTime="5.815933039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:34.67267985 +0000 UTC m=+293.521213319" watchObservedRunningTime="2026-07-28 19:34:36.033572486 +0000 UTC m=+294.882105963"
Jul 28 19:34:36.034254 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.034227    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"]
Jul 28 19:34:36.035403 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.034596    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerName="registry"
Jul 28 19:34:36.035403 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.034616    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerName="registry"
Jul 28 19:34:36.035403 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.034674    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba59e62e-b72f-47d1-ae1d-08ce4ea71fe0" containerName="registry"
Jul 28 19:34:36.052732 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.052664    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9r9ck"]
Jul 28 19:34:36.052888 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.052861    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.057401 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.055650    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 19:34:36.057401 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.055650    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x7sk5\""
Jul 28 19:34:36.057401 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.056247    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 19:34:36.075428 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.075399    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"]
Jul 28 19:34:36.075584 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.075478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.078560 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.078538    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ndd7t\""
Jul 28 19:34:36.078975 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.078898    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 19:34:36.079097 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.079079    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 19:34:36.079161 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.079137    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 19:34:36.108925 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.108892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.109174 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.108945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.109174 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.109006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.109174 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.109115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npxp\" (UniqueName: \"kubernetes.io/projected/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-kube-api-access-2npxp\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.210076 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-tls\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210076 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-textfile\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-sys\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210136    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-wtmp\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210190    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/817306a9-3479-43e2-8d48-7f01b7b75046-metrics-client-ca\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210311    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-accelerators-collector-config\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210728 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210338    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npxp\" (UniqueName: \"kubernetes.io/projected/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-kube-api-access-2npxp\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.210728 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-root\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.210728 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.210532    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nlt2\" (UniqueName: \"kubernetes.io/projected/817306a9-3479-43e2-8d48-7f01b7b75046-kube-api-access-6nlt2\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.211826 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.211797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.213502 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.213478    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.213663 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.213642    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.219464 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.219423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npxp\" (UniqueName: \"kubernetes.io/projected/b4c07fd1-8b0d-4bec-973a-f8c90979ee8b-kube-api-access-2npxp\") pod \"openshift-state-metrics-b8f49f5c6-lvjtk\" (UID: \"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.311981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-root\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.311981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nlt2\" (UniqueName: \"kubernetes.io/projected/817306a9-3479-43e2-8d48-7f01b7b75046-kube-api-access-6nlt2\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.311981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-tls\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.311981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-textfile\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.311981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-sys\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.311981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311969    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-root\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.312446 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.311988    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-wtmp\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.312446 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.312027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/817306a9-3479-43e2-8d48-7f01b7b75046-metrics-client-ca\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.312446 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.312068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.312446 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.312102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-accelerators-collector-config\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.312927 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.312750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-accelerators-collector-config\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.312927 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.312830    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-wtmp\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.313105 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.313086    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-textfile\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.313172 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.313144    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/817306a9-3479-43e2-8d48-7f01b7b75046-sys\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.313226 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.313197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/817306a9-3479-43e2-8d48-7f01b7b75046-metrics-client-ca\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.314889 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.314866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-tls\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.316564 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.316498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/817306a9-3479-43e2-8d48-7f01b7b75046-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.322068 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.321956    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nlt2\" (UniqueName: \"kubernetes.io/projected/817306a9-3479-43e2-8d48-7f01b7b75046-kube-api-access-6nlt2\") pod \"node-exporter-9r9ck\" (UID: \"817306a9-3479-43e2-8d48-7f01b7b75046\") " pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:36.365092 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.365055    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"
Jul 28 19:34:36.389294 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:36.389258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9r9ck"
Jul 28 19:34:37.106382 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.106341    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:34:37.229752 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.229716    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:34:37.229925 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.229851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.232646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.232614    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 19:34:37.232849 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.232787    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 19:34:37.232951 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.232871    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 19:34:37.232951 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.232882    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 19:34:37.233123 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.232966    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 19:34:37.233123 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.232966    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 19:34:37.233123 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.233019    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xchm5\""
Jul 28 19:34:37.233274 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.233176    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 19:34:37.233328 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.233277    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 19:34:37.239241 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.239217    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 19:34:37.322526 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322526 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322557    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqrz\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-kube-api-access-tjqrz\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.322793 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.323094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.323094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.323094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.323094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.322970    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.323094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.323006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424496 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424660 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424660 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424660 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424584    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424660 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424835    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.424874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqrz\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-kube-api-access-tjqrz\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.425119 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.425119 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424933    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.425119 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.424970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.425266 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.425231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.427839 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.427811    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.428013 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.427988    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.428142 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:34:37.428101    2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 19:34:37.428337 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:34:37.428202    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls podName:4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a nodeName:}" failed. No retries permitted until 2026-07-28 19:34:37.928181747 +0000 UTC m=+296.776715195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a") : secret "alertmanager-main-tls" not found
Jul 28 19:34:37.428857 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.428798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.428857 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.428839    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.429137 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.429090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.429455 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.429428    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.429546 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.429509    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.429641 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.429614    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.429739 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.429615    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.429880 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.429857    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.434180 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.434160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqrz\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-kube-api-access-tjqrz\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.916883 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:37.916758    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817306a9_3479_43e2_8d48_7f01b7b75046.slice/crio-4df243a645861cc9e681fce3a400e2407e7acea71a42e6dd7db9f149b530aabe WatchSource:0}: Error finding container 4df243a645861cc9e681fce3a400e2407e7acea71a42e6dd7db9f149b530aabe: Status 404 returned error can't find the container with id 4df243a645861cc9e681fce3a400e2407e7acea71a42e6dd7db9f149b530aabe
Jul 28 19:34:37.929773 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.929747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:37.931938 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:37.931914    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:38.033830 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.033806    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk"]
Jul 28 19:34:38.035787 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:38.035758    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c07fd1_8b0d_4bec_973a_f8c90979ee8b.slice/crio-00b155691f69aab60c6cfb2a4b8df692ec24817e67490ec3417b2a7386f7f653 WatchSource:0}: Error finding container 00b155691f69aab60c6cfb2a4b8df692ec24817e67490ec3417b2a7386f7f653: Status 404 returned error can't find the container with id 00b155691f69aab60c6cfb2a4b8df692ec24817e67490ec3417b2a7386f7f653
Jul 28 19:34:38.141680 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.141650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:34:38.425298 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.425197    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:34:38.428772 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:38.428726    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee15c88_c95b_4bb3_b0c5_5abc6903fc9a.slice/crio-430fa5cf9a61dc0fab71cafd2ee9a83909ac48d39cdae8814f94df71886f2f23 WatchSource:0}: Error finding container 430fa5cf9a61dc0fab71cafd2ee9a83909ac48d39cdae8814f94df71886f2f23: Status 404 returned error can't find the container with id 430fa5cf9a61dc0fab71cafd2ee9a83909ac48d39cdae8814f94df71886f2f23
Jul 28 19:34:38.663014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.662976    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk" event={"ID":"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b","Type":"ContainerStarted","Data":"5bd56266d896334975b7006f3a2004b1b45f167cde232aa6263ada69a83f97d6"}
Jul 28 19:34:38.663181 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.663040    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk" event={"ID":"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b","Type":"ContainerStarted","Data":"d5bb426b7d01c1b6f8a44d101824a1facf5bc20c492cf9e1d3e0b4b5a2ce78fa"}
Jul 28 19:34:38.663181 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.663059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk" event={"ID":"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b","Type":"ContainerStarted","Data":"00b155691f69aab60c6cfb2a4b8df692ec24817e67490ec3417b2a7386f7f653"}
Jul 28 19:34:38.664832 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.664804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5qcxl" event={"ID":"388fb7cc-2204-448d-8b14-c61b7209c65d","Type":"ContainerStarted","Data":"b7e55a72e7ed08f0c85d1f7a49974bbbef30855459d6b9a56374ccb7cdb72a6a"}
Jul 28 19:34:38.665966 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.665939    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"430fa5cf9a61dc0fab71cafd2ee9a83909ac48d39cdae8814f94df71886f2f23"}
Jul 28 19:34:38.667022 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.666999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9r9ck" event={"ID":"817306a9-3479-43e2-8d48-7f01b7b75046","Type":"ContainerStarted","Data":"4df243a645861cc9e681fce3a400e2407e7acea71a42e6dd7db9f149b530aabe"}
Jul 28 19:34:38.684322 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:38.684272    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5qcxl" podStartSLOduration=33.364653253 podStartE2EDuration="55.684255249s" totalImagesPullingTime="22.319601996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:33:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:38.683111648 +0000 UTC m=+297.531645117" watchObservedRunningTime="2026-07-28 19:34:38.684255249 +0000 UTC m=+297.532788717"
Jul 28 19:34:38.704530 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:34:38.704495    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p4kq2" podUID="649d116e-0b54-474e-b93e-4b14c5ce56d0"
Jul 28 19:34:39.032722 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.032639    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"]
Jul 28 19:34:39.056788 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.056753    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"]
Jul 28 19:34:39.056961 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.056878    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.059822 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.059776    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f5gbl\""
Jul 28 19:34:39.059965 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.059776    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9j6n2halbfb3a\""
Jul 28 19:34:39.059965 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.059919    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 19:34:39.059965 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.059787    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 19:34:39.059965 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.059787    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 19:34:39.060130 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.059922    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 19:34:39.060223 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.060208    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 19:34:39.138488 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llm6h\" (UniqueName: \"kubernetes.io/projected/8f555990-8d07-4beb-bc72-a2a109597baa-kube-api-access-llm6h\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138655 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138514    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138655 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138655 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138582    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-tls\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138655 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138805 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f555990-8d07-4beb-bc72-a2a109597baa-metrics-client-ca\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138805 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-grpc-tls\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.138805 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.138754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.239782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llm6h\" (UniqueName: \"kubernetes.io/projected/8f555990-8d07-4beb-bc72-a2a109597baa-kube-api-access-llm6h\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239828    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-tls\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f555990-8d07-4beb-bc72-a2a109597baa-metrics-client-ca\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-grpc-tls\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240213 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.239965    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.240786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.240730    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f555990-8d07-4beb-bc72-a2a109597baa-metrics-client-ca\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.242412 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.242388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.242559 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.242536    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.242808 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.242790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.242866 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.242852    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-tls\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.242904 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.242864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-grpc-tls\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.242937 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.242916    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f555990-8d07-4beb-bc72-a2a109597baa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.248240 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.248219    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llm6h\" (UniqueName: \"kubernetes.io/projected/8f555990-8d07-4beb-bc72-a2a109597baa-kube-api-access-llm6h\") pod \"thanos-querier-5f9c7fff77-5c9hm\" (UID: \"8f555990-8d07-4beb-bc72-a2a109597baa\") " pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.367733 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.367622    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:39.545327 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.545261    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"]
Jul 28 19:34:39.566514 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:39.566481    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f555990_8d07_4beb_bc72_a2a109597baa.slice/crio-0f6641908d9c21d41ceff419b090a25626f0f86bb45fdc8cc82a133072f273ea WatchSource:0}: Error finding container 0f6641908d9c21d41ceff419b090a25626f0f86bb45fdc8cc82a133072f273ea: Status 404 returned error can't find the container with id 0f6641908d9c21d41ceff419b090a25626f0f86bb45fdc8cc82a133072f273ea
Jul 28 19:34:39.672913 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.672879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"0f6641908d9c21d41ceff419b090a25626f0f86bb45fdc8cc82a133072f273ea"}
Jul 28 19:34:39.674399 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.674356    2574 generic.go:356] "Generic (PLEG): container finished" podID="817306a9-3479-43e2-8d48-7f01b7b75046" containerID="3da654f05fce651924321f22b25886c819f287877acbd9ecbd4748f274746ff3" exitCode=0
Jul 28 19:34:39.674548 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:39.674437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9r9ck" event={"ID":"817306a9-3479-43e2-8d48-7f01b7b75046","Type":"ContainerDied","Data":"3da654f05fce651924321f22b25886c819f287877acbd9ecbd4748f274746ff3"}
Jul 28 19:34:40.450374 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.450324    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b99dfd848-h72n9"]
Jul 28 19:34:40.462290 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.462260    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.464806 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.464780    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b99dfd848-h72n9"]
Jul 28 19:34:40.465218 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.465197    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 19:34:40.465354 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.465197    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 19:34:40.466451 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.466425    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bor28jr8dq0o9\""
Jul 28 19:34:40.466560 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.466463    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 19:34:40.466560 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.466463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 19:34:40.466560 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.466530    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wl6cj\""
Jul 28 19:34:40.551022 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.550998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae617915-ecfd-4302-8f6f-8440913c8296-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.551158 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.551025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-client-ca-bundle\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.551158 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.551041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-secret-metrics-server-client-certs\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.551158 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.551142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae617915-ecfd-4302-8f6f-8440913c8296-audit-log\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.551272 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.551174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-secret-metrics-server-tls\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.551272 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.551223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae617915-ecfd-4302-8f6f-8440913c8296-metrics-server-audit-profiles\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.551272 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.551244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74v28\" (UniqueName: \"kubernetes.io/projected/ae617915-ecfd-4302-8f6f-8440913c8296-kube-api-access-74v28\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651788 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae617915-ecfd-4302-8f6f-8440913c8296-metrics-server-audit-profiles\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651788 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74v28\" (UniqueName: \"kubernetes.io/projected/ae617915-ecfd-4302-8f6f-8440913c8296-kube-api-access-74v28\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651992 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae617915-ecfd-4302-8f6f-8440913c8296-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651992 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651824    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-client-ca-bundle\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651992 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-secret-metrics-server-client-certs\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651992 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651932    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae617915-ecfd-4302-8f6f-8440913c8296-audit-log\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.651992 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.651968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-secret-metrics-server-tls\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.652666 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.652599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae617915-ecfd-4302-8f6f-8440913c8296-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.652794 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.652720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae617915-ecfd-4302-8f6f-8440913c8296-audit-log\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.652875 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.652810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae617915-ecfd-4302-8f6f-8440913c8296-metrics-server-audit-profiles\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.655496 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.655327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-secret-metrics-server-tls\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.655496 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.655345    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-client-ca-bundle\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.655727 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.655693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae617915-ecfd-4302-8f6f-8440913c8296-secret-metrics-server-client-certs\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.660969 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.660866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74v28\" (UniqueName: \"kubernetes.io/projected/ae617915-ecfd-4302-8f6f-8440913c8296-kube-api-access-74v28\") pod \"metrics-server-5b99dfd848-h72n9\" (UID: \"ae617915-ecfd-4302-8f6f-8440913c8296\") " pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.682641 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.682555    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk" event={"ID":"b4c07fd1-8b0d-4bec-973a-f8c90979ee8b","Type":"ContainerStarted","Data":"89ca675956a639f235b4dee0b6bfee416aa46ef5cef921350c7092242868d61c"}
Jul 28 19:34:40.684768 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.684739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8"}
Jul 28 19:34:40.686874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.686848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9r9ck" event={"ID":"817306a9-3479-43e2-8d48-7f01b7b75046","Type":"ContainerStarted","Data":"8441f8448d571e1a531c4a42e04ede40dcfccbf5a5af6cd3882f72f02e15d796"}
Jul 28 19:34:40.702668 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.702618    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-lvjtk" podStartSLOduration=2.578515429 podStartE2EDuration="4.702596314s" totalImagesPullingTime="2.124080885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:40.699858181 +0000 UTC m=+299.548391644" watchObservedRunningTime="2026-07-28 19:34:40.702596314 +0000 UTC m=+299.551129782"
Jul 28 19:34:40.774110 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.774005    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:34:40.943255 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:40.943222    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b99dfd848-h72n9"]
Jul 28 19:34:40.945817 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:34:40.945786    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae617915_ecfd_4302_8f6f_8440913c8296.slice/crio-55a505ecebbb6a12019bcfc06c8012dc91b710de043deb06f444739db65ff7e3 WatchSource:0}: Error finding container 55a505ecebbb6a12019bcfc06c8012dc91b710de043deb06f444739db65ff7e3: Status 404 returned error can't find the container with id 55a505ecebbb6a12019bcfc06c8012dc91b710de043deb06f444739db65ff7e3
Jul 28 19:34:41.566535 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:41.566509    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 19:34:41.693428 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:41.693387    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8" exitCode=0
Jul 28 19:34:41.693621 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:41.693514    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8"}
Jul 28 19:34:41.695756 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:41.695699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9" event={"ID":"ae617915-ecfd-4302-8f6f-8440913c8296","Type":"ContainerStarted","Data":"55a505ecebbb6a12019bcfc06c8012dc91b710de043deb06f444739db65ff7e3"}
Jul 28 19:34:41.698920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:41.698883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9r9ck" event={"ID":"817306a9-3479-43e2-8d48-7f01b7b75046","Type":"ContainerStarted","Data":"3fb4d02c4749de521a52944d1a8290f51c333f3050c4cfbe1c0f13f89089f1db"}
Jul 28 19:34:41.757440 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:41.757373    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9r9ck" podStartSLOduration=4.294386429 podStartE2EDuration="5.757342608s" totalImagesPullingTime="1.366212839s" totalInitContainerRuntime="96.74334ms" isStatefulPod=true podCreationTimestamp="2026-07-28 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:41.756476102 +0000 UTC m=+300.605009569" watchObservedRunningTime="2026-07-28 19:34:41.757342608 +0000 UTC m=+300.605876075"
Jul 28 19:34:43.572914 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:43.572887    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:34:43.709584 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:43.709495    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"626aaccccde032d1032d6b20ab87fec9518eab648d342ca8f106ca352c66b92d"}
Jul 28 19:34:43.709584 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:43.709558    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"c711c6753401cfd26506c07955676737e5da7fc616a24dca7fe01c35be552b69"}
Jul 28 19:34:43.709788 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:43.709597    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"f7c4e14f41852384f2da903387165b6970d12d1836adb121283e11eb35692f30"}
Jul 28 19:34:43.710968 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:43.710942    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9" event={"ID":"ae617915-ecfd-4302-8f6f-8440913c8296","Type":"ContainerStarted","Data":"4d8bc6216bdb42eff4ad5ad779d30a2d7c9f20c172c672244a178ff36b1432c9"}
Jul 28 19:34:43.731693 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:43.729965    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9" podStartSLOduration=1.472826848 podStartE2EDuration="3.729945517s" totalImagesPullingTime="2.257118669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:43.727992596 +0000 UTC m=+302.576526062" watchObservedRunningTime="2026-07-28 19:34:43.729945517 +0000 UTC m=+302.578478986"
Jul 28 19:34:45.656412 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.656382    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vj7vk"
Jul 28 19:34:45.723670 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.723637    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75"}
Jul 28 19:34:45.723758 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.723724    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb"}
Jul 28 19:34:45.723834 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.723766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b"}
Jul 28 19:34:45.723834 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.723807    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d"}
Jul 28 19:34:45.723918 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.723849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a"}
Jul 28 19:34:45.727411 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.727355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"e19f63de885d2ebaec90eab70f9cfaf00ea15dc24cbaeae1a9cef6fecd8435ba"}
Jul 28 19:34:45.727545 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:45.727452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"2f033b8540e993ec6069f5a3873da6899b426fb3ccb8fd45757ddacce44870d8"}
Jul 28 19:34:46.737584 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:46.737552    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerStarted","Data":"a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a"}
Jul 28 19:34:46.740550 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:46.740519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" event={"ID":"8f555990-8d07-4beb-bc72-a2a109597baa","Type":"ContainerStarted","Data":"e61cbd17294ef6978157d07d385dffce3db40724ad980c3bd9e0b5cb08292308"}
Jul 28 19:34:46.740687 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:46.740649    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:46.764830 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:46.764732    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.725781099 podStartE2EDuration="9.764715321s" totalImagesPullingTime="5.019510512s" totalInitContainerRuntime="19.42371ms" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:46.762965799 +0000 UTC m=+305.611499267" watchObservedRunningTime="2026-07-28 19:34:46.764715321 +0000 UTC m=+305.613248787"
Jul 28 19:34:46.787533 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:46.787488    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm" podStartSLOduration=2.293607521 podStartE2EDuration="7.787466085s" totalImagesPullingTime="5.493858564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:34:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:34:46.78590004 +0000 UTC m=+305.634433499" watchObservedRunningTime="2026-07-28 19:34:46.787466085 +0000 UTC m=+305.635999555"
Jul 28 19:34:52.750174 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:52.750145    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f9c7fff77-5c9hm"
Jul 28 19:34:53.703601 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:53.703571    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:34:53.767061 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:53.767023    2574 generic.go:356] "Generic (PLEG): container finished" podID="3f91f96b-2d93-48a7-86a4-051d697a025d" containerID="4ea1d05e9c33c8a57991da274f30125134b7a4dc4f96579af34352357d091247" exitCode=0
Jul 28 19:34:53.767404 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:53.767101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22" event={"ID":"3f91f96b-2d93-48a7-86a4-051d697a025d","Type":"ContainerDied","Data":"4ea1d05e9c33c8a57991da274f30125134b7a4dc4f96579af34352357d091247"}
Jul 28 19:34:53.767492 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:53.767480    2574 scope.go:117] "RemoveContainer" containerID="4ea1d05e9c33c8a57991da274f30125134b7a4dc4f96579af34352357d091247"
Jul 28 19:34:54.772709 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:54.772669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dqv22" event={"ID":"3f91f96b-2d93-48a7-86a4-051d697a025d","Type":"ContainerStarted","Data":"7bef08cd8f78f3f0af5a7e865eabcb1ff2ffab5ce26cb9b09f604b622accdecb"}
Jul 28 19:34:55.594903 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:55.594872    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7vk_88f015c2-1349-4491-803c-310e227415d1/dns/0.log"
Jul 28 19:34:55.794529 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:55.794496    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7vk_88f015c2-1349-4491-803c-310e227415d1/kube-rbac-proxy/0.log"
Jul 28 19:34:55.994443 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:55.994419    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44t57_592865ab-8346-4df2-bb41-fd71b6ddb268/dns-node-resolver/0.log"
Jul 28 19:34:56.595191 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:56.595157    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6d8b4d89-5zl6n_c72abebf-4474-49c9-930b-cafd40be40ca/router/0.log"
Jul 28 19:34:56.994070 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:34:56.994002    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f97hk_f2bf292e-4ef1-4d23-88bb-235f1e5c5672/serve-healthcheck-canary/0.log"
Jul 28 19:35:00.774772 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:00.774736    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:35:00.775168 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:00.774799    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:35:13.852390 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:13.852341    2574 generic.go:356] "Generic (PLEG): container finished" podID="8c5483f6-ef83-4ec3-9cb6-715138b48401" containerID="13d7e4634a904ad944f3c76bdd05b81c67bd8d68c2e5d35c8bbf6bdbd51eecc7" exitCode=0
Jul 28 19:35:13.852802 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:13.852412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt" event={"ID":"8c5483f6-ef83-4ec3-9cb6-715138b48401","Type":"ContainerDied","Data":"13d7e4634a904ad944f3c76bdd05b81c67bd8d68c2e5d35c8bbf6bdbd51eecc7"}
Jul 28 19:35:13.852802 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:13.852738    2574 scope.go:117] "RemoveContainer" containerID="13d7e4634a904ad944f3c76bdd05b81c67bd8d68c2e5d35c8bbf6bdbd51eecc7"
Jul 28 19:35:14.858689 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:14.858650    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-zx7kt" event={"ID":"8c5483f6-ef83-4ec3-9cb6-715138b48401","Type":"ContainerStarted","Data":"74971ed9364de3d3172bad20f3171ac809c73f547e8d1bf3144816ea8cab2ada"}
Jul 28 19:35:20.780051 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:20.780023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:35:20.783896 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:20.783875    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b99dfd848-h72n9"
Jul 28 19:35:55.614771 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:55.614732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:35:55.617092 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:55.617063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649d116e-0b54-474e-b93e-4b14c5ce56d0-metrics-certs\") pod \"network-metrics-daemon-p4kq2\" (UID: \"649d116e-0b54-474e-b93e-4b14c5ce56d0\") " pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:35:55.807417 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:55.807384    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zz5d7\""
Jul 28 19:35:55.815664 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:55.815640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p4kq2"
Jul 28 19:35:55.942714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:55.942687    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p4kq2"]
Jul 28 19:35:55.945062 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:35:55.945033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649d116e_0b54_474e_b93e_4b14c5ce56d0.slice/crio-ac7d7cec71b6ddc49b99593f8cfa41aaca364725f279ff2c6bf6bef2dbe619aa WatchSource:0}: Error finding container ac7d7cec71b6ddc49b99593f8cfa41aaca364725f279ff2c6bf6bef2dbe619aa: Status 404 returned error can't find the container with id ac7d7cec71b6ddc49b99593f8cfa41aaca364725f279ff2c6bf6bef2dbe619aa
Jul 28 19:35:56.017284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.017247    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4kq2" event={"ID":"649d116e-0b54-474e-b93e-4b14c5ce56d0","Type":"ContainerStarted","Data":"ac7d7cec71b6ddc49b99593f8cfa41aaca364725f279ff2c6bf6bef2dbe619aa"}
Jul 28 19:35:56.429454 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429417    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:35:56.429738 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429700    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="alertmanager" containerID="cri-o://2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a" gracePeriod=120
Jul 28 19:35:56.429803 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429757    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-metric" containerID="cri-o://b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75" gracePeriod=120
Jul 28 19:35:56.429865 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429804    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-web" containerID="cri-o://9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b" gracePeriod=120
Jul 28 19:35:56.429865 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429792    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="prom-label-proxy" containerID="cri-o://a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a" gracePeriod=120
Jul 28 19:35:56.429865 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429840    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="config-reloader" containerID="cri-o://106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d" gracePeriod=120
Jul 28 19:35:56.430009 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:56.429841    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy" containerID="cri-o://046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb" gracePeriod=120
Jul 28 19:35:57.025423 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025396    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a" exitCode=0
Jul 28 19:35:57.025423 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025421    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75" exitCode=0
Jul 28 19:35:57.025423 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025426    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb" exitCode=0
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025437    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d" exitCode=0
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025445    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a" exitCode=0
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a"}
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75"}
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025550    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb"}
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025576    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d"}
Jul 28 19:35:57.025902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.025608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a"}
Jul 28 19:35:57.685328 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.685305    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:57.734679 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-out\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.734850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734685    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.734850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734708    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-cluster-tls-config\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.734850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734753    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.734850 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjqrz\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-kube-api-access-tjqrz\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.735064 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734856    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-trusted-ca-bundle\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.735064 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734913    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.735064 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734942    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-main-db\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.735064 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.734994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-tls-assets\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.735259 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.735082    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-web-config\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.735259 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.735118    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.736192 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.735964    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:35:57.736192 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.736176    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:35:57.736413 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.736399    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-metrics-client-ca\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.736479 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.736446    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-volume\") pod \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\" (UID: \"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a\") "
Jul 28 19:35:57.737018 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.736726    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.737018 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.736752    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-alertmanager-main-db\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.737469 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.737441    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:35:57.738205 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.738176    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.738449 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.738424    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.738559 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.738523    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-out" (OuterVolumeSpecName: "config-out") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:35:57.739031 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.739000    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.739350 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.739323    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.739771 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.739751    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-volume" (OuterVolumeSpecName: "config-volume") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.740078 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.740049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:35:57.740160 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.740109    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-kube-api-access-tjqrz" (OuterVolumeSpecName: "kube-api-access-tjqrz") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "kube-api-access-tjqrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:35:57.743302 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.743265    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.751494 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.751462    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-web-config" (OuterVolumeSpecName: "web-config") pod "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" (UID: "4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837074    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837104    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-tls-assets\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837113    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-web-config\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837122    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837130    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-metrics-client-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837139    2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-volume\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837146    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-config-out\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837154    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-main-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837162    2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-cluster-tls-config\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837588 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837170    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:57.837588 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:57.837178    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjqrz\" (UniqueName: \"kubernetes.io/projected/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a-kube-api-access-tjqrz\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:35:58.031308 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.031272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4kq2" event={"ID":"649d116e-0b54-474e-b93e-4b14c5ce56d0","Type":"ContainerStarted","Data":"f6dfb83228fff529a510759f9f2420e8bb09c4a0184948b3278e3b300ee627a0"}
Jul 28 19:35:58.031801 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.031347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p4kq2" event={"ID":"649d116e-0b54-474e-b93e-4b14c5ce56d0","Type":"ContainerStarted","Data":"8ec6133d3c27225adc3af297611c87535a864288835c2e68f13b3fe4ce14055b"}
Jul 28 19:35:58.034274 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.034246    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerID="9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b" exitCode=0
Jul 28 19:35:58.034356 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.034319    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.034435 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.034319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b"}
Jul 28 19:35:58.034435 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.034423    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a","Type":"ContainerDied","Data":"430fa5cf9a61dc0fab71cafd2ee9a83909ac48d39cdae8814f94df71886f2f23"}
Jul 28 19:35:58.034513 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.034460    2574 scope.go:117] "RemoveContainer" containerID="a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a"
Jul 28 19:35:58.042359 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.042342    2574 scope.go:117] "RemoveContainer" containerID="b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75"
Jul 28 19:35:58.047039 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.046998    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p4kq2" podStartSLOduration=376.044464676 podStartE2EDuration="6m17.046985509s" totalImagesPullingTime="1.002520833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:58.046207556 +0000 UTC m=+376.894741025" watchObservedRunningTime="2026-07-28 19:35:58.046985509 +0000 UTC m=+376.895519026"
Jul 28 19:35:58.050119 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.050105    2574 scope.go:117] "RemoveContainer" containerID="046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb"
Jul 28 19:35:58.056986 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.056969    2574 scope.go:117] "RemoveContainer" containerID="9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b"
Jul 28 19:35:58.063035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.063014    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:35:58.063979 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.063945    2574 scope.go:117] "RemoveContainer" containerID="106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d"
Jul 28 19:35:58.070279 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.070254    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:35:58.071648 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.071630    2574 scope.go:117] "RemoveContainer" containerID="2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a"
Jul 28 19:35:58.078831 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.078811    2574 scope.go:117] "RemoveContainer" containerID="0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8"
Jul 28 19:35:58.085926 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.085909    2574 scope.go:117] "RemoveContainer" containerID="a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a"
Jul 28 19:35:58.086209 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.086187    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a\": container with ID starting with a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a not found: ID does not exist" containerID="a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a"
Jul 28 19:35:58.086281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.086221    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a"} err="failed to get container status \"a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a\": rpc error: code = NotFound desc = could not find container \"a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a\": container with ID starting with a71ed645cf3fe102c40d7b8bb7d8fdf035f71fe2b78623cbaa3af6e58cb9c15a not found: ID does not exist"
Jul 28 19:35:58.086281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.086268    2574 scope.go:117] "RemoveContainer" containerID="b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75"
Jul 28 19:35:58.086552 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.086535    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75\": container with ID starting with b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75 not found: ID does not exist" containerID="b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75"
Jul 28 19:35:58.086593 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.086558    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75"} err="failed to get container status \"b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75\": rpc error: code = NotFound desc = could not find container \"b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75\": container with ID starting with b4f745df27e178dd695d4a4451ae5930880b24f213385355f0f19d0a3d126b75 not found: ID does not exist"
Jul 28 19:35:58.086593 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.086573    2574 scope.go:117] "RemoveContainer" containerID="046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb"
Jul 28 19:35:58.086789 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.086772    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb\": container with ID starting with 046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb not found: ID does not exist" containerID="046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb"
Jul 28 19:35:58.086824 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.086794    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb"} err="failed to get container status \"046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb\": rpc error: code = NotFound desc = could not find container \"046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb\": container with ID starting with 046e7a58b3483438a0f5de421c58f31e64d53a726c7b46e09057149d96a36edb not found: ID does not exist"
Jul 28 19:35:58.086824 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.086809    2574 scope.go:117] "RemoveContainer" containerID="9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b"
Jul 28 19:35:58.087002 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.086987    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b\": container with ID starting with 9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b not found: ID does not exist" containerID="9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b"
Jul 28 19:35:58.087067 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087009    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b"} err="failed to get container status \"9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b\": rpc error: code = NotFound desc = could not find container \"9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b\": container with ID starting with 9f7eb57f42812618dcb8dc41b7c4c3150ceff13388ac00368a76aa82388ff96b not found: ID does not exist"
Jul 28 19:35:58.087067 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087028    2574 scope.go:117] "RemoveContainer" containerID="106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d"
Jul 28 19:35:58.087315 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.087278    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d\": container with ID starting with 106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d not found: ID does not exist" containerID="106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d"
Jul 28 19:35:58.087315 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087298    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d"} err="failed to get container status \"106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d\": rpc error: code = NotFound desc = could not find container \"106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d\": container with ID starting with 106deffa4bbf8f590da83af651ee7316933457150955f9f0748280ebde21429d not found: ID does not exist"
Jul 28 19:35:58.087315 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087313    2574 scope.go:117] "RemoveContainer" containerID="2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a"
Jul 28 19:35:58.087577 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.087558    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a\": container with ID starting with 2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a not found: ID does not exist" containerID="2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a"
Jul 28 19:35:58.087620 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087582    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a"} err="failed to get container status \"2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a\": rpc error: code = NotFound desc = could not find container \"2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a\": container with ID starting with 2ecb7029351ce3345ceda56fe6c5ceccbf551a3ca7ba07942b4a1bb446466c8a not found: ID does not exist"
Jul 28 19:35:58.087620 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087595    2574 scope.go:117] "RemoveContainer" containerID="0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8"
Jul 28 19:35:58.087771 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:35:58.087756    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8\": container with ID starting with 0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8 not found: ID does not exist" containerID="0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8"
Jul 28 19:35:58.087812 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.087774    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8"} err="failed to get container status \"0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8\": rpc error: code = NotFound desc = could not find container \"0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8\": container with ID starting with 0b4b6929dc40cf7ac7378b87bb94f9a5e9555dc754de1ef0c5040e80b51a02c8 not found: ID does not exist"
Jul 28 19:35:58.092714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.092693    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:35:58.092975 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.092963    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-metric"
Jul 28 19:35:58.093014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.092976    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-metric"
Jul 28 19:35:58.093014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.092988    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="alertmanager"
Jul 28 19:35:58.093014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.092994    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="alertmanager"
Jul 28 19:35:58.093014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093000    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-web"
Jul 28 19:35:58.093014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093006    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-web"
Jul 28 19:35:58.093014 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093015    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="config-reloader"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093021    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="config-reloader"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093034    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="init-config-reloader"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093039    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="init-config-reloader"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093049    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="prom-label-proxy"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093054    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="prom-label-proxy"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093063    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093068    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093111    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-web"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093119    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="config-reloader"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093125    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="prom-label-proxy"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093130    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093136    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="kube-rbac-proxy-metric"
Jul 28 19:35:58.093188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.093142    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" containerName="alertmanager"
Jul 28 19:35:58.098045 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.098027    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.100653 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.100636    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 19:35:58.100744 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.100654    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xchm5\""
Jul 28 19:35:58.100954 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.100908    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 19:35:58.101050 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.101036    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 19:35:58.101164 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.101142    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 19:35:58.101440 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.101423    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 19:35:58.101529 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.101457    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 19:35:58.101529 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.101502    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 19:35:58.101616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.101502    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 19:35:58.106706 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.106689    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 19:35:58.118051 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.118027    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:35:58.239823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-config-out\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.239823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-web-config\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-config-volume\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.239987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7mbt\" (UniqueName: \"kubernetes.io/projected/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-kube-api-access-x7mbt\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.240027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.240052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.240073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.240093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.240145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.240284 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.240170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.340823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.340725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-config-out\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.340823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.340764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-web-config\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.340823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.340789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-config-volume\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.340823 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.340809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.340972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7mbt\" (UniqueName: \"kubernetes.io/projected/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-kube-api-access-x7mbt\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341058    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341497 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341149    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341497 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.341497 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.341251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.342945 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.342912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.343749 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.343723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.343838 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.343810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.343931 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.343909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.344048 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.344029    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-config-out\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.344132 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.344110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-config-volume\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.344214 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.344195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.344408 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.344386    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-web-config\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.344477 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.344463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.344537 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.344518    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.345532 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.345515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.345778 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.345760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.351248 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.351230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7mbt\" (UniqueName: \"kubernetes.io/projected/553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f-kube-api-access-x7mbt\") pod \"alertmanager-main-0\" (UID: \"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.408677 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.408642    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:35:58.542305 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:58.542281    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:35:58.544059 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:35:58.544036    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553ffaa1_c1f1_4d7c_b3c9_a7d3daf4fc2f.slice/crio-9e3ac7700b448655338f01ba25d1cafbdd16b1fb82c86e81dade047f813744dd WatchSource:0}: Error finding container 9e3ac7700b448655338f01ba25d1cafbdd16b1fb82c86e81dade047f813744dd: Status 404 returned error can't find the container with id 9e3ac7700b448655338f01ba25d1cafbdd16b1fb82c86e81dade047f813744dd
Jul 28 19:35:59.040172 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:59.040133    2574 generic.go:356] "Generic (PLEG): container finished" podID="553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f" containerID="2d8f7c98cb8a3fb90795567f1c7ca63843ce3978362443a499bcf1d9b0c66e08" exitCode=0
Jul 28 19:35:59.040643 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:59.040217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerDied","Data":"2d8f7c98cb8a3fb90795567f1c7ca63843ce3978362443a499bcf1d9b0c66e08"}
Jul 28 19:35:59.040643 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:59.040286    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"9e3ac7700b448655338f01ba25d1cafbdd16b1fb82c86e81dade047f813744dd"}
Jul 28 19:35:59.708730 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:35:59.708695    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a" path="/var/lib/kubelet/pods/4ee15c88-c95b-4bb3-b0c5-5abc6903fc9a/volumes"
Jul 28 19:36:00.049214 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.049129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"081e24904471c0958f113c5781f10cedf6aa7da5f3fd56e6bdafd99e993945a4"}
Jul 28 19:36:00.049214 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.049192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"bd3391a6983bb79785e4eb52c9793ca6c1b0e384c9a0fdf52481e00447e643e9"}
Jul 28 19:36:00.049617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.049218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"9dda13a2b05981ee0bdf059e1df25e429be3f48af574a746c9d7b2188cf49a97"}
Jul 28 19:36:00.049617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.049244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"4dcbdda29faa2484ebc112a8c7f85cadd8f404385b972f1cc3b7860891997944"}
Jul 28 19:36:00.049617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.049272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"62f1619644d58d62823a64fa9b3bb96483379165df73030091bd8932a1e3576d"}
Jul 28 19:36:00.049617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.049298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f","Type":"ContainerStarted","Data":"a1651830659b8be2b83b0288aed16128612bb155182bd6658c476b3d5a9e3c38"}
Jul 28 19:36:00.077199 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:36:00.077146    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.058867881 podStartE2EDuration="2.077129437s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.261556ms" isStatefulPod=false podCreationTimestamp="2026-07-28 19:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:00.075116134 +0000 UTC m=+378.923649601" watchObservedRunningTime="2026-07-28 19:36:00.077129437 +0000 UTC m=+378.925662915"
Jul 28 19:37:39.161974 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.161940    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7kkdf"]
Jul 28 19:37:39.164119 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.164103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.166936 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.166910    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 19:37:39.168137 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.168116    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 19:37:39.168270 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.168149    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mvv9q\""
Jul 28 19:37:39.173821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.173800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7kkdf"]
Jul 28 19:37:39.274280 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.274243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt966\" (UniqueName: \"kubernetes.io/projected/8e42c111-f533-4e98-b8dc-4fc9353492dc-kube-api-access-xt966\") pod \"cert-manager-webhook-6486ffd997-7kkdf\" (UID: \"8e42c111-f533-4e98-b8dc-4fc9353492dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.274483 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.274322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e42c111-f533-4e98-b8dc-4fc9353492dc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7kkdf\" (UID: \"8e42c111-f533-4e98-b8dc-4fc9353492dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.375433 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.375401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e42c111-f533-4e98-b8dc-4fc9353492dc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7kkdf\" (UID: \"8e42c111-f533-4e98-b8dc-4fc9353492dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.375623 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.375463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt966\" (UniqueName: \"kubernetes.io/projected/8e42c111-f533-4e98-b8dc-4fc9353492dc-kube-api-access-xt966\") pod \"cert-manager-webhook-6486ffd997-7kkdf\" (UID: \"8e42c111-f533-4e98-b8dc-4fc9353492dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.383925 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.383898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e42c111-f533-4e98-b8dc-4fc9353492dc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7kkdf\" (UID: \"8e42c111-f533-4e98-b8dc-4fc9353492dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.384170 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.383935    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt966\" (UniqueName: \"kubernetes.io/projected/8e42c111-f533-4e98-b8dc-4fc9353492dc-kube-api-access-xt966\") pod \"cert-manager-webhook-6486ffd997-7kkdf\" (UID: \"8e42c111-f533-4e98-b8dc-4fc9353492dc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.485580 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.485485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:39.613425 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:39.613317    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7kkdf"]
Jul 28 19:37:39.615740 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:37:39.615710    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e42c111_f533_4e98_b8dc_4fc9353492dc.slice/crio-90248ca9f56c3fab12634c7a22ef14e9de305c8c404dc6b6b5b5c83ece8e0fd8 WatchSource:0}: Error finding container 90248ca9f56c3fab12634c7a22ef14e9de305c8c404dc6b6b5b5c83ece8e0fd8: Status 404 returned error can't find the container with id 90248ca9f56c3fab12634c7a22ef14e9de305c8c404dc6b6b5b5c83ece8e0fd8
Jul 28 19:37:40.428866 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:40.428828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf" event={"ID":"8e42c111-f533-4e98-b8dc-4fc9353492dc","Type":"ContainerStarted","Data":"90248ca9f56c3fab12634c7a22ef14e9de305c8c404dc6b6b5b5c83ece8e0fd8"}
Jul 28 19:37:43.444824 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:43.444787    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf" event={"ID":"8e42c111-f533-4e98-b8dc-4fc9353492dc","Type":"ContainerStarted","Data":"1392dc01e42a0b389c62f9dd2983860ef73b855d4cbc2ba046fdb38fca1a4194"}
Jul 28 19:37:43.445232 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:43.444855    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:43.461769 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:43.461719    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf" podStartSLOduration=1.098066918 podStartE2EDuration="4.461701012s" totalImagesPullingTime="3.363634094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:37:43.460054598 +0000 UTC m=+482.308588066" watchObservedRunningTime="2026-07-28 19:37:43.461701012 +0000 UTC m=+482.310234478"
Jul 28 19:37:49.451607 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:49.451566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7kkdf"
Jul 28 19:37:57.276454 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.276397    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2bl8k"]
Jul 28 19:37:57.279775 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.279759    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.282356 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.282338    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9gdb4\""
Jul 28 19:37:57.288234 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.288207    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2bl8k"]
Jul 28 19:37:57.333333 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.333298    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a227136-0a88-4d22-a8be-5c58a1792c93-bound-sa-token\") pod \"cert-manager-55b4d954d5-2bl8k\" (UID: \"6a227136-0a88-4d22-a8be-5c58a1792c93\") " pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.333526 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.333342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8lph\" (UniqueName: \"kubernetes.io/projected/6a227136-0a88-4d22-a8be-5c58a1792c93-kube-api-access-j8lph\") pod \"cert-manager-55b4d954d5-2bl8k\" (UID: \"6a227136-0a88-4d22-a8be-5c58a1792c93\") " pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.434343 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.434305    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8lph\" (UniqueName: \"kubernetes.io/projected/6a227136-0a88-4d22-a8be-5c58a1792c93-kube-api-access-j8lph\") pod \"cert-manager-55b4d954d5-2bl8k\" (UID: \"6a227136-0a88-4d22-a8be-5c58a1792c93\") " pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.434528 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.434408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a227136-0a88-4d22-a8be-5c58a1792c93-bound-sa-token\") pod \"cert-manager-55b4d954d5-2bl8k\" (UID: \"6a227136-0a88-4d22-a8be-5c58a1792c93\") " pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.442674 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.442639    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a227136-0a88-4d22-a8be-5c58a1792c93-bound-sa-token\") pod \"cert-manager-55b4d954d5-2bl8k\" (UID: \"6a227136-0a88-4d22-a8be-5c58a1792c93\") " pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.442799 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.442737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8lph\" (UniqueName: \"kubernetes.io/projected/6a227136-0a88-4d22-a8be-5c58a1792c93-kube-api-access-j8lph\") pod \"cert-manager-55b4d954d5-2bl8k\" (UID: \"6a227136-0a88-4d22-a8be-5c58a1792c93\") " pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.588618 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.588524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2bl8k"
Jul 28 19:37:57.717258 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:57.717239    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2bl8k"]
Jul 28 19:37:57.719336 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:37:57.719310    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a227136_0a88_4d22_a8be_5c58a1792c93.slice/crio-fc49cd23f4f3b5702ce14a3b69d4d58dba9f9997fdfd850232504bbb5891f5f7 WatchSource:0}: Error finding container fc49cd23f4f3b5702ce14a3b69d4d58dba9f9997fdfd850232504bbb5891f5f7: Status 404 returned error can't find the container with id fc49cd23f4f3b5702ce14a3b69d4d58dba9f9997fdfd850232504bbb5891f5f7
Jul 28 19:37:58.505157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:58.505124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2bl8k" event={"ID":"6a227136-0a88-4d22-a8be-5c58a1792c93","Type":"ContainerStarted","Data":"f8dae0e38f7aa8b2e323f2c3b38e9308ccd704a20c71e6733f62ba345cfc29b0"}
Jul 28 19:37:58.505157 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:58.505164    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2bl8k" event={"ID":"6a227136-0a88-4d22-a8be-5c58a1792c93","Type":"ContainerStarted","Data":"fc49cd23f4f3b5702ce14a3b69d4d58dba9f9997fdfd850232504bbb5891f5f7"}
Jul 28 19:37:58.526931 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:37:58.526880    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2bl8k" podStartSLOduration=1.5268631030000002 podStartE2EDuration="1.526863103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:37:58.525188243 +0000 UTC m=+497.373721711" watchObservedRunningTime="2026-07-28 19:37:58.526863103 +0000 UTC m=+497.375396569"
Jul 28 19:38:11.757645 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.757609    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"]
Jul 28 19:38:11.760874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.760851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.763721 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.763687    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 19:38:11.763864 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.763693    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 19:38:11.763864 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.763702    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 19:38:11.763864 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.763742    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 19:38:11.763864 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.763749    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gvzp5\""
Jul 28 19:38:11.783535 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.783512    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"]
Jul 28 19:38:11.858981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.858941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c776762-2e8c-45f3-bc3c-d726ae5e9947-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.859175 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.859081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8m98\" (UniqueName: \"kubernetes.io/projected/6c776762-2e8c-45f3-bc3c-d726ae5e9947-kube-api-access-h8m98\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.859175 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.859130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c776762-2e8c-45f3-bc3c-d726ae5e9947-tmp\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.859277 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.859241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c776762-2e8c-45f3-bc3c-d726ae5e9947-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.859438 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.859414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c776762-2e8c-45f3-bc3c-d726ae5e9947-manifests\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.961009 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.960972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c776762-2e8c-45f3-bc3c-d726ae5e9947-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.961198 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.961021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8m98\" (UniqueName: \"kubernetes.io/projected/6c776762-2e8c-45f3-bc3c-d726ae5e9947-kube-api-access-h8m98\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.961198 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.961152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c776762-2e8c-45f3-bc3c-d726ae5e9947-tmp\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.961319 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.961211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c776762-2e8c-45f3-bc3c-d726ae5e9947-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.961319 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.961233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c776762-2e8c-45f3-bc3c-d726ae5e9947-manifests\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.961606 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.961584    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c776762-2e8c-45f3-bc3c-d726ae5e9947-manifests\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.963401 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.963343    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c776762-2e8c-45f3-bc3c-d726ae5e9947-tmp\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.963521 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.963404    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c776762-2e8c-45f3-bc3c-d726ae5e9947-webhook-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.963521 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.963515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c776762-2e8c-45f3-bc3c-d726ae5e9947-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:11.972204 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:11.972185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8m98\" (UniqueName: \"kubernetes.io/projected/6c776762-2e8c-45f3-bc3c-d726ae5e9947-kube-api-access-h8m98\") pod \"opendatahub-operator-controller-manager-9ddd48bbd-jw2rh\" (UID: \"6c776762-2e8c-45f3-bc3c-d726ae5e9947\") " pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:12.071225 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:12.071135    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:12.214887 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:12.214710    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"]
Jul 28 19:38:12.217787 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:38:12.217764    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c776762_2e8c_45f3_bc3c_d726ae5e9947.slice/crio-239706373de046da983275bcf9216b7fb6289314bd1fb57301a6292bf3fc76cd WatchSource:0}: Error finding container 239706373de046da983275bcf9216b7fb6289314bd1fb57301a6292bf3fc76cd: Status 404 returned error can't find the container with id 239706373de046da983275bcf9216b7fb6289314bd1fb57301a6292bf3fc76cd
Jul 28 19:38:12.561580 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:12.561546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh" event={"ID":"6c776762-2e8c-45f3-bc3c-d726ae5e9947","Type":"ContainerStarted","Data":"239706373de046da983275bcf9216b7fb6289314bd1fb57301a6292bf3fc76cd"}
Jul 28 19:38:15.578646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:15.578559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh" event={"ID":"6c776762-2e8c-45f3-bc3c-d726ae5e9947","Type":"ContainerStarted","Data":"185d2fd35ca3bf5baf449b8327145c73ffdee56b407dbab357727b3c9d26d596"}
Jul 28 19:38:16.584352 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:16.584313    2574 generic.go:356] "Generic (PLEG): container finished" podID="6c776762-2e8c-45f3-bc3c-d726ae5e9947" containerID="185d2fd35ca3bf5baf449b8327145c73ffdee56b407dbab357727b3c9d26d596" exitCode=0
Jul 28 19:38:16.584765 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:16.584406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh" event={"ID":"6c776762-2e8c-45f3-bc3c-d726ae5e9947","Type":"ContainerDied","Data":"185d2fd35ca3bf5baf449b8327145c73ffdee56b407dbab357727b3c9d26d596"}
Jul 28 19:38:17.591031 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:17.590993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh" event={"ID":"6c776762-2e8c-45f3-bc3c-d726ae5e9947","Type":"ContainerStarted","Data":"a1e6e90f01c822797c1f0fd1fbf87b1610e92a6d76c8878d1857d30a22db272b"}
Jul 28 19:38:17.591538 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:17.591130    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:17.611989 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:17.611832    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh" podStartSLOduration=2.251207157 podStartE2EDuration="6.611812016s" totalImagesPullingTime="3.293978688s" totalInitContainerRuntime="1.066626171s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:17.611732189 +0000 UTC m=+516.460265656" watchObservedRunningTime="2026-07-28 19:38:17.611812016 +0000 UTC m=+516.460345483"
Jul 28 19:38:28.596649 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:28.596616    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9ddd48bbd-jw2rh"
Jul 28 19:38:31.448100 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.448063    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"]
Jul 28 19:38:31.456986 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.456961    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.466091 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.465673    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 19:38:31.466091 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.465939    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c8g9l\""
Jul 28 19:38:31.466308 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.466202    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 19:38:31.467441 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.467420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"]
Jul 28 19:38:31.523994 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.523958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tls-certs\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.524159 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.524030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whflh\" (UniqueName: \"kubernetes.io/projected/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-kube-api-access-whflh\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.524159 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.524094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tmp\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.625535 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.625500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tmp\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.625535 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.625548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tls-certs\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.625747 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.625631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whflh\" (UniqueName: \"kubernetes.io/projected/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-kube-api-access-whflh\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.625747 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:38:31.625731    2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 28 19:38:31.625820 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:38:31.625798    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tls-certs podName:f145f7cf-b614-4bff-9f57-627dd7d9f5cd nodeName:}" failed. No retries permitted until 2026-07-28 19:38:32.125779165 +0000 UTC m=+530.974312615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tls-certs") pod "kube-auth-proxy-ccfbc6b9-l9784" (UID: "f145f7cf-b614-4bff-9f57-627dd7d9f5cd") : secret "kube-auth-proxy-tls" not found
Jul 28 19:38:31.629855 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.629820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tmp\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:31.641756 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:31.641721    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whflh\" (UniqueName: \"kubernetes.io/projected/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-kube-api-access-whflh\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:32.130349 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.130311    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tls-certs\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:32.132936 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.132902    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f145f7cf-b614-4bff-9f57-627dd7d9f5cd-tls-certs\") pod \"kube-auth-proxy-ccfbc6b9-l9784\" (UID: \"f145f7cf-b614-4bff-9f57-627dd7d9f5cd\") " pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:32.367706 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.367670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"
Jul 28 19:38:32.511396 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.509724    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784"]
Jul 28 19:38:32.514941 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:38:32.514911    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf145f7cf_b614_4bff_9f57_627dd7d9f5cd.slice/crio-b37e1370a0300f9deeab49da1562325d1e4435ed7e76c2a3d3302abe55576a5f WatchSource:0}: Error finding container b37e1370a0300f9deeab49da1562325d1e4435ed7e76c2a3d3302abe55576a5f: Status 404 returned error can't find the container with id b37e1370a0300f9deeab49da1562325d1e4435ed7e76c2a3d3302abe55576a5f
Jul 28 19:38:32.659857 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.659765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784" event={"ID":"f145f7cf-b614-4bff-9f57-627dd7d9f5cd","Type":"ContainerStarted","Data":"b37e1370a0300f9deeab49da1562325d1e4435ed7e76c2a3d3302abe55576a5f"}
Jul 28 19:38:32.684539 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.684511    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"]
Jul 28 19:38:32.689254 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.689234    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.691808 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.691787    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 19:38:32.691920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.691887    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 19:38:32.691989 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.691937    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pkbvx\""
Jul 28 19:38:32.692164 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.692147    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 19:38:32.692373 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.692345    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 19:38:32.700841 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.700821    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"]
Jul 28 19:38:32.736471 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.736619 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6625182d-915f-4213-aef2-3d0b4a1bd763-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.736619 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736539    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.736619 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.736783 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6nbc\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-kube-api-access-h6nbc\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.736783 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.736783 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.736774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838184 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838184 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6625182d-915f-4213-aef2-3d0b4a1bd763-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6nbc\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-kube-api-access-h6nbc\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838323    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.838942 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.838911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.840707 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.840677    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6625182d-915f-4213-aef2-3d0b4a1bd763-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.840853 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.840833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.841107 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.841064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.841107 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.841072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.845846 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.845824    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6nbc\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-kube-api-access-h6nbc\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.845944 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.845922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9szpc\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:32.999033 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:32.998934    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:33.144149 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:33.144122    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"]
Jul 28 19:38:33.146322 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:38:33.146286    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6625182d_915f_4213_aef2_3d0b4a1bd763.slice/crio-cf6828ccf9b237638054a14fc899f587388ce6971668bac634c7c558e7a96149 WatchSource:0}: Error finding container cf6828ccf9b237638054a14fc899f587388ce6971668bac634c7c558e7a96149: Status 404 returned error can't find the container with id cf6828ccf9b237638054a14fc899f587388ce6971668bac634c7c558e7a96149
Jul 28 19:38:33.665719 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:33.665673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc" event={"ID":"6625182d-915f-4213-aef2-3d0b4a1bd763","Type":"ContainerStarted","Data":"cf6828ccf9b237638054a14fc899f587388ce6971668bac634c7c558e7a96149"}
Jul 28 19:38:36.400498 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:36.400460    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 19:38:36.400807 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:36.400528    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 19:38:36.686976 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:36.686882    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784" event={"ID":"f145f7cf-b614-4bff-9f57-627dd7d9f5cd","Type":"ContainerStarted","Data":"3443af818aff8f65296070e635b88396ec468a10a4083856cb8809ca2559e511"}
Jul 28 19:38:36.688524 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:36.688498    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc" event={"ID":"6625182d-915f-4213-aef2-3d0b4a1bd763","Type":"ContainerStarted","Data":"7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6"}
Jul 28 19:38:36.688656 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:36.688556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:36.705258 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:36.705188    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ccfbc6b9-l9784" podStartSLOduration=1.823588277 podStartE2EDuration="5.705168319s" totalImagesPullingTime="3.881580042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:36.70494045 +0000 UTC m=+535.553473917" watchObservedRunningTime="2026-07-28 19:38:36.705168319 +0000 UTC m=+535.553701786"
Jul 28 19:38:37.695059 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:37.695032    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:37.726172 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:37.726106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc" podStartSLOduration=2.474809381 podStartE2EDuration="5.726081898s" totalImagesPullingTime="3.251272517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:36.728397153 +0000 UTC m=+535.576930621" watchObservedRunningTime="2026-07-28 19:38:37.726081898 +0000 UTC m=+536.574615369"
Jul 28 19:38:42.357211 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.357166    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"]
Jul 28 19:38:42.362526 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.362501    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:42.365440 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.365408    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 19:38:42.365601 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.365515    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7vxjq\""
Jul 28 19:38:42.374537 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.374511    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"]
Jul 28 19:38:42.376064 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.376041    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"]
Jul 28 19:38:42.379759 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.379740    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.382473 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.382451    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 19:38:42.382600 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.382474    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8qzc4\""
Jul 28 19:38:42.402727 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.402690    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"]
Jul 28 19:38:42.432202 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.432170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zcbj9\" (UID: \"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.432202 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.432206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fx57\" (UniqueName: \"kubernetes.io/projected/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-kube-api-access-2fx57\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:42.432438 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.432240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qpxm\" (UniqueName: \"kubernetes.io/projected/bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9-kube-api-access-8qpxm\") pod \"llmisvc-controller-manager-777c6bd7d5-zcbj9\" (UID: \"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.432438 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.432305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-cert\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:42.532835 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.532797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zcbj9\" (UID: \"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.532835 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.532838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fx57\" (UniqueName: \"kubernetes.io/projected/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-kube-api-access-2fx57\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:42.533101 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.532870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qpxm\" (UniqueName: \"kubernetes.io/projected/bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9-kube-api-access-8qpxm\") pod \"llmisvc-controller-manager-777c6bd7d5-zcbj9\" (UID: \"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.533101 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.532909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-cert\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:42.533101 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:38:42.532999    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 28 19:38:42.533101 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:38:42.533064    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-cert podName:c3a3c566-00d0-4dcc-b8ed-f80571b2909c nodeName:}" failed. No retries permitted until 2026-07-28 19:38:43.03304418 +0000 UTC m=+541.881577626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-cert") pod "kserve-controller-manager-d6f4b65b8-f2vqq" (UID: "c3a3c566-00d0-4dcc-b8ed-f80571b2909c") : secret "kserve-webhook-server-cert" not found
Jul 28 19:38:42.535434 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.535405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zcbj9\" (UID: \"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.543927 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.543905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fx57\" (UniqueName: \"kubernetes.io/projected/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-kube-api-access-2fx57\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:42.548306 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.548282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qpxm\" (UniqueName: \"kubernetes.io/projected/bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9-kube-api-access-8qpxm\") pod \"llmisvc-controller-manager-777c6bd7d5-zcbj9\" (UID: \"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.691401 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.691277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:42.825242 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:42.825116    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"]
Jul 28 19:38:42.827861 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:38:42.827833    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb8d19a5_d4dc_43cc_a9a3_f2ebdef0abf9.slice/crio-9844d3ea2f019e852e4f86a735cabe3026c8b622a43f572feb7b49fb32bd640d WatchSource:0}: Error finding container 9844d3ea2f019e852e4f86a735cabe3026c8b622a43f572feb7b49fb32bd640d: Status 404 returned error can't find the container with id 9844d3ea2f019e852e4f86a735cabe3026c8b622a43f572feb7b49fb32bd640d
Jul 28 19:38:43.038479 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:43.038403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-cert\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:43.040735 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:43.040717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3a3c566-00d0-4dcc-b8ed-f80571b2909c-cert\") pod \"kserve-controller-manager-d6f4b65b8-f2vqq\" (UID: \"c3a3c566-00d0-4dcc-b8ed-f80571b2909c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:43.273657 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:43.273617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:43.407893 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:43.407854    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"]
Jul 28 19:38:43.410065 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:38:43.410031    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a3c566_00d0_4dcc_b8ed_f80571b2909c.slice/crio-a3105f2dcdc542b0d74df3baa4fa8796c88b4142c1afa67f369fd1e735fe3106 WatchSource:0}: Error finding container a3105f2dcdc542b0d74df3baa4fa8796c88b4142c1afa67f369fd1e735fe3106: Status 404 returned error can't find the container with id a3105f2dcdc542b0d74df3baa4fa8796c88b4142c1afa67f369fd1e735fe3106
Jul 28 19:38:43.725424 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:43.725386    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq" event={"ID":"c3a3c566-00d0-4dcc-b8ed-f80571b2909c","Type":"ContainerStarted","Data":"a3105f2dcdc542b0d74df3baa4fa8796c88b4142c1afa67f369fd1e735fe3106"}
Jul 28 19:38:43.726276 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:43.726257    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9" event={"ID":"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9","Type":"ContainerStarted","Data":"9844d3ea2f019e852e4f86a735cabe3026c8b622a43f572feb7b49fb32bd640d"}
Jul 28 19:38:45.499787 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:45.499744    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"]
Jul 28 19:38:45.500277 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:45.499981    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc" podUID="6625182d-915f-4213-aef2-3d0b4a1bd763" containerName="discovery" containerID="cri-o://7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6" gracePeriod=30
Jul 28 19:38:46.488879 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.488852    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:46.569040 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569011    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-ca-configmap\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569047    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-cacerts\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569071    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6nbc\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-kube-api-access-h6nbc\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569116    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-kubeconfig\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569168    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-dns-cert\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569196    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-token\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569221    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6625182d-915f-4213-aef2-3d0b4a1bd763-local-certs\") pod \"6625182d-915f-4213-aef2-3d0b4a1bd763\" (UID: \"6625182d-915f-4213-aef2-3d0b4a1bd763\") "
Jul 28 19:38:46.569741 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.569427    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:38:46.571472 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.571440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6625182d-915f-4213-aef2-3d0b4a1bd763-local-certs" (OuterVolumeSpecName: "local-certs") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:38:46.571472 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.571447    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-token" (OuterVolumeSpecName: "istio-token") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:38:46.571707 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.571672    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:38:46.571790 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.571714    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:38:46.571924 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.571907    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-cacerts" (OuterVolumeSpecName: "cacerts") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:38:46.571975 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.571905    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-kube-api-access-h6nbc" (OuterVolumeSpecName: "kube-api-access-h6nbc") pod "6625182d-915f-4213-aef2-3d0b4a1bd763" (UID: "6625182d-915f-4213-aef2-3d0b4a1bd763"). InnerVolumeSpecName "kube-api-access-h6nbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:38:46.669899 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669865    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-ca-configmap\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.669899 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669894    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-cacerts\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.669899 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669905    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6nbc\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-kube-api-access-h6nbc\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.670122 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669915    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-kubeconfig\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.670122 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669924    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-csr-dns-cert\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.670122 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669932    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6625182d-915f-4213-aef2-3d0b4a1bd763-istio-token\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.670122 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.669940    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6625182d-915f-4213-aef2-3d0b4a1bd763-local-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:38:46.746557 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.746463    2574 generic.go:356] "Generic (PLEG): container finished" podID="6625182d-915f-4213-aef2-3d0b4a1bd763" containerID="7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6" exitCode=0
Jul 28 19:38:46.746557 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.746504    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"
Jul 28 19:38:46.746557 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.746545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc" event={"ID":"6625182d-915f-4213-aef2-3d0b4a1bd763","Type":"ContainerDied","Data":"7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6"}
Jul 28 19:38:46.746799 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.746589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc" event={"ID":"6625182d-915f-4213-aef2-3d0b4a1bd763","Type":"ContainerDied","Data":"cf6828ccf9b237638054a14fc899f587388ce6971668bac634c7c558e7a96149"}
Jul 28 19:38:46.746799 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.746611    2574 scope.go:117] "RemoveContainer" containerID="7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6"
Jul 28 19:38:46.748280 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.748250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq" event={"ID":"c3a3c566-00d0-4dcc-b8ed-f80571b2909c","Type":"ContainerStarted","Data":"f3d82bbba7c94e85ad809f29dc2cc70bdaed0d54393f07b99126451d84888eec"}
Jul 28 19:38:46.748492 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.748311    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:38:46.749908 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.749886    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9" event={"ID":"bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9","Type":"ContainerStarted","Data":"1d0eb940083681d3a913d0271adea1764b45bc11a03340d9b41d79a4f26ef1eb"}
Jul 28 19:38:46.750016 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.749944    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:38:46.755754 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.755739    2574 scope.go:117] "RemoveContainer" containerID="7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6"
Jul 28 19:38:46.756047 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:38:46.756028    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6\": container with ID starting with 7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6 not found: ID does not exist" containerID="7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6"
Jul 28 19:38:46.756126 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.756056    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6"} err="failed to get container status \"7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6\": rpc error: code = NotFound desc = could not find container \"7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6\": container with ID starting with 7e0796c63fa38b6453f195ee8452fe27ad83126185423899494bc2de074198a6 not found: ID does not exist"
Jul 28 19:38:46.782348 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.782300    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq" podStartSLOduration=1.693629295 podStartE2EDuration="4.78228389s" totalImagesPullingTime="3.088654595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:46.781191549 +0000 UTC m=+545.629725017" watchObservedRunningTime="2026-07-28 19:38:46.78228389 +0000 UTC m=+545.630817356"
Jul 28 19:38:46.819426 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.819339    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9" podStartSLOduration=1.144165856 podStartE2EDuration="4.819321617s" totalImagesPullingTime="3.675155761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:38:46.816871248 +0000 UTC m=+545.665404717" watchObservedRunningTime="2026-07-28 19:38:46.819321617 +0000 UTC m=+545.667855084"
Jul 28 19:38:46.836890 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.836854    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"]
Jul 28 19:38:46.851789 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:46.851758    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9szpc"]
Jul 28 19:38:47.709594 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:38:47.709559    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6625182d-915f-4213-aef2-3d0b4a1bd763" path="/var/lib/kubelet/pods/6625182d-915f-4213-aef2-3d0b4a1bd763/volumes"
Jul 28 19:39:17.758304 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:17.758270    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zcbj9"
Jul 28 19:39:17.761082 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:17.761064    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f2vqq"
Jul 28 19:39:32.544593 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.544562    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-25sjs"]
Jul 28 19:39:32.544967 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.544909    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6625182d-915f-4213-aef2-3d0b4a1bd763" containerName="discovery"
Jul 28 19:39:32.544967 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.544922    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6625182d-915f-4213-aef2-3d0b4a1bd763" containerName="discovery"
Jul 28 19:39:32.545042 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.544989    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6625182d-915f-4213-aef2-3d0b4a1bd763" containerName="discovery"
Jul 28 19:39:32.552777 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.552753    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:32.556007 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.555986    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 19:39:32.556140 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.556020    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mdz7d\""
Jul 28 19:39:32.557051 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.557028    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 19:39:32.566196 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.566172    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-25sjs"]
Jul 28 19:39:32.637606 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.637569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x666r\" (UniqueName: \"kubernetes.io/projected/6d7467af-e621-401d-9db8-7a3353d9e5b6-kube-api-access-x666r\") pod \"kuadrant-operator-catalog-25sjs\" (UID: \"6d7467af-e621-401d-9db8-7a3353d9e5b6\") " pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:32.738888 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.738856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x666r\" (UniqueName: \"kubernetes.io/projected/6d7467af-e621-401d-9db8-7a3353d9e5b6-kube-api-access-x666r\") pod \"kuadrant-operator-catalog-25sjs\" (UID: \"6d7467af-e621-401d-9db8-7a3353d9e5b6\") " pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:32.747028 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.746995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x666r\" (UniqueName: \"kubernetes.io/projected/6d7467af-e621-401d-9db8-7a3353d9e5b6-kube-api-access-x666r\") pod \"kuadrant-operator-catalog-25sjs\" (UID: \"6d7467af-e621-401d-9db8-7a3353d9e5b6\") " pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:32.862062 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.862034    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:32.909135 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.909100    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-25sjs"]
Jul 28 19:39:32.993624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:32.993601    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-25sjs"]
Jul 28 19:39:32.995262 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:39:32.995231    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7467af_e621_401d_9db8_7a3353d9e5b6.slice/crio-3c5798129d242732ad44c15cf84770c61540d64df6021784034e7760d9128eb9 WatchSource:0}: Error finding container 3c5798129d242732ad44c15cf84770c61540d64df6021784034e7760d9128eb9: Status 404 returned error can't find the container with id 3c5798129d242732ad44c15cf84770c61540d64df6021784034e7760d9128eb9
Jul 28 19:39:33.118050 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.117970    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dbbhx"]
Jul 28 19:39:33.121175 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.121157    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:33.129144 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.129125    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dbbhx"]
Jul 28 19:39:33.144538 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.144507    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtdl\" (UniqueName: \"kubernetes.io/projected/0749b487-141b-439d-804d-f25f1ec2105e-kube-api-access-rwtdl\") pod \"kuadrant-operator-catalog-dbbhx\" (UID: \"0749b487-141b-439d-804d-f25f1ec2105e\") " pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:33.245503 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.245460    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtdl\" (UniqueName: \"kubernetes.io/projected/0749b487-141b-439d-804d-f25f1ec2105e-kube-api-access-rwtdl\") pod \"kuadrant-operator-catalog-dbbhx\" (UID: \"0749b487-141b-439d-804d-f25f1ec2105e\") " pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:33.254778 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.254755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtdl\" (UniqueName: \"kubernetes.io/projected/0749b487-141b-439d-804d-f25f1ec2105e-kube-api-access-rwtdl\") pod \"kuadrant-operator-catalog-dbbhx\" (UID: \"0749b487-141b-439d-804d-f25f1ec2105e\") " pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:33.431224 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.431136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:33.567877 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.567849    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dbbhx"]
Jul 28 19:39:33.570073 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:39:33.570046    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0749b487_141b_439d_804d_f25f1ec2105e.slice/crio-ce6057bf7af4a84848bde16bfca671749000215acbef729c182f84a7b5189828 WatchSource:0}: Error finding container ce6057bf7af4a84848bde16bfca671749000215acbef729c182f84a7b5189828: Status 404 returned error can't find the container with id ce6057bf7af4a84848bde16bfca671749000215acbef729c182f84a7b5189828
Jul 28 19:39:33.974486 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.974441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-25sjs" event={"ID":"6d7467af-e621-401d-9db8-7a3353d9e5b6","Type":"ContainerStarted","Data":"3c5798129d242732ad44c15cf84770c61540d64df6021784034e7760d9128eb9"}
Jul 28 19:39:33.976043 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:33.976010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx" event={"ID":"0749b487-141b-439d-804d-f25f1ec2105e","Type":"ContainerStarted","Data":"ce6057bf7af4a84848bde16bfca671749000215acbef729c182f84a7b5189828"}
Jul 28 19:39:35.986984 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:35.986944    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx" event={"ID":"0749b487-141b-439d-804d-f25f1ec2105e","Type":"ContainerStarted","Data":"c72a0a22844030927e2c3b3a6c1b710f1b6541d9334e3e5fdb8943de5d3c000b"}
Jul 28 19:39:35.988392 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:35.988351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-25sjs" event={"ID":"6d7467af-e621-401d-9db8-7a3353d9e5b6","Type":"ContainerStarted","Data":"abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15"}
Jul 28 19:39:35.988489 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:35.988447    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-25sjs" podUID="6d7467af-e621-401d-9db8-7a3353d9e5b6" containerName="registry-server" containerID="cri-o://abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15" gracePeriod=2
Jul 28 19:39:36.002488 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.002436    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx" podStartSLOduration=1.608923965 podStartE2EDuration="3.002415413s" totalImagesPullingTime="1.393491448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:39:36.002107573 +0000 UTC m=+594.850641040" watchObservedRunningTime="2026-07-28 19:39:36.002415413 +0000 UTC m=+594.850948880"
Jul 28 19:39:36.017948 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.017893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-25sjs" podStartSLOduration=2.050243879 podStartE2EDuration="4.017875493s" totalImagesPullingTime="1.967631614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:39:36.016134282 +0000 UTC m=+594.864667760" watchObservedRunningTime="2026-07-28 19:39:36.017875493 +0000 UTC m=+594.866408992"
Jul 28 19:39:36.231117 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.231093    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:36.272227 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.272136    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x666r\" (UniqueName: \"kubernetes.io/projected/6d7467af-e621-401d-9db8-7a3353d9e5b6-kube-api-access-x666r\") pod \"6d7467af-e621-401d-9db8-7a3353d9e5b6\" (UID: \"6d7467af-e621-401d-9db8-7a3353d9e5b6\") "
Jul 28 19:39:36.274411 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.274384    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7467af-e621-401d-9db8-7a3353d9e5b6-kube-api-access-x666r" (OuterVolumeSpecName: "kube-api-access-x666r") pod "6d7467af-e621-401d-9db8-7a3353d9e5b6" (UID: "6d7467af-e621-401d-9db8-7a3353d9e5b6"). InnerVolumeSpecName "kube-api-access-x666r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:39:36.373767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.373734    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x666r\" (UniqueName: \"kubernetes.io/projected/6d7467af-e621-401d-9db8-7a3353d9e5b6-kube-api-access-x666r\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:39:36.993697 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.993665    2574 generic.go:356] "Generic (PLEG): container finished" podID="6d7467af-e621-401d-9db8-7a3353d9e5b6" containerID="abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15" exitCode=0
Jul 28 19:39:36.994139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.993710    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-25sjs"
Jul 28 19:39:36.994139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.993758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-25sjs" event={"ID":"6d7467af-e621-401d-9db8-7a3353d9e5b6","Type":"ContainerDied","Data":"abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15"}
Jul 28 19:39:36.994139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.993810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-25sjs" event={"ID":"6d7467af-e621-401d-9db8-7a3353d9e5b6","Type":"ContainerDied","Data":"3c5798129d242732ad44c15cf84770c61540d64df6021784034e7760d9128eb9"}
Jul 28 19:39:36.994139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:36.993836    2574 scope.go:117] "RemoveContainer" containerID="abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15"
Jul 28 19:39:37.003650 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:37.003626    2574 scope.go:117] "RemoveContainer" containerID="abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15"
Jul 28 19:39:37.003955 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:39:37.003933    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15\": container with ID starting with abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15 not found: ID does not exist" containerID="abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15"
Jul 28 19:39:37.004002 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:37.003967    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15"} err="failed to get container status \"abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15\": rpc error: code = NotFound desc = could not find container \"abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15\": container with ID starting with abd473adf97b75c20d70254609ece8098c913c94a1e5c748d5eb9d61ea1a3a15 not found: ID does not exist"
Jul 28 19:39:37.014324 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:37.014298    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-25sjs"]
Jul 28 19:39:37.017994 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:37.017967    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-25sjs"]
Jul 28 19:39:37.709550 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:37.709517    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7467af-e621-401d-9db8-7a3353d9e5b6" path="/var/lib/kubelet/pods/6d7467af-e621-401d-9db8-7a3353d9e5b6/volumes"
Jul 28 19:39:43.432028 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:43.431978    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:43.434630 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:43.432091    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:43.455535 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:43.455507    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:39:44.054604 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:39:44.054574    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dbbhx"
Jul 28 19:40:04.689832 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.689755    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"]
Jul 28 19:40:04.690231 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.690119    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7467af-e621-401d-9db8-7a3353d9e5b6" containerName="registry-server"
Jul 28 19:40:04.690231 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.690131    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7467af-e621-401d-9db8-7a3353d9e5b6" containerName="registry-server"
Jul 28 19:40:04.690231 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.690202    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7467af-e621-401d-9db8-7a3353d9e5b6" containerName="registry-server"
Jul 28 19:40:04.697120 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.697087    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:04.699796 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.699773    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rxrrw\""
Jul 28 19:40:04.705357 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.705336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"]
Jul 28 19:40:04.830806 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.830768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzb9p\" (UniqueName: \"kubernetes.io/projected/c93a6b6c-d12c-4faa-a5c1-f00bac187761-kube-api-access-rzb9p\") pod \"limitador-operator-controller-manager-859d7b78bd-jb58f\" (UID: \"c93a6b6c-d12c-4faa-a5c1-f00bac187761\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:04.931884 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.931847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzb9p\" (UniqueName: \"kubernetes.io/projected/c93a6b6c-d12c-4faa-a5c1-f00bac187761-kube-api-access-rzb9p\") pod \"limitador-operator-controller-manager-859d7b78bd-jb58f\" (UID: \"c93a6b6c-d12c-4faa-a5c1-f00bac187761\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:04.941991 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:04.941931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzb9p\" (UniqueName: \"kubernetes.io/projected/c93a6b6c-d12c-4faa-a5c1-f00bac187761-kube-api-access-rzb9p\") pod \"limitador-operator-controller-manager-859d7b78bd-jb58f\" (UID: \"c93a6b6c-d12c-4faa-a5c1-f00bac187761\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:05.008779 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:05.008729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:05.142320 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:05.142294    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"]
Jul 28 19:40:05.144658 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:05.144630    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93a6b6c_d12c_4faa_a5c1_f00bac187761.slice/crio-4eafd6a9b4d591835d990f57ef87a061c2d68aa5892b0ee95dff295598b11569 WatchSource:0}: Error finding container 4eafd6a9b4d591835d990f57ef87a061c2d68aa5892b0ee95dff295598b11569: Status 404 returned error can't find the container with id 4eafd6a9b4d591835d990f57ef87a061c2d68aa5892b0ee95dff295598b11569
Jul 28 19:40:05.146616 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:05.146599    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:40:06.138072 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:06.138026    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f" event={"ID":"c93a6b6c-d12c-4faa-a5c1-f00bac187761","Type":"ContainerStarted","Data":"4eafd6a9b4d591835d990f57ef87a061c2d68aa5892b0ee95dff295598b11569"}
Jul 28 19:40:07.147006 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:07.146973    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f" event={"ID":"c93a6b6c-d12c-4faa-a5c1-f00bac187761","Type":"ContainerStarted","Data":"452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7"}
Jul 28 19:40:07.147444 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:07.147031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:07.164847 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:07.164792    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f" podStartSLOduration=1.545783415 podStartE2EDuration="3.164774013s" totalImagesPullingTime="1.618990598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:07.162884867 +0000 UTC m=+626.011418334" watchObservedRunningTime="2026-07-28 19:40:07.164774013 +0000 UTC m=+626.013307480"
Jul 28 19:40:08.687211 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.687178    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"]
Jul 28 19:40:08.690787 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.690770    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:08.693701 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.693673    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-95dhs\""
Jul 28 19:40:08.703181 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.703158    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"]
Jul 28 19:40:08.865923 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.865885    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7rcf\" (UniqueName: \"kubernetes.io/projected/9f007322-678f-4df1-9c07-a77f3a93855d-kube-api-access-m7rcf\") pod \"authorino-operator-75cc8d5cb7-crrcw\" (UID: \"9f007322-678f-4df1-9c07-a77f3a93855d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:08.967230 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.967157    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rcf\" (UniqueName: \"kubernetes.io/projected/9f007322-678f-4df1-9c07-a77f3a93855d-kube-api-access-m7rcf\") pod \"authorino-operator-75cc8d5cb7-crrcw\" (UID: \"9f007322-678f-4df1-9c07-a77f3a93855d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:08.975699 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:08.975669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7rcf\" (UniqueName: \"kubernetes.io/projected/9f007322-678f-4df1-9c07-a77f3a93855d-kube-api-access-m7rcf\") pod \"authorino-operator-75cc8d5cb7-crrcw\" (UID: \"9f007322-678f-4df1-9c07-a77f3a93855d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:09.000559 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:09.000534    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:09.137540 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:09.137516    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"]
Jul 28 19:40:09.139341 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:09.139311    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f007322_678f_4df1_9c07_a77f3a93855d.slice/crio-25d307afaa551434cea69bc5d9c2334ee5920276781a347df798fe59b2179954 WatchSource:0}: Error finding container 25d307afaa551434cea69bc5d9c2334ee5920276781a347df798fe59b2179954: Status 404 returned error can't find the container with id 25d307afaa551434cea69bc5d9c2334ee5920276781a347df798fe59b2179954
Jul 28 19:40:09.156176 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:09.156151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw" event={"ID":"9f007322-678f-4df1-9c07-a77f3a93855d","Type":"ContainerStarted","Data":"25d307afaa551434cea69bc5d9c2334ee5920276781a347df798fe59b2179954"}
Jul 28 19:40:11.972815 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:11.972782    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"]
Jul 28 19:40:11.976200 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:11.976184    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:11.979154 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:11.979131    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 19:40:11.979275 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:11.979260    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8rt9v\""
Jul 28 19:40:11.993342 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:11.993319    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"]
Jul 28 19:40:12.097572 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.097528    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t84l2\" (UniqueName: \"kubernetes.io/projected/bea7a808-47cd-4c9d-b44c-4631330daa84-kube-api-access-t84l2\") pod \"dns-operator-controller-manager-864dd78c4c-t2rr7\" (UID: \"bea7a808-47cd-4c9d-b44c-4631330daa84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:12.173549 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.173519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw" event={"ID":"9f007322-678f-4df1-9c07-a77f3a93855d","Type":"ContainerStarted","Data":"44e1058f94b40a4906a2971bb821d0b73eafc0292b1f45b2e93042ccfc9569b3"}
Jul 28 19:40:12.173771 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.173754    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:12.193478 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.193428    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw" podStartSLOduration=1.967479492 podStartE2EDuration="4.193411888s" totalImagesPullingTime="2.225932396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:12.191958255 +0000 UTC m=+631.040491740" watchObservedRunningTime="2026-07-28 19:40:12.193411888 +0000 UTC m=+631.041945422"
Jul 28 19:40:12.198591 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.198562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t84l2\" (UniqueName: \"kubernetes.io/projected/bea7a808-47cd-4c9d-b44c-4631330daa84-kube-api-access-t84l2\") pod \"dns-operator-controller-manager-864dd78c4c-t2rr7\" (UID: \"bea7a808-47cd-4c9d-b44c-4631330daa84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:12.209211 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.209185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t84l2\" (UniqueName: \"kubernetes.io/projected/bea7a808-47cd-4c9d-b44c-4631330daa84-kube-api-access-t84l2\") pod \"dns-operator-controller-manager-864dd78c4c-t2rr7\" (UID: \"bea7a808-47cd-4c9d-b44c-4631330daa84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:12.286790 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.286707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:12.434143 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:12.434117    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"]
Jul 28 19:40:12.436246 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:12.436212    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea7a808_47cd_4c9d_b44c_4631330daa84.slice/crio-69eaed5fb9e7603f915764154a7378b171a47f42dec480191f061d5cdf1e54a8 WatchSource:0}: Error finding container 69eaed5fb9e7603f915764154a7378b171a47f42dec480191f061d5cdf1e54a8: Status 404 returned error can't find the container with id 69eaed5fb9e7603f915764154a7378b171a47f42dec480191f061d5cdf1e54a8
Jul 28 19:40:13.179998 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:13.179958    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7" event={"ID":"bea7a808-47cd-4c9d-b44c-4631330daa84","Type":"ContainerStarted","Data":"69eaed5fb9e7603f915764154a7378b171a47f42dec480191f061d5cdf1e54a8"}
Jul 28 19:40:15.192792 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:15.192692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7" event={"ID":"bea7a808-47cd-4c9d-b44c-4631330daa84","Type":"ContainerStarted","Data":"058d9a8e0087d5db0898af4becc65b0aaf0488761562ea8af12ee2d0bb256b84"}
Jul 28 19:40:15.192792 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:15.192780    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:15.212617 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:15.212567    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7" podStartSLOduration=1.736926987 podStartE2EDuration="4.212552926s" totalImagesPullingTime="2.475625939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:15.210051622 +0000 UTC m=+634.058585090" watchObservedRunningTime="2026-07-28 19:40:15.212552926 +0000 UTC m=+634.061086393"
Jul 28 19:40:16.413247 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.413208    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"]
Jul 28 19:40:16.416993 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.416970    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.419884 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.419866    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dhx6n\""
Jul 28 19:40:16.434108 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.434076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c28964f5-2f8e-4c84-9624-a7bd2861473e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.434253 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.434139    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7mx\" (UniqueName: \"kubernetes.io/projected/c28964f5-2f8e-4c84-9624-a7bd2861473e-kube-api-access-bq7mx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.435748 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.435731    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"]
Jul 28 19:40:16.534599 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.534565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7mx\" (UniqueName: \"kubernetes.io/projected/c28964f5-2f8e-4c84-9624-a7bd2861473e-kube-api-access-bq7mx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.534812 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.534720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c28964f5-2f8e-4c84-9624-a7bd2861473e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.535088 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.535066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c28964f5-2f8e-4c84-9624-a7bd2861473e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.543273 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.543248    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7mx\" (UniqueName: \"kubernetes.io/projected/c28964f5-2f8e-4c84-9624-a7bd2861473e-kube-api-access-bq7mx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.727416 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.727315    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:16.863413 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:16.863391    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"]
Jul 28 19:40:16.866117 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:16.866091    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28964f5_2f8e_4c84_9624_a7bd2861473e.slice/crio-2efd87cfd55eee214116508eac29ca5a8139ac3cd0b1473df0fb7ebd74f97219 WatchSource:0}: Error finding container 2efd87cfd55eee214116508eac29ca5a8139ac3cd0b1473df0fb7ebd74f97219: Status 404 returned error can't find the container with id 2efd87cfd55eee214116508eac29ca5a8139ac3cd0b1473df0fb7ebd74f97219
Jul 28 19:40:17.203527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:17.203491    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww" event={"ID":"c28964f5-2f8e-4c84-9624-a7bd2861473e","Type":"ContainerStarted","Data":"2efd87cfd55eee214116508eac29ca5a8139ac3cd0b1473df0fb7ebd74f97219"}
Jul 28 19:40:18.154518 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:18.154490    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:23.182803 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:23.182774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-crrcw"
Jul 28 19:40:23.239570 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:23.239532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww" event={"ID":"c28964f5-2f8e-4c84-9624-a7bd2861473e","Type":"ContainerStarted","Data":"0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e"}
Jul 28 19:40:23.239748 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:23.239673    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:23.257348 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:23.257303    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww" podStartSLOduration=1.05248121 podStartE2EDuration="7.257288461s" totalImagesPullingTime="6.204807251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:23.256261478 +0000 UTC m=+642.104794969" watchObservedRunningTime="2026-07-28 19:40:23.257288461 +0000 UTC m=+642.105821927"
Jul 28 19:40:25.850887 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.850848    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"]
Jul 28 19:40:25.854446 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.854426    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:25.857890 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.857867    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-thhmk\""
Jul 28 19:40:25.859646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.859622    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 19:40:25.859817 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.859795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 19:40:25.862001 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.861971    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"]
Jul 28 19:40:25.916471 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.916438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:25.916632 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.916477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg5bw\" (UniqueName: \"kubernetes.io/projected/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-kube-api-access-rg5bw\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:25.916632 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:25.916497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.017581 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.017529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.017581 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.017596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg5bw\" (UniqueName: \"kubernetes.io/projected/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-kube-api-access-rg5bw\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.017804 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.017630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.018200 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.018168    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.020131 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.020103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.025575 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.025555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg5bw\" (UniqueName: \"kubernetes.io/projected/dcbc000d-8c6a-411b-896a-fe3f8fcadb82-kube-api-access-rg5bw\") pod \"kuadrant-console-plugin-66b5774985-hbfgp\" (UID: \"dcbc000d-8c6a-411b-896a-fe3f8fcadb82\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.170040 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.169950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"
Jul 28 19:40:26.200317 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.200285    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2rr7"
Jul 28 19:40:26.302204 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:26.302183    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp"]
Jul 28 19:40:26.304832 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:26.304787    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcbc000d_8c6a_411b_896a_fe3f8fcadb82.slice/crio-549e0b629452868be5145e6635db44d8aadc5184e7ea79ab78f53f965e7794bb WatchSource:0}: Error finding container 549e0b629452868be5145e6635db44d8aadc5184e7ea79ab78f53f965e7794bb: Status 404 returned error can't find the container with id 549e0b629452868be5145e6635db44d8aadc5184e7ea79ab78f53f965e7794bb
Jul 28 19:40:27.262018 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:27.261984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp" event={"ID":"dcbc000d-8c6a-411b-896a-fe3f8fcadb82","Type":"ContainerStarted","Data":"549e0b629452868be5145e6635db44d8aadc5184e7ea79ab78f53f965e7794bb"}
Jul 28 19:40:34.247655 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:34.247622    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:35.287428 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.287394    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"]
Jul 28 19:40:35.291593 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.291565    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.302229 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.302163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"]
Jul 28 19:40:35.412233 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.412193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.412458 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.412279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvddn\" (UniqueName: \"kubernetes.io/projected/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-kube-api-access-xvddn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.513502 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.513472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.513672 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.513526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvddn\" (UniqueName: \"kubernetes.io/projected/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-kube-api-access-xvddn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.513848 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.513827    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.524860 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.524835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvddn\" (UniqueName: \"kubernetes.io/projected/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-kube-api-access-xvddn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.606133 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.606103    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:35.753782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.753756    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"]
Jul 28 19:40:35.755770 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:35.755745    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c1f358_130d_4bc2_bfcc_39ffd9a1ba53.slice/crio-e963ed7892e6e79a2f7cb73808e1086189ec9ce826c9ff1101008c5e9dcc2a4e WatchSource:0}: Error finding container e963ed7892e6e79a2f7cb73808e1086189ec9ce826c9ff1101008c5e9dcc2a4e: Status 404 returned error can't find the container with id e963ed7892e6e79a2f7cb73808e1086189ec9ce826c9ff1101008c5e9dcc2a4e
Jul 28 19:40:35.969767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.969685    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"]
Jul 28 19:40:35.972899 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.972874    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"]
Jul 28 19:40:35.980719 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.980696    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"]
Jul 28 19:40:35.980922 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.980894    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" containerName="manager" containerID="cri-o://0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e" gracePeriod=2
Jul 28 19:40:35.992477 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.992220    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"]
Jul 28 19:40:35.994217 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994196    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"]
Jul 28 19:40:35.994697 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994680    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" containerName="manager"
Jul 28 19:40:35.994794 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994720    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" containerName="manager"
Jul 28 19:40:35.994794 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994737    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" containerName="manager"
Jul 28 19:40:35.994794 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994745    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" containerName="manager"
Jul 28 19:40:35.994945 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994900    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" containerName="manager"
Jul 28 19:40:35.994945 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.994916    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" containerName="manager"
Jul 28 19:40:35.997256 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:35.997211    2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c28964f5-2f8e-4c84-9624-a7bd2861473e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lbnww\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:35.998386 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:35.998327    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.002898 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.002875    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"]
Jul 28 19:40:36.003090 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.003068    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" containerName="manager" containerID="cri-o://452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7" gracePeriod=2
Jul 28 19:40:36.009310 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.009182    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"]
Jul 28 19:40:36.014220 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.014190    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"]
Jul 28 19:40:36.014712 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.014443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.014981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.014944    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"]
Jul 28 19:40:36.035133 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.035101    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"]
Jul 28 19:40:36.035311 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.035130    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:36.037753 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.037712    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:36.039828 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.039797    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"]
Jul 28 19:40:36.040033 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.040007    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:36.040398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.040375    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" containerName="manager"
Jul 28 19:40:36.040398 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.040400    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" containerName="manager"
Jul 28 19:40:36.040567 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.040504    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" containerName="manager"
Jul 28 19:40:36.043806 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.043783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:40:36.053660 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.053632    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"]
Jul 28 19:40:36.066349 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.066300    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:36.071383 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.071324    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:36.120280 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.120247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvvw\" (UniqueName: \"kubernetes.io/projected/9ab4933e-bb33-47e5-83a2-9135bd8ffced-kube-api-access-2tvvw\") pod \"limitador-operator-controller-manager-859d7b78bd-4j9ft\" (UID: \"9ab4933e-bb33-47e5-83a2-9135bd8ffced\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:40:36.120562 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.120536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d83394e-b7ec-4d15-91f8-e637a6936fff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9b88m\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.120687 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.120577    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7m87\" (UniqueName: \"kubernetes.io/projected/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-kube-api-access-w7m87\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tj2rc\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.120687 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.120608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7shm\" (UniqueName: \"kubernetes.io/projected/2d83394e-b7ec-4d15-91f8-e637a6936fff-kube-api-access-p7shm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9b88m\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.120687 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.120674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tj2rc\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.221831 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.221738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d83394e-b7ec-4d15-91f8-e637a6936fff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9b88m\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.221831 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.221797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7m87\" (UniqueName: \"kubernetes.io/projected/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-kube-api-access-w7m87\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tj2rc\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.221831 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.221824    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7shm\" (UniqueName: \"kubernetes.io/projected/2d83394e-b7ec-4d15-91f8-e637a6936fff-kube-api-access-p7shm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9b88m\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.222094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.221850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tj2rc\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.222094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.221953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvvw\" (UniqueName: \"kubernetes.io/projected/9ab4933e-bb33-47e5-83a2-9135bd8ffced-kube-api-access-2tvvw\") pod \"limitador-operator-controller-manager-859d7b78bd-4j9ft\" (UID: \"9ab4933e-bb33-47e5-83a2-9135bd8ffced\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:40:36.222217 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.222192    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d83394e-b7ec-4d15-91f8-e637a6936fff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9b88m\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.222278 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.222257    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tj2rc\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.235684 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.235654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7shm\" (UniqueName: \"kubernetes.io/projected/2d83394e-b7ec-4d15-91f8-e637a6936fff-kube-api-access-p7shm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9b88m\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.236782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.236757    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7m87\" (UniqueName: \"kubernetes.io/projected/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-kube-api-access-w7m87\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tj2rc\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.237011 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.236990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvvw\" (UniqueName: \"kubernetes.io/projected/9ab4933e-bb33-47e5-83a2-9135bd8ffced-kube-api-access-2tvvw\") pod \"limitador-operator-controller-manager-859d7b78bd-4j9ft\" (UID: \"9ab4933e-bb33-47e5-83a2-9135bd8ffced\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:40:36.318026 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.317992    2574 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss" container="manager"
Jul 28 19:40:36.320643 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.320616    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:36.323010 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.322984    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:36.325249 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:36.325198    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:36.406283 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.406252    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:36.415233 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.415205    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:36.422219 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:36.422183    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.080929    2574 log.go:32] "UpdateContainerResources from runtime service failed" err=<
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:         rpc error: code = Unknown desc = updating resources for container "9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896" failed: sd-bus call: Unit crio-9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896.scope not found.: No such file or directory
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:          : exit status 1
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:  > containerID="9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896"
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.080988    2574 kuberuntime_container.go:421] "UpdateContainerResources failed" err=<
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:         rpc error: code = Unknown desc = updating resources for container "9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896" failed: sd-bus call: Unit crio-9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896.scope not found.: No such file or directory
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:          : exit status 1
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:  > container="cri-o://9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896"
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.081006    2574 kuberuntime_manager.go:986] "updateContainerResources failed" err=<
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:         rpc error: code = Unknown desc = updating resources for container "9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896" failed: sd-bus call: Unit crio-9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896.scope not found.: No such file or directory
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:          : exit status 1
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:  > container="manager" cID={"Type":"cri-o","ID":"9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896"} pod="kuadrant-operator-controller-manager-6fb7879bc9-qmrss_kuadrant-system(a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53)" resourceName="memory"
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.081034    2574 kuberuntime_manager.go:821] "updatePodContainerResources failed" err=<
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:         rpc error: code = Unknown desc = updating resources for container "9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896" failed: sd-bus call: Unit crio-9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896.scope not found.: No such file or directory
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:          : exit status 1
Jul 28 19:40:50.081080 ip-10-0-137-245 kubenswrapper[2574]:  > pod="kuadrant-operator-controller-manager-6fb7879bc9-qmrss_kuadrant-system(a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53)" resource="memory"
Jul 28 19:40:50.082282 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.081090    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"ResizePodInPlace\" for \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss_kuadrant-system(a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53)\" with ResizePodInPlaceError: \"rpc error: code = Unknown desc = updating resources for container \\\"9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896\\\" failed: sd-bus call: Unit crio-9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896.scope not found.: No such file or directory\\n : exit status 1\"" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53"
Jul 28 19:40:50.260500 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.260473    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.263644 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.263584    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.273076 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.273050    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"]
Jul 28 19:40:50.275760 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:50.275735    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7308d2_f86c_4fb8_a4b1_0849b9745e30.slice/crio-377ac466c4a92af3107e67ba28518332dedbfa666a838f35f5497de16b2ccb53 WatchSource:0}: Error finding container 377ac466c4a92af3107e67ba28518332dedbfa666a838f35f5497de16b2ccb53: Status 404 returned error can't find the container with id 377ac466c4a92af3107e67ba28518332dedbfa666a838f35f5497de16b2ccb53
Jul 28 19:40:50.301408 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.301356    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.303853 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.303826    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.305923 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.305891    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.370922 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.370894    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq7mx\" (UniqueName: \"kubernetes.io/projected/c28964f5-2f8e-4c84-9624-a7bd2861473e-kube-api-access-bq7mx\") pod \"c28964f5-2f8e-4c84-9624-a7bd2861473e\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") "
Jul 28 19:40:50.371088 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.371015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c28964f5-2f8e-4c84-9624-a7bd2861473e-extensions-socket-volume\") pod \"c28964f5-2f8e-4c84-9624-a7bd2861473e\" (UID: \"c28964f5-2f8e-4c84-9624-a7bd2861473e\") "
Jul 28 19:40:50.371562 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.371500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c28964f5-2f8e-4c84-9624-a7bd2861473e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c28964f5-2f8e-4c84-9624-a7bd2861473e" (UID: "c28964f5-2f8e-4c84-9624-a7bd2861473e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:40:50.372808 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.372787    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c28964f5-2f8e-4c84-9624-a7bd2861473e-kube-api-access-bq7mx" (OuterVolumeSpecName: "kube-api-access-bq7mx") pod "c28964f5-2f8e-4c84-9624-a7bd2861473e" (UID: "c28964f5-2f8e-4c84-9624-a7bd2861473e"). InnerVolumeSpecName "kube-api-access-bq7mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:40:50.394638 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.394599    2574 generic.go:356] "Generic (PLEG): container finished" podID="c28964f5-2f8e-4c84-9624-a7bd2861473e" containerID="0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e" exitCode=0
Jul 28 19:40:50.394821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.394650    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.394821 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.394692    2574 scope.go:117] "RemoveContainer" containerID="0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e"
Jul 28 19:40:50.396166 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.396141    2574 generic.go:356] "Generic (PLEG): container finished" podID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" containerID="452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7" exitCode=0
Jul 28 19:40:50.396274 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.396177    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.397690 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.397658    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.398104 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.398083    2574 generic.go:356] "Generic (PLEG): container finished" podID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" containerID="9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896" exitCode=1
Jul 28 19:40:50.400449 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.400164    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp" event={"ID":"dcbc000d-8c6a-411b-896a-fe3f8fcadb82","Type":"ContainerStarted","Data":"9f6e2f0c85a27683db18e1651dc4626585ff138d46be4849761d9c3aca3b736f"}
Jul 28 19:40:50.401249 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.401221    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.402387 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.402310    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc" event={"ID":"0a7308d2-f86c-4fb8-a4b1-0849b9745e30","Type":"ContainerStarted","Data":"15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84"}
Jul 28 19:40:50.402489 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.402389    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc" event={"ID":"0a7308d2-f86c-4fb8-a4b1-0849b9745e30","Type":"ContainerStarted","Data":"377ac466c4a92af3107e67ba28518332dedbfa666a838f35f5497de16b2ccb53"}
Jul 28 19:40:50.402565 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.402490    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:40:50.403948 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.403922    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.406181 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.406159    2574 scope.go:117] "RemoveContainer" containerID="0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e"
Jul 28 19:40:50.406476 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.406451    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.406564 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.406476    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e\": container with ID starting with 0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e not found: ID does not exist" containerID="0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e"
Jul 28 19:40:50.406564 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.406504    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e"} err="failed to get container status \"0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e\": rpc error: code = NotFound desc = could not find container \"0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e\": container with ID starting with 0e4cc88c05595959ff115bd0493ad2b4f8ab5d5c0e2745ad2cfff4e89287278e not found: ID does not exist"
Jul 28 19:40:50.406564 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.406521    2574 scope.go:117] "RemoveContainer" containerID="452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7"
Jul 28 19:40:50.410149 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.410118    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:50.416338 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.416315    2574 scope.go:117] "RemoveContainer" containerID="452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7"
Jul 28 19:40:50.416639 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.416622    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7\": container with ID starting with 452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7 not found: ID does not exist" containerID="452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7"
Jul 28 19:40:50.416701 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.416646    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7"} err="failed to get container status \"452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7\": rpc error: code = NotFound desc = could not find container \"452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7\": container with ID starting with 452cb03631739d54a9c0213efdb0c483a074bf6dbe2ed300dd57309fe0ab54b7 not found: ID does not exist"
Jul 28 19:40:50.431166 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.429674    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hbfgp" podStartSLOduration=1.546869075 podStartE2EDuration="25.429653386s" totalImagesPullingTime="23.882784311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:50.427504479 +0000 UTC m=+669.276037946" watchObservedRunningTime="2026-07-28 19:40:50.429653386 +0000 UTC m=+669.278186856"
Jul 28 19:40:50.431339 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.431261    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.457999 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.457962    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.458235 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.458188    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc" podStartSLOduration=15.458168291 podStartE2EDuration="15.458168291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:50.455502715 +0000 UTC m=+669.304036184" watchObservedRunningTime="2026-07-28 19:40:50.458168291 +0000 UTC m=+669.306701759"
Jul 28 19:40:50.460379 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.460333    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:50.471957 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.471922    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzb9p\" (UniqueName: \"kubernetes.io/projected/c93a6b6c-d12c-4faa-a5c1-f00bac187761-kube-api-access-rzb9p\") pod \"c93a6b6c-d12c-4faa-a5c1-f00bac187761\" (UID: \"c93a6b6c-d12c-4faa-a5c1-f00bac187761\") "
Jul 28 19:40:50.472278 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.472256    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c28964f5-2f8e-4c84-9624-a7bd2861473e-extensions-socket-volume\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:40:50.472342 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.472285    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq7mx\" (UniqueName: \"kubernetes.io/projected/c28964f5-2f8e-4c84-9624-a7bd2861473e-kube-api-access-bq7mx\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:40:50.474667 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.474641    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c93a6b6c-d12c-4faa-a5c1-f00bac187761-kube-api-access-rzb9p" (OuterVolumeSpecName: "kube-api-access-rzb9p") pod "c93a6b6c-d12c-4faa-a5c1-f00bac187761" (UID: "c93a6b6c-d12c-4faa-a5c1-f00bac187761"). InnerVolumeSpecName "kube-api-access-rzb9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:40:50.504461 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:50.504426    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab4933e_bb33_47e5_83a2_9135bd8ffced.slice/crio-ddc1476227fb87897ab70422a1d3e85f8a18f9c2e7419766eed2810d524cdb5d WatchSource:0}: Error finding container ddc1476227fb87897ab70422a1d3e85f8a18f9c2e7419766eed2810d524cdb5d: Status 404 returned error can't find the container with id ddc1476227fb87897ab70422a1d3e85f8a18f9c2e7419766eed2810d524cdb5d
Jul 28 19:40:50.504953 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:40:50.504929    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d83394e_b7ec_4d15_91f8_e637a6936fff.slice/crio-3aa59760cb83936fed915dbde5fc11d4f8d77bf55ce7aeb0af2447a23e4e84fd WatchSource:0}: Error finding container 3aa59760cb83936fed915dbde5fc11d4f8d77bf55ce7aeb0af2447a23e4e84fd: Status 404 returned error can't find the container with id 3aa59760cb83936fed915dbde5fc11d4f8d77bf55ce7aeb0af2447a23e4e84fd
Jul 28 19:40:50.505062 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.504968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"]
Jul 28 19:40:50.507303 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.507280    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"]
Jul 28 19:40:50.522194 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.522172    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:50.524813 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.524790    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.527341 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.527313    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.529612 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.529587    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:50.572963 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.572932    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzb9p\" (UniqueName: \"kubernetes.io/projected/c93a6b6c-d12c-4faa-a5c1-f00bac187761-kube-api-access-rzb9p\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:40:50.674077 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.673999    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-extensions-socket-volume\") pod \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") "
Jul 28 19:40:50.674221 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.674114    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvddn\" (UniqueName: \"kubernetes.io/projected/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-kube-api-access-xvddn\") pod \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\" (UID: \"a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53\") "
Jul 28 19:40:50.674304 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.674277    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" (UID: "a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:40:50.676116 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.676094    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-kube-api-access-xvddn" (OuterVolumeSpecName: "kube-api-access-xvddn") pod "a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" (UID: "a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53"). InnerVolumeSpecName "kube-api-access-xvddn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:40:50.709011 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.708980    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:50.711908 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.711881    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:50.714878 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:50.714859    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:50.775435 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.775401    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvddn\" (UniqueName: \"kubernetes.io/projected/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-kube-api-access-xvddn\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:40:50.775435 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:50.775434    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53-extensions-socket-volume\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:40:51.410159 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.410130    2574 scope.go:117] "RemoveContainer" containerID="9ca5c52cb8e52069a07e0cc08d4578083e31bf5da903aacb654bbb220cea9896"
Jul 28 19:40:51.410159 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.410152    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:51.412101 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.412067    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft" event={"ID":"9ab4933e-bb33-47e5-83a2-9135bd8ffced","Type":"ContainerStarted","Data":"32d89a8034021d65085a0e3afab256a183b889f5bb2ec5b26d9337b30a5e0dee"}
Jul 28 19:40:51.412231 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.412178    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:40:51.412231 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.412205    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft" event={"ID":"9ab4933e-bb33-47e5-83a2-9135bd8ffced","Type":"ContainerStarted","Data":"ddc1476227fb87897ab70422a1d3e85f8a18f9c2e7419766eed2810d524cdb5d"}
Jul 28 19:40:51.413410 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.413380    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:51.413881 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.413848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m" event={"ID":"2d83394e-b7ec-4d15-91f8-e637a6936fff","Type":"ContainerStarted","Data":"eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741"}
Jul 28 19:40:51.413957 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.413901    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m" event={"ID":"2d83394e-b7ec-4d15-91f8-e637a6936fff","Type":"ContainerStarted","Data":"3aa59760cb83936fed915dbde5fc11d4f8d77bf55ce7aeb0af2447a23e4e84fd"}
Jul 28 19:40:51.413957 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.413938    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:40:51.415784 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.415747    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:51.418200 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.418172    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:51.439571 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.439517    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m" podStartSLOduration=16.439500766 podStartE2EDuration="16.439500766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:51.438199662 +0000 UTC m=+670.286733130" watchObservedRunningTime="2026-07-28 19:40:51.439500766 +0000 UTC m=+670.288034232"
Jul 28 19:40:51.440498 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.440476    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:51.442797 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.442771    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:51.445078 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.445052    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:51.465419 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.465378    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft" podStartSLOduration=15.465349286 podStartE2EDuration="15.465349286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:51.464322717 +0000 UTC m=+670.312856185" watchObservedRunningTime="2026-07-28 19:40:51.465349286 +0000 UTC m=+670.313882753"
Jul 28 19:40:51.466896 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.466869    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:51.469283 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.469261    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:51.471488 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.471470    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:40:51.708697 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.708613    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbnww\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbnww"
Jul 28 19:40:51.711117 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.711092    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qmrss\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmrss"
Jul 28 19:40:51.711397 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.711349    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53" path="/var/lib/kubelet/pods/a6c1f358-130d-4bc2-bfcc-39ffd9a1ba53/volumes"
Jul 28 19:40:51.711733 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.711721    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c28964f5-2f8e-4c84-9624-a7bd2861473e" path="/var/lib/kubelet/pods/c28964f5-2f8e-4c84-9624-a7bd2861473e/volumes"
Jul 28 19:40:51.711998 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:40:51.711986    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" path="/var/lib/kubelet/pods/c93a6b6c-d12c-4faa-a5c1-f00bac187761/volumes"
Jul 28 19:40:51.713450 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:40:51.713433    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jb58f\" is forbidden: User \"system:node:ip-10-0-137-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-245.ec2.internal' and this object" podUID="c93a6b6c-d12c-4faa-a5c1-f00bac187761" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jb58f"
Jul 28 19:41:01.416045 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.416012    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:41:01.464437 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.464399    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"]
Jul 28 19:41:01.464784 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.464728    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m" podUID="2d83394e-b7ec-4d15-91f8-e637a6936fff" containerName="manager" containerID="cri-o://eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741" gracePeriod=10
Jul 28 19:41:01.466554 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.466533    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:41:01.683798 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.683722    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"]
Jul 28 19:41:01.686495 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.686469    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.716298 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.716274    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"]
Jul 28 19:41:01.724746 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.724723    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:41:01.779533 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.779503    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d83394e-b7ec-4d15-91f8-e637a6936fff-extensions-socket-volume\") pod \"2d83394e-b7ec-4d15-91f8-e637a6936fff\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") "
Jul 28 19:41:01.779725 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.779564    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7shm\" (UniqueName: \"kubernetes.io/projected/2d83394e-b7ec-4d15-91f8-e637a6936fff-kube-api-access-p7shm\") pod \"2d83394e-b7ec-4d15-91f8-e637a6936fff\" (UID: \"2d83394e-b7ec-4d15-91f8-e637a6936fff\") "
Jul 28 19:41:01.779725 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.779707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsrmb\" (UniqueName: \"kubernetes.io/projected/b6448fbf-4d9e-43da-a475-19b7280872b5-kube-api-access-lsrmb\") pod \"kuadrant-operator-controller-manager-86878c769f-v7c6d\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.779848 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.779834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6448fbf-4d9e-43da-a475-19b7280872b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7c6d\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.779904 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.779875    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d83394e-b7ec-4d15-91f8-e637a6936fff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2d83394e-b7ec-4d15-91f8-e637a6936fff" (UID: "2d83394e-b7ec-4d15-91f8-e637a6936fff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:41:01.779985 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.779971    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d83394e-b7ec-4d15-91f8-e637a6936fff-extensions-socket-volume\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:41:01.781592 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.781569    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d83394e-b7ec-4d15-91f8-e637a6936fff-kube-api-access-p7shm" (OuterVolumeSpecName: "kube-api-access-p7shm") pod "2d83394e-b7ec-4d15-91f8-e637a6936fff" (UID: "2d83394e-b7ec-4d15-91f8-e637a6936fff"). InnerVolumeSpecName "kube-api-access-p7shm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:41:01.880708 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.880669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6448fbf-4d9e-43da-a475-19b7280872b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7c6d\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.880902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.880746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsrmb\" (UniqueName: \"kubernetes.io/projected/b6448fbf-4d9e-43da-a475-19b7280872b5-kube-api-access-lsrmb\") pod \"kuadrant-operator-controller-manager-86878c769f-v7c6d\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.880902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.880784    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7shm\" (UniqueName: \"kubernetes.io/projected/2d83394e-b7ec-4d15-91f8-e637a6936fff-kube-api-access-p7shm\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:41:01.881079 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.881044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6448fbf-4d9e-43da-a475-19b7280872b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v7c6d\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.889088 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.889056    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsrmb\" (UniqueName: \"kubernetes.io/projected/b6448fbf-4d9e-43da-a475-19b7280872b5-kube-api-access-lsrmb\") pod \"kuadrant-operator-controller-manager-86878c769f-v7c6d\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:01.997141 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:01.997040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:02.125063 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.125038    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"]
Jul 28 19:41:02.128019 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:41:02.127996    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6448fbf_4d9e_43da_a475_19b7280872b5.slice/crio-e24c52d91f0ddab58751e8f9c54a067ec771a335ebfa6f0c29fe8a4a33786581 WatchSource:0}: Error finding container e24c52d91f0ddab58751e8f9c54a067ec771a335ebfa6f0c29fe8a4a33786581: Status 404 returned error can't find the container with id e24c52d91f0ddab58751e8f9c54a067ec771a335ebfa6f0c29fe8a4a33786581
Jul 28 19:41:02.422759 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.422733    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4j9ft"
Jul 28 19:41:02.473759 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.473726    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d" event={"ID":"b6448fbf-4d9e-43da-a475-19b7280872b5","Type":"ContainerStarted","Data":"d4acc9f2ca0bb89c1a6a53ded60662ec1e451c439c13a1a8ffd61b84a2cf78da"}
Jul 28 19:41:02.473934 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.473779    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d" event={"ID":"b6448fbf-4d9e-43da-a475-19b7280872b5","Type":"ContainerStarted","Data":"e24c52d91f0ddab58751e8f9c54a067ec771a335ebfa6f0c29fe8a4a33786581"}
Jul 28 19:41:02.473934 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.473808    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:02.475217 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.475193    2574 generic.go:356] "Generic (PLEG): container finished" podID="2d83394e-b7ec-4d15-91f8-e637a6936fff" containerID="eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741" exitCode=0
Jul 28 19:41:02.475355 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.475229    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m" event={"ID":"2d83394e-b7ec-4d15-91f8-e637a6936fff","Type":"ContainerDied","Data":"eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741"}
Jul 28 19:41:02.475355 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.475271    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m" event={"ID":"2d83394e-b7ec-4d15-91f8-e637a6936fff","Type":"ContainerDied","Data":"3aa59760cb83936fed915dbde5fc11d4f8d77bf55ce7aeb0af2447a23e4e84fd"}
Jul 28 19:41:02.475355 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.475299    2574 scope.go:117] "RemoveContainer" containerID="eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741"
Jul 28 19:41:02.475355 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.475239    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"
Jul 28 19:41:02.493759 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.493740    2574 scope.go:117] "RemoveContainer" containerID="eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741"
Jul 28 19:41:02.494155 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:41:02.494130    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741\": container with ID starting with eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741 not found: ID does not exist" containerID="eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741"
Jul 28 19:41:02.494232 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.494170    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741"} err="failed to get container status \"eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741\": rpc error: code = NotFound desc = could not find container \"eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741\": container with ID starting with eabe3829aa240008bd8b7f75d39b50680c8fbc8eb09056f37c924e243d340741 not found: ID does not exist"
Jul 28 19:41:02.494232 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.494104    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d" podStartSLOduration=1.494087331 podStartE2EDuration="1.494087331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:41:02.491038843 +0000 UTC m=+681.339572311" watchObservedRunningTime="2026-07-28 19:41:02.494087331 +0000 UTC m=+681.342620797"
Jul 28 19:41:02.503786 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.503767    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"]
Jul 28 19:41:02.509624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:02.509603    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9b88m"]
Jul 28 19:41:03.710262 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:03.710227    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d83394e-b7ec-4d15-91f8-e637a6936fff" path="/var/lib/kubelet/pods/2d83394e-b7ec-4d15-91f8-e637a6936fff/volumes"
Jul 28 19:41:13.483894 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:13.483866    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:41:13.531386 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:13.531338    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"]
Jul 28 19:41:13.531697 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:13.531650    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc" podUID="0a7308d2-f86c-4fb8-a4b1-0849b9745e30" containerName="manager" containerID="cri-o://15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84" gracePeriod=10
Jul 28 19:41:14.348357 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.348331    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:41:14.397061 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.397036    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7m87\" (UniqueName: \"kubernetes.io/projected/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-kube-api-access-w7m87\") pod \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") "
Jul 28 19:41:14.397216 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.397198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-extensions-socket-volume\") pod \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\" (UID: \"0a7308d2-f86c-4fb8-a4b1-0849b9745e30\") "
Jul 28 19:41:14.397549 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.397528    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a7308d2-f86c-4fb8-a4b1-0849b9745e30" (UID: "0a7308d2-f86c-4fb8-a4b1-0849b9745e30"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:41:14.399098 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.399067    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-kube-api-access-w7m87" (OuterVolumeSpecName: "kube-api-access-w7m87") pod "0a7308d2-f86c-4fb8-a4b1-0849b9745e30" (UID: "0a7308d2-f86c-4fb8-a4b1-0849b9745e30"). InnerVolumeSpecName "kube-api-access-w7m87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:41:14.498737 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.498660    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-extensions-socket-volume\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:41:14.498737 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.498688    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7m87\" (UniqueName: \"kubernetes.io/projected/0a7308d2-f86c-4fb8-a4b1-0849b9745e30-kube-api-access-w7m87\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:41:14.540755 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.540720    2574 generic.go:356] "Generic (PLEG): container finished" podID="0a7308d2-f86c-4fb8-a4b1-0849b9745e30" containerID="15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84" exitCode=0
Jul 28 19:41:14.540940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.540762    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"
Jul 28 19:41:14.540940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.540811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc" event={"ID":"0a7308d2-f86c-4fb8-a4b1-0849b9745e30","Type":"ContainerDied","Data":"15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84"}
Jul 28 19:41:14.540940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.540871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc" event={"ID":"0a7308d2-f86c-4fb8-a4b1-0849b9745e30","Type":"ContainerDied","Data":"377ac466c4a92af3107e67ba28518332dedbfa666a838f35f5497de16b2ccb53"}
Jul 28 19:41:14.540940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.540904    2574 scope.go:117] "RemoveContainer" containerID="15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84"
Jul 28 19:41:14.549959 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.549942    2574 scope.go:117] "RemoveContainer" containerID="15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84"
Jul 28 19:41:14.550196 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:41:14.550178    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84\": container with ID starting with 15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84 not found: ID does not exist" containerID="15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84"
Jul 28 19:41:14.550240 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.550204    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84"} err="failed to get container status \"15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84\": rpc error: code = NotFound desc = could not find container \"15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84\": container with ID starting with 15c29c7db4107507b5deff17229691b78fa8f42707b69bfba223e11a38107d84 not found: ID does not exist"
Jul 28 19:41:14.564919 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.564893    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"]
Jul 28 19:41:14.569252 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:14.569232    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tj2rc"]
Jul 28 19:41:15.709926 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:15.709891    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7308d2-f86c-4fb8-a4b1-0849b9745e30" path="/var/lib/kubelet/pods/0a7308d2-f86c-4fb8-a4b1-0849b9745e30/volumes"
Jul 28 19:41:33.489460 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489379    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:33.489851 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489765    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d83394e-b7ec-4d15-91f8-e637a6936fff" containerName="manager"
Jul 28 19:41:33.489851 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489777    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d83394e-b7ec-4d15-91f8-e637a6936fff" containerName="manager"
Jul 28 19:41:33.489851 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489790    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7308d2-f86c-4fb8-a4b1-0849b9745e30" containerName="manager"
Jul 28 19:41:33.489851 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489796    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7308d2-f86c-4fb8-a4b1-0849b9745e30" containerName="manager"
Jul 28 19:41:33.489851 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489850    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d83394e-b7ec-4d15-91f8-e637a6936fff" containerName="manager"
Jul 28 19:41:33.490008 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.489859    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7308d2-f86c-4fb8-a4b1-0849b9745e30" containerName="manager"
Jul 28 19:41:33.510533 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.510491    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:33.510717 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.510613    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.513300 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.513275    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 19:41:33.579567 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.579522    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:33.665736 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.665699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbd674c9-7125-4257-bd20-d5fb97df3743-config-file\") pod \"limitador-limitador-64c94fd64f-5qvnx\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.665894 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.665840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg94m\" (UniqueName: \"kubernetes.io/projected/bbd674c9-7125-4257-bd20-d5fb97df3743-kube-api-access-mg94m\") pod \"limitador-limitador-64c94fd64f-5qvnx\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.767232 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.767146    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbd674c9-7125-4257-bd20-d5fb97df3743-config-file\") pod \"limitador-limitador-64c94fd64f-5qvnx\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.767409 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.767235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg94m\" (UniqueName: \"kubernetes.io/projected/bbd674c9-7125-4257-bd20-d5fb97df3743-kube-api-access-mg94m\") pod \"limitador-limitador-64c94fd64f-5qvnx\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.767800 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.767782    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbd674c9-7125-4257-bd20-d5fb97df3743-config-file\") pod \"limitador-limitador-64c94fd64f-5qvnx\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.775480 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.775455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg94m\" (UniqueName: \"kubernetes.io/projected/bbd674c9-7125-4257-bd20-d5fb97df3743-kube-api-access-mg94m\") pod \"limitador-limitador-64c94fd64f-5qvnx\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.821222 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.821187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:33.874705 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.874269    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:41:33.879229 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.879149    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:33.884739 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.884633    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:41:33.916331 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.916214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:41:33.964469 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.964446    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:33.966913 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:41:33.966884    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd674c9_7125_4257_bd20_d5fb97df3743.slice/crio-93f5f6f9dc88ddb528411233a62d283e823c9b21400d6f37a8744426820c0e02 WatchSource:0}: Error finding container 93f5f6f9dc88ddb528411233a62d283e823c9b21400d6f37a8744426820c0e02: Status 404 returned error can't find the container with id 93f5f6f9dc88ddb528411233a62d283e823c9b21400d6f37a8744426820c0e02
Jul 28 19:41:33.968705 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.968679    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjffd\" (UniqueName: \"kubernetes.io/projected/aa634361-e37f-4c87-9d74-dbbf508ce132-kube-api-access-sjffd\") pod \"limitador-limitador-54d6d988d5-t9vzd\" (UID: \"aa634361-e37f-4c87-9d74-dbbf508ce132\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:33.968871 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:33.968811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa634361-e37f-4c87-9d74-dbbf508ce132-config-file\") pod \"limitador-limitador-54d6d988d5-t9vzd\" (UID: \"aa634361-e37f-4c87-9d74-dbbf508ce132\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:34.069483 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.069408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjffd\" (UniqueName: \"kubernetes.io/projected/aa634361-e37f-4c87-9d74-dbbf508ce132-kube-api-access-sjffd\") pod \"limitador-limitador-54d6d988d5-t9vzd\" (UID: \"aa634361-e37f-4c87-9d74-dbbf508ce132\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:34.069615 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.069577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa634361-e37f-4c87-9d74-dbbf508ce132-config-file\") pod \"limitador-limitador-54d6d988d5-t9vzd\" (UID: \"aa634361-e37f-4c87-9d74-dbbf508ce132\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:34.070171 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.070152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa634361-e37f-4c87-9d74-dbbf508ce132-config-file\") pod \"limitador-limitador-54d6d988d5-t9vzd\" (UID: \"aa634361-e37f-4c87-9d74-dbbf508ce132\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:34.077466 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.077444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjffd\" (UniqueName: \"kubernetes.io/projected/aa634361-e37f-4c87-9d74-dbbf508ce132-kube-api-access-sjffd\") pod \"limitador-limitador-54d6d988d5-t9vzd\" (UID: \"aa634361-e37f-4c87-9d74-dbbf508ce132\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:34.196861 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.196827    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:34.340222 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.340181    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:41:34.343104 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:41:34.343073    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa634361_e37f_4c87_9d74_dbbf508ce132.slice/crio-331035dc67ae7ad470baa1ee2a6c9b3d84339cc777f48025d9efd8c88e55c8e6 WatchSource:0}: Error finding container 331035dc67ae7ad470baa1ee2a6c9b3d84339cc777f48025d9efd8c88e55c8e6: Status 404 returned error can't find the container with id 331035dc67ae7ad470baa1ee2a6c9b3d84339cc777f48025d9efd8c88e55c8e6
Jul 28 19:41:34.644571 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.644535    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx" event={"ID":"bbd674c9-7125-4257-bd20-d5fb97df3743","Type":"ContainerStarted","Data":"93f5f6f9dc88ddb528411233a62d283e823c9b21400d6f37a8744426820c0e02"}
Jul 28 19:41:34.645787 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:34.645761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd" event={"ID":"aa634361-e37f-4c87-9d74-dbbf508ce132","Type":"ContainerStarted","Data":"331035dc67ae7ad470baa1ee2a6c9b3d84339cc777f48025d9efd8c88e55c8e6"}
Jul 28 19:41:37.668983 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:37.668943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx" event={"ID":"bbd674c9-7125-4257-bd20-d5fb97df3743","Type":"ContainerStarted","Data":"8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94"}
Jul 28 19:41:37.669491 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:37.669005    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:37.670459 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:37.670437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd" event={"ID":"aa634361-e37f-4c87-9d74-dbbf508ce132","Type":"ContainerStarted","Data":"a3a947729e50b2d4537dbbc0cadf7dd3fef9a051e619c2019c96382f1eebf908"}
Jul 28 19:41:37.670584 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:37.670568    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:37.685661 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:37.685617    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx" podStartSLOduration=1.616913917 podStartE2EDuration="4.685604812s" totalImagesPullingTime="3.068690895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:41:37.684470962 +0000 UTC m=+716.533004442" watchObservedRunningTime="2026-07-28 19:41:37.685604812 +0000 UTC m=+716.534138279"
Jul 28 19:41:37.701782 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:37.701738    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd" podStartSLOduration=2.017739843 podStartE2EDuration="4.701725795s" totalImagesPullingTime="2.683985952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:41:37.699649309 +0000 UTC m=+716.548182780" watchObservedRunningTime="2026-07-28 19:41:37.701725795 +0000 UTC m=+716.550259262"
Jul 28 19:41:48.676692 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:48.676656    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"
Jul 28 19:41:48.677174 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:48.676741    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:48.735744 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:48.735712    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:48.735914 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:48.735886    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx" podUID="bbd674c9-7125-4257-bd20-d5fb97df3743" containerName="limitador" containerID="cri-o://8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94" gracePeriod=30
Jul 28 19:41:49.695084 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.695055    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:49.730654 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.730620    2574 generic.go:356] "Generic (PLEG): container finished" podID="bbd674c9-7125-4257-bd20-d5fb97df3743" containerID="8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94" exitCode=0
Jul 28 19:41:49.730654 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.730651    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"
Jul 28 19:41:49.730853 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.730665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx" event={"ID":"bbd674c9-7125-4257-bd20-d5fb97df3743","Type":"ContainerDied","Data":"8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94"}
Jul 28 19:41:49.730853 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.730718    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5qvnx" event={"ID":"bbd674c9-7125-4257-bd20-d5fb97df3743","Type":"ContainerDied","Data":"93f5f6f9dc88ddb528411233a62d283e823c9b21400d6f37a8744426820c0e02"}
Jul 28 19:41:49.730853 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.730751    2574 scope.go:117] "RemoveContainer" containerID="8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94"
Jul 28 19:41:49.739661 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.739534    2574 scope.go:117] "RemoveContainer" containerID="8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94"
Jul 28 19:41:49.739848 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:41:49.739829    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94\": container with ID starting with 8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94 not found: ID does not exist" containerID="8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94"
Jul 28 19:41:49.739919 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.739858    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94"} err="failed to get container status \"8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94\": rpc error: code = NotFound desc = could not find container \"8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94\": container with ID starting with 8315c7433bbb2b0819af9cc2925c1b9347bdf8e3f059bdd78370023c70db8b94 not found: ID does not exist"
Jul 28 19:41:49.801123 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.801029    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg94m\" (UniqueName: \"kubernetes.io/projected/bbd674c9-7125-4257-bd20-d5fb97df3743-kube-api-access-mg94m\") pod \"bbd674c9-7125-4257-bd20-d5fb97df3743\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") "
Jul 28 19:41:49.801290 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.801142    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbd674c9-7125-4257-bd20-d5fb97df3743-config-file\") pod \"bbd674c9-7125-4257-bd20-d5fb97df3743\" (UID: \"bbd674c9-7125-4257-bd20-d5fb97df3743\") "
Jul 28 19:41:49.801523 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.801501    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd674c9-7125-4257-bd20-d5fb97df3743-config-file" (OuterVolumeSpecName: "config-file") pod "bbd674c9-7125-4257-bd20-d5fb97df3743" (UID: "bbd674c9-7125-4257-bd20-d5fb97df3743"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:41:49.803144 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.803117    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd674c9-7125-4257-bd20-d5fb97df3743-kube-api-access-mg94m" (OuterVolumeSpecName: "kube-api-access-mg94m") pod "bbd674c9-7125-4257-bd20-d5fb97df3743" (UID: "bbd674c9-7125-4257-bd20-d5fb97df3743"). InnerVolumeSpecName "kube-api-access-mg94m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:41:49.902787 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.902744    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbd674c9-7125-4257-bd20-d5fb97df3743-config-file\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:41:49.902787 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:49.902779    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg94m\" (UniqueName: \"kubernetes.io/projected/bbd674c9-7125-4257-bd20-d5fb97df3743-kube-api-access-mg94m\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:41:50.051897 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:50.051817    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:50.053714 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:50.053694    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5qvnx"]
Jul 28 19:41:51.709595 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:41:51.709559    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd674c9-7125-4257-bd20-d5fb97df3743" path="/var/lib/kubelet/pods/bbd674c9-7125-4257-bd20-d5fb97df3743/volumes"
Jul 28 19:42:03.660094 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.660061    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r72m"]
Jul 28 19:42:03.660517 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.660491    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd674c9-7125-4257-bd20-d5fb97df3743" containerName="limitador"
Jul 28 19:42:03.660517 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.660505    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd674c9-7125-4257-bd20-d5fb97df3743" containerName="limitador"
Jul 28 19:42:03.660600 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.660578    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd674c9-7125-4257-bd20-d5fb97df3743" containerName="limitador"
Jul 28 19:42:03.664939 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.664921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:03.667744 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.667643    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-494lb\""
Jul 28 19:42:03.670549 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.670526    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r72m"]
Jul 28 19:42:03.736383 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.736338    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpnfj\" (UniqueName: \"kubernetes.io/projected/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a-kube-api-access-jpnfj\") pod \"authorino-5d4b67c446-6r72m\" (UID: \"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a\") " pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:03.837357 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.837327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpnfj\" (UniqueName: \"kubernetes.io/projected/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a-kube-api-access-jpnfj\") pod \"authorino-5d4b67c446-6r72m\" (UID: \"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a\") " pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:03.845249 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.845223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpnfj\" (UniqueName: \"kubernetes.io/projected/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a-kube-api-access-jpnfj\") pod \"authorino-5d4b67c446-6r72m\" (UID: \"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a\") " pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:03.888054 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.888016    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r72m"]
Jul 28 19:42:03.888281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:03.888268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:04.021168 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.021135    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r72m"]
Jul 28 19:42:04.024449 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:42:04.024422    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf69abb7_a22e_4de7_920b_8d27d9a8ce4a.slice/crio-ceb081d8d110350ca333f33701dc3576ad4f8620faa0eb7db273f4bc5142687b WatchSource:0}: Error finding container ceb081d8d110350ca333f33701dc3576ad4f8620faa0eb7db273f4bc5142687b: Status 404 returned error can't find the container with id ceb081d8d110350ca333f33701dc3576ad4f8620faa0eb7db273f4bc5142687b
Jul 28 19:42:04.060452 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.060423    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8597844ff-hthmc"]
Jul 28 19:42:04.064281 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.064264    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.067060 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.067043    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 19:42:04.073465 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.073443    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8597844ff-hthmc"]
Jul 28 19:42:04.140575 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.140542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hdcf\" (UniqueName: \"kubernetes.io/projected/be6032b9-2dbe-4038-a4b4-149c10a52337-kube-api-access-9hdcf\") pod \"authorino-8597844ff-hthmc\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") " pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.140758 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.140603    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be6032b9-2dbe-4038-a4b4-149c10a52337-tls-cert\") pod \"authorino-8597844ff-hthmc\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") " pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.242017 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.241918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be6032b9-2dbe-4038-a4b4-149c10a52337-tls-cert\") pod \"authorino-8597844ff-hthmc\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") " pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.242188 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.242022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hdcf\" (UniqueName: \"kubernetes.io/projected/be6032b9-2dbe-4038-a4b4-149c10a52337-kube-api-access-9hdcf\") pod \"authorino-8597844ff-hthmc\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") " pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.244283 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.244250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be6032b9-2dbe-4038-a4b4-149c10a52337-tls-cert\") pod \"authorino-8597844ff-hthmc\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") " pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.250739 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.250716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hdcf\" (UniqueName: \"kubernetes.io/projected/be6032b9-2dbe-4038-a4b4-149c10a52337-kube-api-access-9hdcf\") pod \"authorino-8597844ff-hthmc\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") " pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.373912 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.373877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:42:04.509386 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.509342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8597844ff-hthmc"]
Jul 28 19:42:04.511554 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:42:04.511523    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe6032b9_2dbe_4038_a4b4_149c10a52337.slice/crio-8c7f25975f36de500441907162fdc95e9dd519f003185078ab2bd5052b129d9c WatchSource:0}: Error finding container 8c7f25975f36de500441907162fdc95e9dd519f003185078ab2bd5052b129d9c: Status 404 returned error can't find the container with id 8c7f25975f36de500441907162fdc95e9dd519f003185078ab2bd5052b129d9c
Jul 28 19:42:04.810049 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.809939    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r72m" event={"ID":"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a","Type":"ContainerStarted","Data":"ceb081d8d110350ca333f33701dc3576ad4f8620faa0eb7db273f4bc5142687b"}
Jul 28 19:42:04.811718 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:04.811686    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8597844ff-hthmc" event={"ID":"be6032b9-2dbe-4038-a4b4-149c10a52337","Type":"ContainerStarted","Data":"8c7f25975f36de500441907162fdc95e9dd519f003185078ab2bd5052b129d9c"}
Jul 28 19:42:07.832990 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:07.832896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r72m" event={"ID":"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a","Type":"ContainerStarted","Data":"c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7"}
Jul 28 19:42:07.833478 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:07.832960    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6r72m" podUID="cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" containerName="authorino" containerID="cri-o://c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7" gracePeriod=30
Jul 28 19:42:07.834581 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:07.834554    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8597844ff-hthmc" event={"ID":"be6032b9-2dbe-4038-a4b4-149c10a52337","Type":"ContainerStarted","Data":"79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a"}
Jul 28 19:42:07.847854 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:07.847811    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6r72m" podStartSLOduration=1.419576911 podStartE2EDuration="4.847794596s" totalImagesPullingTime="3.428217685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:42:07.846593547 +0000 UTC m=+746.695127014" watchObservedRunningTime="2026-07-28 19:42:07.847794596 +0000 UTC m=+746.696328063"
Jul 28 19:42:07.860608 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:07.860570    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8597844ff-hthmc" podStartSLOduration=0.937279334 podStartE2EDuration="3.860556179s" totalImagesPullingTime="2.923276845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:42:07.860043033 +0000 UTC m=+746.708576503" watchObservedRunningTime="2026-07-28 19:42:07.860556179 +0000 UTC m=+746.709089646"
Jul 28 19:42:08.072937 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.072911    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:08.178661 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.178622    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpnfj\" (UniqueName: \"kubernetes.io/projected/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a-kube-api-access-jpnfj\") pod \"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a\" (UID: \"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a\") "
Jul 28 19:42:08.180740 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.180710    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a-kube-api-access-jpnfj" (OuterVolumeSpecName: "kube-api-access-jpnfj") pod "cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" (UID: "cf69abb7-a22e-4de7-920b-8d27d9a8ce4a"). InnerVolumeSpecName "kube-api-access-jpnfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:42:08.279902 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.279863    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpnfj\" (UniqueName: \"kubernetes.io/projected/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a-kube-api-access-jpnfj\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:42:08.841624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.841532    2574 generic.go:356] "Generic (PLEG): container finished" podID="cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" containerID="c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7" exitCode=0
Jul 28 19:42:08.841624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.841581    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6r72m"
Jul 28 19:42:08.841624 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.841614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r72m" event={"ID":"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a","Type":"ContainerDied","Data":"c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7"}
Jul 28 19:42:08.842201 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.841651    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6r72m" event={"ID":"cf69abb7-a22e-4de7-920b-8d27d9a8ce4a","Type":"ContainerDied","Data":"ceb081d8d110350ca333f33701dc3576ad4f8620faa0eb7db273f4bc5142687b"}
Jul 28 19:42:08.842201 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.841669    2574 scope.go:117] "RemoveContainer" containerID="c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7"
Jul 28 19:42:08.850549 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.850518    2574 scope.go:117] "RemoveContainer" containerID="c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7"
Jul 28 19:42:08.850848 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:42:08.850826    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7\": container with ID starting with c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7 not found: ID does not exist" containerID="c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7"
Jul 28 19:42:08.850925 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.850854    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7"} err="failed to get container status \"c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7\": rpc error: code = NotFound desc = could not find container \"c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7\": container with ID starting with c3c0441760ca9f43f977963329904cd6cc7025a1ff8e7b04ef8be3eb23599fc7 not found: ID does not exist"
Jul 28 19:42:08.863938 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.863914    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r72m"]
Jul 28 19:42:08.869432 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:08.869412    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6r72m"]
Jul 28 19:42:09.710672 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:09.710641    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" path="/var/lib/kubelet/pods/cf69abb7-a22e-4de7-920b-8d27d9a8ce4a/volumes"
Jul 28 19:42:49.447960 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:42:49.447921    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:43:06.070585 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.070503    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"]
Jul 28 19:43:06.071125 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.071109    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" containerName="authorino"
Jul 28 19:43:06.071169 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.071128    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" containerName="authorino"
Jul 28 19:43:06.071231 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.071220    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf69abb7-a22e-4de7-920b-8d27d9a8ce4a" containerName="authorino"
Jul 28 19:43:06.073904 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.073880    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.078061 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.078039    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-csdqr\""
Jul 28 19:43:06.078193 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.078071    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 19:43:06.078193 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.078115    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 19:43:06.078193 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.078160    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 19:43:06.081493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.081349    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"]
Jul 28 19:43:06.112041 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.112000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.112041 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.112039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa541f41-856c-41d7-8e9a-b01f90f64e1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.112302 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.112135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.112302 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.112160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.112302 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.112181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h29v\" (UniqueName: \"kubernetes.io/projected/aa541f41-856c-41d7-8e9a-b01f90f64e1b-kube-api-access-7h29v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.112302 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.112277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213185 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213185 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h29v\" (UniqueName: \"kubernetes.io/projected/aa541f41-856c-41d7-8e9a-b01f90f64e1b-kube-api-access-7h29v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213307    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa541f41-856c-41d7-8e9a-b01f90f64e1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213677    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213718    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.213844 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.213766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.215621 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.215604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa541f41-856c-41d7-8e9a-b01f90f64e1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.215778 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.215763    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa541f41-856c-41d7-8e9a-b01f90f64e1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.221397 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.221356    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h29v\" (UniqueName: \"kubernetes.io/projected/aa541f41-856c-41d7-8e9a-b01f90f64e1b-kube-api-access-7h29v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw\" (UID: \"aa541f41-856c-41d7-8e9a-b01f90f64e1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.385344 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.385312    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:06.524148 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.524121    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"]
Jul 28 19:43:06.525923 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:43:06.525896    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa541f41_856c_41d7_8e9a_b01f90f64e1b.slice/crio-482821e98fabacf524afaaa41262a6e19b2ccb636dd9fe064310a5aa237e4b1d WatchSource:0}: Error finding container 482821e98fabacf524afaaa41262a6e19b2ccb636dd9fe064310a5aa237e4b1d: Status 404 returned error can't find the container with id 482821e98fabacf524afaaa41262a6e19b2ccb636dd9fe064310a5aa237e4b1d
Jul 28 19:43:06.584475 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:06.584436    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:43:07.137436 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:07.137392    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw" event={"ID":"aa541f41-856c-41d7-8e9a-b01f90f64e1b","Type":"ContainerStarted","Data":"482821e98fabacf524afaaa41262a6e19b2ccb636dd9fe064310a5aa237e4b1d"}
Jul 28 19:43:08.144989 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:08.144914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw" event={"ID":"aa541f41-856c-41d7-8e9a-b01f90f64e1b","Type":"ContainerStarted","Data":"2b9d74332097875888154b1c10499f5cc605b9fa711d9abd0c79c01b4b5d2dd8"}
Jul 28 19:43:08.162609 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:08.162561    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw" podStartSLOduration=1.08909505 podStartE2EDuration="2.162522305s" totalImagesPullingTime="1.073427255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:43:08.161675304 +0000 UTC m=+807.010208764" watchObservedRunningTime="2026-07-28 19:43:08.162522305 +0000 UTC m=+807.011055772"
Jul 28 19:43:16.385671 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:16.385636    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:16.386224 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:16.385716    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:16.397855 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:16.397829    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:17.202737 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:17.202712    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw"
Jul 28 19:43:22.290690 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:22.290632    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:43:47.158634 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.158601    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"]
Jul 28 19:43:47.161460 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.161439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.165341 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.165323    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 19:43:47.186894 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.186861    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"]
Jul 28 19:43:47.289266 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.289224    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rpn\" (UniqueName: \"kubernetes.io/projected/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-kube-api-access-j2rpn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.289455 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.289299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.289455 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.289342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.289455 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.289390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.289455 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.289454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.289613 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.289473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390403 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rpn\" (UniqueName: \"kubernetes.io/projected/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-kube-api-access-j2rpn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390403 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390646 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390900 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.390977 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390907    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.391033 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.390982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.392691 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.392670    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.392948 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.392930    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.398439 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.398417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rpn\" (UniqueName: \"kubernetes.io/projected/de3c7fd9-eb22-42fa-a92a-91e2c79c5d91-kube-api-access-j2rpn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dcbjc\" (UID: \"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.478874 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.478782    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:47.616298 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.616270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"]
Jul 28 19:43:47.617620 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:43:47.617596    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3c7fd9_eb22_42fa_a92a_91e2c79c5d91.slice/crio-44b67ec807eb2d5c66cd7167071daf8b4faf0c35cc27950cb0ef350eaeaa5c00 WatchSource:0}: Error finding container 44b67ec807eb2d5c66cd7167071daf8b4faf0c35cc27950cb0ef350eaeaa5c00: Status 404 returned error can't find the container with id 44b67ec807eb2d5c66cd7167071daf8b4faf0c35cc27950cb0ef350eaeaa5c00
Jul 28 19:43:47.881919 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:47.881891    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:43:48.350598 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:48.350559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc" event={"ID":"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91","Type":"ContainerStarted","Data":"56ac2ea99cd0b6cf11229f9a8153bc36e5218e4b9d5fa6003751399bcd76d141"}
Jul 28 19:43:48.350990 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:48.350617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc" event={"ID":"de3c7fd9-eb22-42fa-a92a-91e2c79c5d91","Type":"ContainerStarted","Data":"44b67ec807eb2d5c66cd7167071daf8b4faf0c35cc27950cb0ef350eaeaa5c00"}
Jul 28 19:43:48.372769 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:48.372717    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc" podStartSLOduration=1.176031401 podStartE2EDuration="1.372700769s" totalImagesPullingTime="196.669368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:43:48.370727874 +0000 UTC m=+847.219261366" watchObservedRunningTime="2026-07-28 19:43:48.372700769 +0000 UTC m=+847.221234236"
Jul 28 19:43:57.479748 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:57.479709    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:57.480147 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:57.479774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:57.492431 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:57.492407    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:43:58.414201 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:43:58.414167    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dcbjc"
Jul 28 19:44:35.388936 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:44:35.388851    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:44:42.985982 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:44:42.985938    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:44:53.286667 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:44:53.286629    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:45:57.654477 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.654447    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85789b8d98-qgw5v"]
Jul 28 19:45:57.658115 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.658099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.664550 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.664527    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85789b8d98-qgw5v"]
Jul 28 19:45:57.788421 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.788352    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9q98\" (UniqueName: \"kubernetes.io/projected/18b8199e-6071-449e-9c09-1bfb0a92a801-kube-api-access-b9q98\") pod \"authorino-85789b8d98-qgw5v\" (UID: \"18b8199e-6071-449e-9c09-1bfb0a92a801\") " pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.788602 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.788484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18b8199e-6071-449e-9c09-1bfb0a92a801-tls-cert\") pod \"authorino-85789b8d98-qgw5v\" (UID: \"18b8199e-6071-449e-9c09-1bfb0a92a801\") " pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.889304 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.889264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9q98\" (UniqueName: \"kubernetes.io/projected/18b8199e-6071-449e-9c09-1bfb0a92a801-kube-api-access-b9q98\") pod \"authorino-85789b8d98-qgw5v\" (UID: \"18b8199e-6071-449e-9c09-1bfb0a92a801\") " pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.889493 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.889322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18b8199e-6071-449e-9c09-1bfb0a92a801-tls-cert\") pod \"authorino-85789b8d98-qgw5v\" (UID: \"18b8199e-6071-449e-9c09-1bfb0a92a801\") " pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.891760 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.891741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18b8199e-6071-449e-9c09-1bfb0a92a801-tls-cert\") pod \"authorino-85789b8d98-qgw5v\" (UID: \"18b8199e-6071-449e-9c09-1bfb0a92a801\") " pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.897308 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.897284    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9q98\" (UniqueName: \"kubernetes.io/projected/18b8199e-6071-449e-9c09-1bfb0a92a801-kube-api-access-b9q98\") pod \"authorino-85789b8d98-qgw5v\" (UID: \"18b8199e-6071-449e-9c09-1bfb0a92a801\") " pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:57.968017 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:57.967926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85789b8d98-qgw5v"
Jul 28 19:45:58.097214 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:58.097190    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85789b8d98-qgw5v"]
Jul 28 19:45:58.099156 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:45:58.099125    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18b8199e_6071_449e_9c09_1bfb0a92a801.slice/crio-8bfd60403937f9eb88bfea5770d60b76f119ee751e8748743203bde27ff0c409 WatchSource:0}: Error finding container 8bfd60403937f9eb88bfea5770d60b76f119ee751e8748743203bde27ff0c409: Status 404 returned error can't find the container with id 8bfd60403937f9eb88bfea5770d60b76f119ee751e8748743203bde27ff0c409
Jul 28 19:45:58.100666 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:58.100648    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:45:59.017071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.017027    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85789b8d98-qgw5v" event={"ID":"18b8199e-6071-449e-9c09-1bfb0a92a801","Type":"ContainerStarted","Data":"f915a74ccfbd911775e85c752f7bcc9d5a7146eef98585dbc1b0f9d8fd64a117"}
Jul 28 19:45:59.017071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.017074    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85789b8d98-qgw5v" event={"ID":"18b8199e-6071-449e-9c09-1bfb0a92a801","Type":"ContainerStarted","Data":"8bfd60403937f9eb88bfea5770d60b76f119ee751e8748743203bde27ff0c409"}
Jul 28 19:45:59.033492 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.033432    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85789b8d98-qgw5v" podStartSLOduration=1.623171464 podStartE2EDuration="2.033414951s" totalImagesPullingTime="410.243487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:45:59.032071013 +0000 UTC m=+977.880604483" watchObservedRunningTime="2026-07-28 19:45:59.033414951 +0000 UTC m=+977.881948418"
Jul 28 19:45:59.059265 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.059226    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8597844ff-hthmc"]
Jul 28 19:45:59.059495 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.059459    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8597844ff-hthmc" podUID="be6032b9-2dbe-4038-a4b4-149c10a52337" containerName="authorino" containerID="cri-o://79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a" gracePeriod=30
Jul 28 19:45:59.331892 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.331863    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:45:59.503666 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.503630    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be6032b9-2dbe-4038-a4b4-149c10a52337-tls-cert\") pod \"be6032b9-2dbe-4038-a4b4-149c10a52337\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") "
Jul 28 19:45:59.503859 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.503681    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hdcf\" (UniqueName: \"kubernetes.io/projected/be6032b9-2dbe-4038-a4b4-149c10a52337-kube-api-access-9hdcf\") pod \"be6032b9-2dbe-4038-a4b4-149c10a52337\" (UID: \"be6032b9-2dbe-4038-a4b4-149c10a52337\") "
Jul 28 19:45:59.505752 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.505718    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6032b9-2dbe-4038-a4b4-149c10a52337-kube-api-access-9hdcf" (OuterVolumeSpecName: "kube-api-access-9hdcf") pod "be6032b9-2dbe-4038-a4b4-149c10a52337" (UID: "be6032b9-2dbe-4038-a4b4-149c10a52337"). InnerVolumeSpecName "kube-api-access-9hdcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:45:59.515882 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.515848    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be6032b9-2dbe-4038-a4b4-149c10a52337-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "be6032b9-2dbe-4038-a4b4-149c10a52337" (UID: "be6032b9-2dbe-4038-a4b4-149c10a52337"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:45:59.604527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.604497    2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be6032b9-2dbe-4038-a4b4-149c10a52337-tls-cert\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:45:59.604527 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:45:59.604526    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hdcf\" (UniqueName: \"kubernetes.io/projected/be6032b9-2dbe-4038-a4b4-149c10a52337-kube-api-access-9hdcf\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:46:00.025015 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.024980    2574 generic.go:356] "Generic (PLEG): container finished" podID="be6032b9-2dbe-4038-a4b4-149c10a52337" containerID="79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a" exitCode=0
Jul 28 19:46:00.025490 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.025023    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8597844ff-hthmc"
Jul 28 19:46:00.025490 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.025083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8597844ff-hthmc" event={"ID":"be6032b9-2dbe-4038-a4b4-149c10a52337","Type":"ContainerDied","Data":"79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a"}
Jul 28 19:46:00.025490 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.025124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8597844ff-hthmc" event={"ID":"be6032b9-2dbe-4038-a4b4-149c10a52337","Type":"ContainerDied","Data":"8c7f25975f36de500441907162fdc95e9dd519f003185078ab2bd5052b129d9c"}
Jul 28 19:46:00.025490 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.025144    2574 scope.go:117] "RemoveContainer" containerID="79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a"
Jul 28 19:46:00.035345 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.035323    2574 scope.go:117] "RemoveContainer" containerID="79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a"
Jul 28 19:46:00.035719 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:46:00.035700    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a\": container with ID starting with 79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a not found: ID does not exist" containerID="79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a"
Jul 28 19:46:00.035796 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.035733    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a"} err="failed to get container status \"79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a\": rpc error: code = NotFound desc = could not find container \"79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a\": container with ID starting with 79943bcaeb98b2e454a22e933a351ad7c2e75fc944f807e7fbd6000d60b0c29a not found: ID does not exist"
Jul 28 19:46:00.043695 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.043664    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8597844ff-hthmc"]
Jul 28 19:46:00.050028 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:00.050004    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8597844ff-hthmc"]
Jul 28 19:46:01.714724 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:01.714687    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be6032b9-2dbe-4038-a4b4-149c10a52337" path="/var/lib/kubelet/pods/be6032b9-2dbe-4038-a4b4-149c10a52337/volumes"
Jul 28 19:46:28.291343 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:28.291297    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:46:38.287696 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:38.287658    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:46:50.097209 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:46:50.097177    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:48:30.395151 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:48:30.395110    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:48:44.282081 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:48:44.282044    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:49:22.890534 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:49:22.890500    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:49:32.832739 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:49:32.832686    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:49:43.185915 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:49:43.185878    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:49:49.406671 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:49:49.406634    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:50:00.696332 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:50:00.696298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:50:10.683395 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:50:10.683344    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:50:21.503637 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:50:21.503593    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:50:31.703215 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:50:31.703172    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:50:53.400163 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:50:53.400081    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:51:05.091612 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:51:05.091572    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:51:27.882455 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:51:27.882420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:51:39.488093 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:51:39.488050    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:51:50.087137 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:51:50.087105    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:52:07.194246 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:52:07.194163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:52:16.933035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:52:16.932989    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:52:27.286920 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:52:27.286881    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:52:36.491518 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:52:36.491473    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:52:46.487217 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:52:46.487181    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:53:12.128050 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:12.128012    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"]
Jul 28 19:53:12.128651 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:12.128270    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d" podUID="b6448fbf-4d9e-43da-a475-19b7280872b5" containerName="manager" containerID="cri-o://d4acc9f2ca0bb89c1a6a53ded60662ec1e451c439c13a1a8ffd61b84a2cf78da" gracePeriod=10
Jul 28 19:53:16.315186 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.315096    2574 generic.go:356] "Generic (PLEG): container finished" podID="b6448fbf-4d9e-43da-a475-19b7280872b5" containerID="d4acc9f2ca0bb89c1a6a53ded60662ec1e451c439c13a1a8ffd61b84a2cf78da" exitCode=0
Jul 28 19:53:16.315186 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.315166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d" event={"ID":"b6448fbf-4d9e-43da-a475-19b7280872b5","Type":"ContainerDied","Data":"d4acc9f2ca0bb89c1a6a53ded60662ec1e451c439c13a1a8ffd61b84a2cf78da"}
Jul 28 19:53:16.585435 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.585409    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:53:16.686957 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.686920    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6448fbf-4d9e-43da-a475-19b7280872b5-extensions-socket-volume\") pod \"b6448fbf-4d9e-43da-a475-19b7280872b5\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") "
Jul 28 19:53:16.687141 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.686981    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsrmb\" (UniqueName: \"kubernetes.io/projected/b6448fbf-4d9e-43da-a475-19b7280872b5-kube-api-access-lsrmb\") pod \"b6448fbf-4d9e-43da-a475-19b7280872b5\" (UID: \"b6448fbf-4d9e-43da-a475-19b7280872b5\") "
Jul 28 19:53:16.687405 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.687357    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6448fbf-4d9e-43da-a475-19b7280872b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b6448fbf-4d9e-43da-a475-19b7280872b5" (UID: "b6448fbf-4d9e-43da-a475-19b7280872b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:53:16.689067 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.689049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6448fbf-4d9e-43da-a475-19b7280872b5-kube-api-access-lsrmb" (OuterVolumeSpecName: "kube-api-access-lsrmb") pod "b6448fbf-4d9e-43da-a475-19b7280872b5" (UID: "b6448fbf-4d9e-43da-a475-19b7280872b5"). InnerVolumeSpecName "kube-api-access-lsrmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:53:16.788177 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.788140    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6448fbf-4d9e-43da-a475-19b7280872b5-extensions-socket-volume\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:53:16.788177 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:16.788170    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsrmb\" (UniqueName: \"kubernetes.io/projected/b6448fbf-4d9e-43da-a475-19b7280872b5-kube-api-access-lsrmb\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:53:17.321539 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:17.321502    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d" event={"ID":"b6448fbf-4d9e-43da-a475-19b7280872b5","Type":"ContainerDied","Data":"e24c52d91f0ddab58751e8f9c54a067ec771a335ebfa6f0c29fe8a4a33786581"}
Jul 28 19:53:17.321539 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:17.321527    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"
Jul 28 19:53:17.322068 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:17.321564    2574 scope.go:117] "RemoveContainer" containerID="d4acc9f2ca0bb89c1a6a53ded60662ec1e451c439c13a1a8ffd61b84a2cf78da"
Jul 28 19:53:17.343755 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:17.343733    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"]
Jul 28 19:53:17.349621 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:17.349599    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v7c6d"]
Jul 28 19:53:17.709905 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:53:17.709872    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6448fbf-4d9e-43da-a475-19b7280872b5" path="/var/lib/kubelet/pods/b6448fbf-4d9e-43da-a475-19b7280872b5/volumes"
Jul 28 19:54:13.255147 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255115    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"]
Jul 28 19:54:13.255633 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255555    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6448fbf-4d9e-43da-a475-19b7280872b5" containerName="manager"
Jul 28 19:54:13.255633 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255567    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6448fbf-4d9e-43da-a475-19b7280872b5" containerName="manager"
Jul 28 19:54:13.255633 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255585    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6032b9-2dbe-4038-a4b4-149c10a52337" containerName="authorino"
Jul 28 19:54:13.255633 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255590    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6032b9-2dbe-4038-a4b4-149c10a52337" containerName="authorino"
Jul 28 19:54:13.255768 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255655    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="be6032b9-2dbe-4038-a4b4-149c10a52337" containerName="authorino"
Jul 28 19:54:13.255768 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.255667    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6448fbf-4d9e-43da-a475-19b7280872b5" containerName="manager"
Jul 28 19:54:13.258613 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.258598    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.261384 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.261344    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dhx6n\""
Jul 28 19:54:13.271537 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.271515    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"]
Jul 28 19:54:13.393301 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.393272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swglw\" (UniqueName: \"kubernetes.io/projected/c72824e3-f84d-4f30-a8ce-1e9bc075dcd2-kube-api-access-swglw\") pod \"kuadrant-operator-controller-manager-86878c769f-qtcgg\" (UID: \"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.393460 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.393403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72824e3-f84d-4f30-a8ce-1e9bc075dcd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qtcgg\" (UID: \"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.494438 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.494403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swglw\" (UniqueName: \"kubernetes.io/projected/c72824e3-f84d-4f30-a8ce-1e9bc075dcd2-kube-api-access-swglw\") pod \"kuadrant-operator-controller-manager-86878c769f-qtcgg\" (UID: \"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.494601 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.494509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72824e3-f84d-4f30-a8ce-1e9bc075dcd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qtcgg\" (UID: \"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.494883 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.494864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72824e3-f84d-4f30-a8ce-1e9bc075dcd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qtcgg\" (UID: \"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.503867 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.503841    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swglw\" (UniqueName: \"kubernetes.io/projected/c72824e3-f84d-4f30-a8ce-1e9bc075dcd2-kube-api-access-swglw\") pod \"kuadrant-operator-controller-manager-86878c769f-qtcgg\" (UID: \"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.568981 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.568915    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:13.716610 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:13.716583    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"]
Jul 28 19:54:13.718327 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:54:13.718301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72824e3_f84d_4f30_a8ce_1e9bc075dcd2.slice/crio-afe5136927d0d1e7a2f056dea2b8d3144c45d3ae7399fa070d07bb5f61b61826 WatchSource:0}: Error finding container afe5136927d0d1e7a2f056dea2b8d3144c45d3ae7399fa070d07bb5f61b61826: Status 404 returned error can't find the container with id afe5136927d0d1e7a2f056dea2b8d3144c45d3ae7399fa070d07bb5f61b61826
Jul 28 19:54:14.620047 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:14.620013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg" event={"ID":"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2","Type":"ContainerStarted","Data":"e99ba41e91a7edab8cd47873bf99e3faf2e8184b64ecb00771eef877005129eb"}
Jul 28 19:54:14.620583 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:14.620062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg" event={"ID":"c72824e3-f84d-4f30-a8ce-1e9bc075dcd2","Type":"ContainerStarted","Data":"afe5136927d0d1e7a2f056dea2b8d3144c45d3ae7399fa070d07bb5f61b61826"}
Jul 28 19:54:14.620583 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:14.620151    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:14.643559 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:14.643515    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg" podStartSLOduration=1.643500226 podStartE2EDuration="1.643500226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:14.641405223 +0000 UTC m=+1473.489938692" watchObservedRunningTime="2026-07-28 19:54:14.643500226 +0000 UTC m=+1473.492033745"
Jul 28 19:54:25.628461 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:25.628421    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qtcgg"
Jul 28 19:54:34.499856 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:34.499820    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:54:43.981945 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:54:43.981911    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:55:00.193959 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:55:00.193921    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:55:10.383216 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:55:10.383183    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:55:22.184771 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:55:22.184733    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:55:29.895159 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:55:29.895123    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:55:41.183644 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:55:41.183612    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:55:52.089940 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:55:52.089907    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:56:00.087035 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:56:00.086995    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:56:11.585210 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:56:11.585167    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:56:24.694071 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:56:24.694032    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:56:34.592149 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:56:34.592071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:56:51.288096 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:56:51.288056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:56:59.282962 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:56:59.282920    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:57:11.688050 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:11.688016    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:57:18.904268 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:18.904233    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"]
Jul 28 19:57:18.907912 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:18.907892    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:18.910958 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:18.910937    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-6e7e0dcd-kserve-self-signed-certs\""
Jul 28 19:57:18.920895 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:18.920870    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"]
Jul 28 19:57:19.014447 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.014411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-home\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.014447 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.014444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f2b518-e596-42c9-89a4-4551ac73267a-tls-certs\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.014651 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.014468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-model-cache\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.014651 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.014486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-tmp-dir\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.014651 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.014556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-dshm\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.014651 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.014623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htzkz\" (UniqueName: \"kubernetes.io/projected/b3f2b518-e596-42c9-89a4-4551ac73267a-kube-api-access-htzkz\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.115939 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.115905    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-home\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.115939 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.115939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f2b518-e596-42c9-89a4-4551ac73267a-tls-certs\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116189 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.115957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-model-cache\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116189 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.115975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-tmp-dir\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116189 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.116000    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-dshm\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116189 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.116052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htzkz\" (UniqueName: \"kubernetes.io/projected/b3f2b518-e596-42c9-89a4-4551ac73267a-kube-api-access-htzkz\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116626 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.116406    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-home\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116626 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.116457    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-model-cache\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.116626 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.116481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-tmp-dir\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.118307 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.118286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-dshm\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.118485 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.118468    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f2b518-e596-42c9-89a4-4551ac73267a-tls-certs\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.124085 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.124065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htzkz\" (UniqueName: \"kubernetes.io/projected/b3f2b518-e596-42c9-89a4-4551ac73267a-kube-api-access-htzkz\") pod \"e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") " pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.217637 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.217551    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:19.356964 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.356933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"]
Jul 28 19:57:19.358822 ip-10-0-137-245 kubenswrapper[2574]: W0728 19:57:19.358797    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3f2b518_e596_42c9_89a4_4551ac73267a.slice/crio-cc30b5142ac8c91035625b5aec46bb51f1a14e55bf0da7edb1ed217be1b4c058 WatchSource:0}: Error finding container cc30b5142ac8c91035625b5aec46bb51f1a14e55bf0da7edb1ed217be1b4c058: Status 404 returned error can't find the container with id cc30b5142ac8c91035625b5aec46bb51f1a14e55bf0da7edb1ed217be1b4c058
Jul 28 19:57:19.591145 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.591050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84" event={"ID":"b3f2b518-e596-42c9-89a4-4551ac73267a","Type":"ContainerStarted","Data":"ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260"}
Jul 28 19:57:19.591145 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.591101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84" event={"ID":"b3f2b518-e596-42c9-89a4-4551ac73267a","Type":"ContainerStarted","Data":"cc30b5142ac8c91035625b5aec46bb51f1a14e55bf0da7edb1ed217be1b4c058"}
Jul 28 19:57:19.609103 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:19.609051    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84" podStartSLOduration=1.609032128 podStartE2EDuration="1.609032128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:57:19.607493693 +0000 UTC m=+1658.456027161" watchObservedRunningTime="2026-07-28 19:57:19.609032128 +0000 UTC m=+1658.457565593"
Jul 28 19:57:23.693376 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:23.693318    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:57:29.218346 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:29.218304    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:29.218346 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:29.218358    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:29.232500 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:29.232474    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:29.655483 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:29.655448    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:57:59.779933 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:57:59.779899    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"]
Jul 28 19:58:02.921442 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:02.921328    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:58:14.800329 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:14.800255    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84" podUID="b3f2b518-e596-42c9-89a4-4551ac73267a" containerName="main" containerID="cri-o://ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260" gracePeriod=45
Jul 28 19:58:15.061781 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.061719    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:58:15.155579 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155545    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-home\") pod \"b3f2b518-e596-42c9-89a4-4551ac73267a\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") "
Jul 28 19:58:15.155767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155593    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htzkz\" (UniqueName: \"kubernetes.io/projected/b3f2b518-e596-42c9-89a4-4551ac73267a-kube-api-access-htzkz\") pod \"b3f2b518-e596-42c9-89a4-4551ac73267a\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") "
Jul 28 19:58:15.155767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155649    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f2b518-e596-42c9-89a4-4551ac73267a-tls-certs\") pod \"b3f2b518-e596-42c9-89a4-4551ac73267a\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") "
Jul 28 19:58:15.155767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155707    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-model-cache\") pod \"b3f2b518-e596-42c9-89a4-4551ac73267a\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") "
Jul 28 19:58:15.155767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155731    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-tmp-dir\") pod \"b3f2b518-e596-42c9-89a4-4551ac73267a\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") "
Jul 28 19:58:15.155767 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155755    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-dshm\") pod \"b3f2b518-e596-42c9-89a4-4551ac73267a\" (UID: \"b3f2b518-e596-42c9-89a4-4551ac73267a\") "
Jul 28 19:58:15.156040 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155858    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-home" (OuterVolumeSpecName: "home") pod "b3f2b518-e596-42c9-89a4-4551ac73267a" (UID: "b3f2b518-e596-42c9-89a4-4551ac73267a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:58:15.156040 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.155986    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3f2b518-e596-42c9-89a4-4551ac73267a" (UID: "b3f2b518-e596-42c9-89a4-4551ac73267a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:58:15.156040 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.156001    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3f2b518-e596-42c9-89a4-4551ac73267a" (UID: "b3f2b518-e596-42c9-89a4-4551ac73267a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:58:15.156173 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.156162    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-model-cache\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.156233 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.156180    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-tmp-dir\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.156233 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.156189    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-home\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.158013 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.157979    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-dshm" (OuterVolumeSpecName: "dshm") pod "b3f2b518-e596-42c9-89a4-4551ac73267a" (UID: "b3f2b518-e596-42c9-89a4-4551ac73267a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:58:15.158139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.158041    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f2b518-e596-42c9-89a4-4551ac73267a-kube-api-access-htzkz" (OuterVolumeSpecName: "kube-api-access-htzkz") pod "b3f2b518-e596-42c9-89a4-4551ac73267a" (UID: "b3f2b518-e596-42c9-89a4-4551ac73267a"). InnerVolumeSpecName "kube-api-access-htzkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:58:15.158139 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.158056    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3f2b518-e596-42c9-89a4-4551ac73267a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3f2b518-e596-42c9-89a4-4551ac73267a" (UID: "b3f2b518-e596-42c9-89a4-4551ac73267a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:58:15.256667 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.256633    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htzkz\" (UniqueName: \"kubernetes.io/projected/b3f2b518-e596-42c9-89a4-4551ac73267a-kube-api-access-htzkz\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.256667 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.256662    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f2b518-e596-42c9-89a4-4551ac73267a-tls-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.256667 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.256671    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f2b518-e596-42c9-89a4-4551ac73267a-dshm\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.907429 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.907397    2574 generic.go:356] "Generic (PLEG): container finished" podID="b3f2b518-e596-42c9-89a4-4551ac73267a" containerID="ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260" exitCode=0
Jul 28 19:58:15.907909 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.907456    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84" event={"ID":"b3f2b518-e596-42c9-89a4-4551ac73267a","Type":"ContainerDied","Data":"ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260"}
Jul 28 19:58:15.907909 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.907466    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"
Jul 28 19:58:15.907909 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.907501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84" event={"ID":"b3f2b518-e596-42c9-89a4-4551ac73267a","Type":"ContainerDied","Data":"cc30b5142ac8c91035625b5aec46bb51f1a14e55bf0da7edb1ed217be1b4c058"}
Jul 28 19:58:15.907909 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.907521    2574 scope.go:117] "RemoveContainer" containerID="ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260"
Jul 28 19:58:15.916440 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.916420    2574 scope.go:117] "RemoveContainer" containerID="ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260"
Jul 28 19:58:15.916717 ip-10-0-137-245 kubenswrapper[2574]: E0728 19:58:15.916698    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260\": container with ID starting with ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260 not found: ID does not exist" containerID="ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260"
Jul 28 19:58:15.916788 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.916730    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260"} err="failed to get container status \"ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260\": rpc error: code = NotFound desc = could not find container \"ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260\": container with ID starting with ad44617190d209c1e18816b4e9e0f7432b3eaaa1d26e875cdf5b255f771b2260 not found: ID does not exist"
Jul 28 19:58:15.934926 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.934897    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"]
Jul 28 19:58:15.947705 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:15.947679    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-6e7e0dcd-kserve-f6fb8d46c-7tc84"]
Jul 28 19:58:17.711079 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:17.711042    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3f2b518-e596-42c9-89a4-4551ac73267a" path="/var/lib/kubelet/pods/b3f2b518-e596-42c9-89a4-4551ac73267a/volumes"
Jul 28 19:58:17.711481 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:17.711315    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:58:28.200955 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:28.200920    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:58:39.987420 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:39.987386    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:58:55.000470 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:58:55.000427    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:59:04.497978 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:59:04.497937    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:59:18.201554 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:59:18.201513    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:59:27.784221 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:59:27.784183    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:59:40.994160 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:59:40.994125    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:59:49.987318 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:59:49.987281    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 19:59:59.793328 ip-10-0-137-245 kubenswrapper[2574]: I0728 19:59:59.793290    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:00:12.489785 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:00:12.489746    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:00:24.505292 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:00:24.499140    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:00:32.493567 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:00:32.493526    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:00:45.883118 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:00:45.883076    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:00:57.688507 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:00:57.688467    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:01:11.386556 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:11.386518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:01:20.692120 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:20.692079    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:01:41.496294 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:41.496253    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:01:54.604221 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.604183    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"]
Jul 28 20:01:54.604750 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.604680    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3f2b518-e596-42c9-89a4-4551ac73267a" containerName="main"
Jul 28 20:01:54.604750 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.604694    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f2b518-e596-42c9-89a4-4551ac73267a" containerName="main"
Jul 28 20:01:54.604825 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.604773    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3f2b518-e596-42c9-89a4-4551ac73267a" containerName="main"
Jul 28 20:01:54.607821 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.607804    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.612106 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.612083    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:01:54.612106 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.612101    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:01:54.612318 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.612082    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:01:54.612318 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.612083    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8a457bc8-serving-cert\""
Jul 28 20:01:54.618604 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.618579    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"]
Jul 28 20:01:54.709830 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.709782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf858d0d-f918-4a8e-a8da-98b6792f863d-openshift-service-ca\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.709830 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.709828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmmg\" (UniqueName: \"kubernetes.io/projected/cf858d0d-f918-4a8e-a8da-98b6792f863d-kube-api-access-8cmmg\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.710067 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.709960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf858d0d-f918-4a8e-a8da-98b6792f863d-maas-api-tls\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.810896 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.810834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf858d0d-f918-4a8e-a8da-98b6792f863d-openshift-service-ca\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.810896 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.810897    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmmg\" (UniqueName: \"kubernetes.io/projected/cf858d0d-f918-4a8e-a8da-98b6792f863d-kube-api-access-8cmmg\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.811131 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.810993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf858d0d-f918-4a8e-a8da-98b6792f863d-maas-api-tls\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.811538 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.811517    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf858d0d-f918-4a8e-a8da-98b6792f863d-openshift-service-ca\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.813468 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.813447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf858d0d-f918-4a8e-a8da-98b6792f863d-maas-api-tls\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.819872 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.819844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmmg\" (UniqueName: \"kubernetes.io/projected/cf858d0d-f918-4a8e-a8da-98b6792f863d-kube-api-access-8cmmg\") pod \"maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:54.919756 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:54.919666    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:55.064989 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:55.064713    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"]
Jul 28 20:01:55.069048 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:01:55.069019    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf858d0d_f918_4a8e_a8da_98b6792f863d.slice/crio-d4ae7155e83ba06d87069ca559ccb7953fac65d0398d1244010bd3d9a94ffb28 WatchSource:0}: Error finding container d4ae7155e83ba06d87069ca559ccb7953fac65d0398d1244010bd3d9a94ffb28: Status 404 returned error can't find the container with id d4ae7155e83ba06d87069ca559ccb7953fac65d0398d1244010bd3d9a94ffb28
Jul 28 20:01:55.070679 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:55.070657    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:01:56.072488 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:56.072441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn" event={"ID":"cf858d0d-f918-4a8e-a8da-98b6792f863d","Type":"ContainerStarted","Data":"d4ae7155e83ba06d87069ca559ccb7953fac65d0398d1244010bd3d9a94ffb28"}
Jul 28 20:01:58.084189 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:58.084154    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn" event={"ID":"cf858d0d-f918-4a8e-a8da-98b6792f863d","Type":"ContainerStarted","Data":"675907c186227c3eecc2745cf980c080ce3d52cd2334d728fe15d8b5873dc934"}
Jul 28 20:01:58.084612 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:58.084241    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:01:58.101710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:58.101659    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn" podStartSLOduration=1.773044853 podStartE2EDuration="4.101642154s" totalImagesPullingTime="2.328597301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:01:58.100478791 +0000 UTC m=+1936.949012261" watchObservedRunningTime="2026-07-28 20:01:58.101642154 +0000 UTC m=+1936.950175620"
Jul 28 20:01:58.683860 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:01:58.683824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:02:04.095280 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:04.095252    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:02:35.133538 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.133320    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"]
Jul 28 20:02:35.135055 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.134214    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn" podUID="cf858d0d-f918-4a8e-a8da-98b6792f863d" containerName="maas-api" containerID="cri-o://675907c186227c3eecc2745cf980c080ce3d52cd2334d728fe15d8b5873dc934" gracePeriod=30
Jul 28 20:02:35.282839 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.282801    2574 generic.go:356] "Generic (PLEG): container finished" podID="cf858d0d-f918-4a8e-a8da-98b6792f863d" containerID="675907c186227c3eecc2745cf980c080ce3d52cd2334d728fe15d8b5873dc934" exitCode=0
Jul 28 20:02:35.283009 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.282875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn" event={"ID":"cf858d0d-f918-4a8e-a8da-98b6792f863d","Type":"ContainerDied","Data":"675907c186227c3eecc2745cf980c080ce3d52cd2334d728fe15d8b5873dc934"}
Jul 28 20:02:35.395774 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.395707    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:02:35.490485 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.490449    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cmmg\" (UniqueName: \"kubernetes.io/projected/cf858d0d-f918-4a8e-a8da-98b6792f863d-kube-api-access-8cmmg\") pod \"cf858d0d-f918-4a8e-a8da-98b6792f863d\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") "
Jul 28 20:02:35.490673 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.490498    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf858d0d-f918-4a8e-a8da-98b6792f863d-openshift-service-ca\") pod \"cf858d0d-f918-4a8e-a8da-98b6792f863d\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") "
Jul 28 20:02:35.490673 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.490576    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf858d0d-f918-4a8e-a8da-98b6792f863d-maas-api-tls\") pod \"cf858d0d-f918-4a8e-a8da-98b6792f863d\" (UID: \"cf858d0d-f918-4a8e-a8da-98b6792f863d\") "
Jul 28 20:02:35.490899 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.490872    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf858d0d-f918-4a8e-a8da-98b6792f863d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf858d0d-f918-4a8e-a8da-98b6792f863d" (UID: "cf858d0d-f918-4a8e-a8da-98b6792f863d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:02:35.493236 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.493208    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf858d0d-f918-4a8e-a8da-98b6792f863d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf858d0d-f918-4a8e-a8da-98b6792f863d" (UID: "cf858d0d-f918-4a8e-a8da-98b6792f863d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:02:35.493405 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.493264    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf858d0d-f918-4a8e-a8da-98b6792f863d-kube-api-access-8cmmg" (OuterVolumeSpecName: "kube-api-access-8cmmg") pod "cf858d0d-f918-4a8e-a8da-98b6792f863d" (UID: "cf858d0d-f918-4a8e-a8da-98b6792f863d"). InnerVolumeSpecName "kube-api-access-8cmmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:02:35.591774 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.591731    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cmmg\" (UniqueName: \"kubernetes.io/projected/cf858d0d-f918-4a8e-a8da-98b6792f863d-kube-api-access-8cmmg\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:02:35.591774 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.591766    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf858d0d-f918-4a8e-a8da-98b6792f863d-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:02:35.591774 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:35.591777    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf858d0d-f918-4a8e-a8da-98b6792f863d-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:02:36.288998 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:36.288969    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"
Jul 28 20:02:36.288998 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:36.288984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn" event={"ID":"cf858d0d-f918-4a8e-a8da-98b6792f863d","Type":"ContainerDied","Data":"d4ae7155e83ba06d87069ca559ccb7953fac65d0398d1244010bd3d9a94ffb28"}
Jul 28 20:02:36.289557 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:36.289044    2574 scope.go:117] "RemoveContainer" containerID="675907c186227c3eecc2745cf980c080ce3d52cd2334d728fe15d8b5873dc934"
Jul 28 20:02:36.306864 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:36.306835    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"]
Jul 28 20:02:36.310700 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:36.310670    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8a457bc8-bb97676cc-5qcdn"]
Jul 28 20:02:37.709847 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:37.709810    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf858d0d-f918-4a8e-a8da-98b6792f863d" path="/var/lib/kubelet/pods/cf858d0d-f918-4a8e-a8da-98b6792f863d/volumes"
Jul 28 20:02:38.861484 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.861450    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"]
Jul 28 20:02:38.861934 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.861918    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf858d0d-f918-4a8e-a8da-98b6792f863d" containerName="maas-api"
Jul 28 20:02:38.861979 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.861936    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf858d0d-f918-4a8e-a8da-98b6792f863d" containerName="maas-api"
Jul 28 20:02:38.862029 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.862018    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf858d0d-f918-4a8e-a8da-98b6792f863d" containerName="maas-api"
Jul 28 20:02:38.866709 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.866689    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:38.869741 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.869721    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b2dba1e2-serving-cert\""
Jul 28 20:02:38.869741 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.869733    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:02:38.869925 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.869887    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:02:38.871327 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.871306    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:02:38.874084 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.874060    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"]
Jul 28 20:02:38.923232 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.923193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b4890-f06d-4545-92be-55b8d9cfa9f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:38.923232 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.923231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrm7f\" (UniqueName: \"kubernetes.io/projected/d38b4890-f06d-4545-92be-55b8d9cfa9f8-kube-api-access-qrm7f\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:38.923482 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:38.923257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.024873 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.024836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b4890-f06d-4545-92be-55b8d9cfa9f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.024873 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.024873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrm7f\" (UniqueName: \"kubernetes.io/projected/d38b4890-f06d-4545-92be-55b8d9cfa9f8-kube-api-access-qrm7f\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.025149 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.024899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.025149 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:02:39.024997    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-serving-cert: secret "maas-api-e2e-migrate-b2dba1e2-serving-cert" not found
Jul 28 20:02:39.025149 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:02:39.025067    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls podName:d38b4890-f06d-4545-92be-55b8d9cfa9f8 nodeName:}" failed. No retries permitted until 2026-07-28 20:02:39.525048887 +0000 UTC m=+1978.373582348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls") pod "maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" (UID: "d38b4890-f06d-4545-92be-55b8d9cfa9f8") : secret "maas-api-e2e-migrate-b2dba1e2-serving-cert" not found
Jul 28 20:02:39.025648 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.025624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b4890-f06d-4545-92be-55b8d9cfa9f8-openshift-service-ca\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.036151 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.036123    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrm7f\" (UniqueName: \"kubernetes.io/projected/d38b4890-f06d-4545-92be-55b8d9cfa9f8-kube-api-access-qrm7f\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.286042 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.285958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:02:39.530423 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.530357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.533199 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.533167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls\") pod \"maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.778418 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.778355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:39.918164 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:39.918137    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"]
Jul 28 20:02:39.920637 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:02:39.920608    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38b4890_f06d_4545_92be_55b8d9cfa9f8.slice/crio-de96088f81759cfa1fe1bd781429f594cce37379ec58c8efea9bcbd7a795cb67 WatchSource:0}: Error finding container de96088f81759cfa1fe1bd781429f594cce37379ec58c8efea9bcbd7a795cb67: Status 404 returned error can't find the container with id de96088f81759cfa1fe1bd781429f594cce37379ec58c8efea9bcbd7a795cb67
Jul 28 20:02:40.312164 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:40.312128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" event={"ID":"d38b4890-f06d-4545-92be-55b8d9cfa9f8","Type":"ContainerStarted","Data":"de96088f81759cfa1fe1bd781429f594cce37379ec58c8efea9bcbd7a795cb67"}
Jul 28 20:02:42.323239 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:42.323203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" event={"ID":"d38b4890-f06d-4545-92be-55b8d9cfa9f8","Type":"ContainerStarted","Data":"5d946a26d34b72868dd2d13a277da9f07ad13a67cd3b2337d3091a2a2902fb1f"}
Jul 28 20:02:42.323689 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:42.323301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:42.340240 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:42.340189    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" podStartSLOduration=2.638730457 podStartE2EDuration="4.34017165s" totalImagesPullingTime="1.701441193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:02:42.339896217 +0000 UTC m=+1981.188429679" watchObservedRunningTime="2026-07-28 20:02:42.34017165 +0000 UTC m=+1981.188705117"
Jul 28 20:02:48.333601 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:48.333568    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:02:49.390492 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:02:49.390454    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:03:10.244879 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.244831    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"]
Jul 28 20:03:10.245487 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.245139    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" podUID="d38b4890-f06d-4545-92be-55b8d9cfa9f8" containerName="maas-api" containerID="cri-o://5d946a26d34b72868dd2d13a277da9f07ad13a67cd3b2337d3091a2a2902fb1f" gracePeriod=30
Jul 28 20:03:10.472583 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.472550    2574 generic.go:356] "Generic (PLEG): container finished" podID="d38b4890-f06d-4545-92be-55b8d9cfa9f8" containerID="5d946a26d34b72868dd2d13a277da9f07ad13a67cd3b2337d3091a2a2902fb1f" exitCode=0
Jul 28 20:03:10.472780 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.472620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" event={"ID":"d38b4890-f06d-4545-92be-55b8d9cfa9f8","Type":"ContainerDied","Data":"5d946a26d34b72868dd2d13a277da9f07ad13a67cd3b2337d3091a2a2902fb1f"}
Jul 28 20:03:10.498729 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.498677    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:03:10.527128 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.527103    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b4890-f06d-4545-92be-55b8d9cfa9f8-openshift-service-ca\") pod \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") "
Jul 28 20:03:10.527309 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.527185    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls\") pod \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") "
Jul 28 20:03:10.527309 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.527234    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrm7f\" (UniqueName: \"kubernetes.io/projected/d38b4890-f06d-4545-92be-55b8d9cfa9f8-kube-api-access-qrm7f\") pod \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\" (UID: \"d38b4890-f06d-4545-92be-55b8d9cfa9f8\") "
Jul 28 20:03:10.527481 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.527441    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d38b4890-f06d-4545-92be-55b8d9cfa9f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d38b4890-f06d-4545-92be-55b8d9cfa9f8" (UID: "d38b4890-f06d-4545-92be-55b8d9cfa9f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:10.529430 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.529395    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d38b4890-f06d-4545-92be-55b8d9cfa9f8" (UID: "d38b4890-f06d-4545-92be-55b8d9cfa9f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:03:10.529552 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.529515    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38b4890-f06d-4545-92be-55b8d9cfa9f8-kube-api-access-qrm7f" (OuterVolumeSpecName: "kube-api-access-qrm7f") pod "d38b4890-f06d-4545-92be-55b8d9cfa9f8" (UID: "d38b4890-f06d-4545-92be-55b8d9cfa9f8"). InnerVolumeSpecName "kube-api-access-qrm7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:10.629040 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.628994    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d38b4890-f06d-4545-92be-55b8d9cfa9f8-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:03:10.629040 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.629035    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrm7f\" (UniqueName: \"kubernetes.io/projected/d38b4890-f06d-4545-92be-55b8d9cfa9f8-kube-api-access-qrm7f\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:03:10.629312 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:10.629050    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d38b4890-f06d-4545-92be-55b8d9cfa9f8-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:03:11.479664 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:11.479633    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"
Jul 28 20:03:11.480167 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:11.479633    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b" event={"ID":"d38b4890-f06d-4545-92be-55b8d9cfa9f8","Type":"ContainerDied","Data":"de96088f81759cfa1fe1bd781429f594cce37379ec58c8efea9bcbd7a795cb67"}
Jul 28 20:03:11.480167 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:11.479762    2574 scope.go:117] "RemoveContainer" containerID="5d946a26d34b72868dd2d13a277da9f07ad13a67cd3b2337d3091a2a2902fb1f"
Jul 28 20:03:11.505120 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:11.505090    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"]
Jul 28 20:03:11.510896 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:11.510871    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b2dba1e2-7b6fdf9c7-9wr9b"]
Jul 28 20:03:11.709946 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:11.709904    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38b4890-f06d-4545-92be-55b8d9cfa9f8" path="/var/lib/kubelet/pods/d38b4890-f06d-4545-92be-55b8d9cfa9f8/volumes"
Jul 28 20:03:13.880569 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.880540    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"]
Jul 28 20:03:13.880947 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.880937    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38b4890-f06d-4545-92be-55b8d9cfa9f8" containerName="maas-api"
Jul 28 20:03:13.880989 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.880948    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38b4890-f06d-4545-92be-55b8d9cfa9f8" containerName="maas-api"
Jul 28 20:03:13.881036 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.881026    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38b4890-f06d-4545-92be-55b8d9cfa9f8" containerName="maas-api"
Jul 28 20:03:13.883775 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.883759    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:13.886639 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.886619    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aaa64e88-serving-cert\""
Jul 28 20:03:13.886639 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.886627    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:03:13.886902 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.886887    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:03:13.887947 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.887933    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:03:13.893345 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.893323    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"]
Jul 28 20:03:13.959849 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.959811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78796042-1b52-43c8-a902-799c5ec3a1a4-maas-api-tls\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:13.959849 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.959853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78796042-1b52-43c8-a902-799c5ec3a1a4-openshift-service-ca\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:13.960066 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:13.959991    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qcw6\" (UniqueName: \"kubernetes.io/projected/78796042-1b52-43c8-a902-799c5ec3a1a4-kube-api-access-8qcw6\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.060459 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.060423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qcw6\" (UniqueName: \"kubernetes.io/projected/78796042-1b52-43c8-a902-799c5ec3a1a4-kube-api-access-8qcw6\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.060616 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.060477    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78796042-1b52-43c8-a902-799c5ec3a1a4-maas-api-tls\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.060616 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.060503    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78796042-1b52-43c8-a902-799c5ec3a1a4-openshift-service-ca\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.061111 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.061087    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78796042-1b52-43c8-a902-799c5ec3a1a4-openshift-service-ca\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.062835 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.062808    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78796042-1b52-43c8-a902-799c5ec3a1a4-maas-api-tls\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.068901 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.068874    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qcw6\" (UniqueName: \"kubernetes.io/projected/78796042-1b52-43c8-a902-799c5ec3a1a4-kube-api-access-8qcw6\") pod \"maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.195672 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.195580    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:14.340407 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.333933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"]
Jul 28 20:03:14.488456 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.488376    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:03:14.498386 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:14.498327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p" event={"ID":"78796042-1b52-43c8-a902-799c5ec3a1a4","Type":"ContainerStarted","Data":"787f7b5ff798a3b56374ecc4af2eb4ad904bdc56d7622c7404aba1ffa47205a5"}
Jul 28 20:03:15.505189 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:15.505146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p" event={"ID":"78796042-1b52-43c8-a902-799c5ec3a1a4","Type":"ContainerStarted","Data":"a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c"}
Jul 28 20:03:15.505613 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:15.505286    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:15.523058 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:15.523006    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p" podStartSLOduration=2.090895484 podStartE2EDuration="2.522993899s" totalImagesPullingTime="432.098415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:15.521766014 +0000 UTC m=+2014.370299481" watchObservedRunningTime="2026-07-28 20:03:15.522993899 +0000 UTC m=+2014.371527344"
Jul 28 20:03:21.516548 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:21.516514    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:23.286230 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:23.286192    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:03:44.611619 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:44.611583    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"]
Jul 28 20:03:44.612091 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:44.611806    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p" podUID="78796042-1b52-43c8-a902-799c5ec3a1a4" containerName="maas-api" containerID="cri-o://a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c" gracePeriod=30
Jul 28 20:03:44.887959 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:44.887928    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:45.061190 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.061150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qcw6\" (UniqueName: \"kubernetes.io/projected/78796042-1b52-43c8-a902-799c5ec3a1a4-kube-api-access-8qcw6\") pod \"78796042-1b52-43c8-a902-799c5ec3a1a4\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") "
Jul 28 20:03:45.061405 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.061271    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78796042-1b52-43c8-a902-799c5ec3a1a4-maas-api-tls\") pod \"78796042-1b52-43c8-a902-799c5ec3a1a4\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") "
Jul 28 20:03:45.061405 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.061342    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78796042-1b52-43c8-a902-799c5ec3a1a4-openshift-service-ca\") pod \"78796042-1b52-43c8-a902-799c5ec3a1a4\" (UID: \"78796042-1b52-43c8-a902-799c5ec3a1a4\") "
Jul 28 20:03:45.061701 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.061673    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78796042-1b52-43c8-a902-799c5ec3a1a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78796042-1b52-43c8-a902-799c5ec3a1a4" (UID: "78796042-1b52-43c8-a902-799c5ec3a1a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:03:45.063347 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.063322    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78796042-1b52-43c8-a902-799c5ec3a1a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78796042-1b52-43c8-a902-799c5ec3a1a4" (UID: "78796042-1b52-43c8-a902-799c5ec3a1a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:03:45.063667 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.063641    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78796042-1b52-43c8-a902-799c5ec3a1a4-kube-api-access-8qcw6" (OuterVolumeSpecName: "kube-api-access-8qcw6") pod "78796042-1b52-43c8-a902-799c5ec3a1a4" (UID: "78796042-1b52-43c8-a902-799c5ec3a1a4"). InnerVolumeSpecName "kube-api-access-8qcw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:03:45.163061 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.162976    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78796042-1b52-43c8-a902-799c5ec3a1a4-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.163061 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.163007    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qcw6\" (UniqueName: \"kubernetes.io/projected/78796042-1b52-43c8-a902-799c5ec3a1a4-kube-api-access-8qcw6\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.163061 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.163018    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78796042-1b52-43c8-a902-799c5ec3a1a4-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:03:45.665909 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.665866    2574 generic.go:356] "Generic (PLEG): container finished" podID="78796042-1b52-43c8-a902-799c5ec3a1a4" containerID="a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c" exitCode=0
Jul 28 20:03:45.666404 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.665916    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"
Jul 28 20:03:45.666404 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.665921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p" event={"ID":"78796042-1b52-43c8-a902-799c5ec3a1a4","Type":"ContainerDied","Data":"a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c"}
Jul 28 20:03:45.666404 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.666053    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p" event={"ID":"78796042-1b52-43c8-a902-799c5ec3a1a4","Type":"ContainerDied","Data":"787f7b5ff798a3b56374ecc4af2eb4ad904bdc56d7622c7404aba1ffa47205a5"}
Jul 28 20:03:45.666404 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.666083    2574 scope.go:117] "RemoveContainer" containerID="a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c"
Jul 28 20:03:45.676774 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.676753    2574 scope.go:117] "RemoveContainer" containerID="a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c"
Jul 28 20:03:45.677042 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:03:45.677024    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c\": container with ID starting with a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c not found: ID does not exist" containerID="a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c"
Jul 28 20:03:45.677103 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.677051    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c"} err="failed to get container status \"a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c\": rpc error: code = NotFound desc = could not find container \"a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c\": container with ID starting with a0d9cc4ae2b2d1755534a2f4405f3d49ac4396b988fce74fa32327d96a72f90c not found: ID does not exist"
Jul 28 20:03:45.688655 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.688627    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"]
Jul 28 20:03:45.694877 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.694855    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aaa64e88-5887967f5c-wdr2p"]
Jul 28 20:03:45.711318 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:45.711278    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78796042-1b52-43c8-a902-799c5ec3a1a4" path="/var/lib/kubelet/pods/78796042-1b52-43c8-a902-799c5ec3a1a4/volumes"
Jul 28 20:03:48.584551 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:48.584517    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:03:49.134778 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.134745    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"]
Jul 28 20:03:49.135281 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.135265    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78796042-1b52-43c8-a902-799c5ec3a1a4" containerName="maas-api"
Jul 28 20:03:49.135334 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.135283    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="78796042-1b52-43c8-a902-799c5ec3a1a4" containerName="maas-api"
Jul 28 20:03:49.135397 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.135388    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="78796042-1b52-43c8-a902-799c5ec3a1a4" containerName="maas-api"
Jul 28 20:03:49.140035 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.140017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.143064 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.143044    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-43e77436-serving-cert\""
Jul 28 20:03:49.143182 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.143136    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:03:49.144246 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.144219    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:03:49.144246 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.144239    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:03:49.149336 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.149314    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"]
Jul 28 20:03:49.196419 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.196382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.196554 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.196467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrf64\" (UniqueName: \"kubernetes.io/projected/0a777891-56bb-49f2-8ddd-e0b9d21318a1-kube-api-access-lrf64\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.196554 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.196495    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a777891-56bb-49f2-8ddd-e0b9d21318a1-openshift-service-ca\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.296967 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.296939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrf64\" (UniqueName: \"kubernetes.io/projected/0a777891-56bb-49f2-8ddd-e0b9d21318a1-kube-api-access-lrf64\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.296967 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.296970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a777891-56bb-49f2-8ddd-e0b9d21318a1-openshift-service-ca\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.297124 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.297028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.297173 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:03:49.297143    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-serving-cert: secret "maas-api-e2e-derive-43e77436-serving-cert" not found
Jul 28 20:03:49.297210 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:03:49.297203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls podName:0a777891-56bb-49f2-8ddd-e0b9d21318a1 nodeName:}" failed. No retries permitted until 2026-07-28 20:03:49.7971869 +0000 UTC m=+2048.645720365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls") pod "maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" (UID: "0a777891-56bb-49f2-8ddd-e0b9d21318a1") : secret "maas-api-e2e-derive-43e77436-serving-cert" not found
Jul 28 20:03:49.297718 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.297699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a777891-56bb-49f2-8ddd-e0b9d21318a1-openshift-service-ca\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.308999 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.308979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrf64\" (UniqueName: \"kubernetes.io/projected/0a777891-56bb-49f2-8ddd-e0b9d21318a1-kube-api-access-lrf64\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.800804 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.800774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:49.803183 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:49.803160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls\") pod \"maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:50.051348 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:50.051269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:50.196867 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:50.196841    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"]
Jul 28 20:03:50.198630 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:03:50.198599    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a777891_56bb_49f2_8ddd_e0b9d21318a1.slice/crio-6b572402d16d0632857fbf27407e8a6baf3305b6269d9f30f7d734557734aa6e WatchSource:0}: Error finding container 6b572402d16d0632857fbf27407e8a6baf3305b6269d9f30f7d734557734aa6e: Status 404 returned error can't find the container with id 6b572402d16d0632857fbf27407e8a6baf3305b6269d9f30f7d734557734aa6e
Jul 28 20:03:50.696024 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:50.695989    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" event={"ID":"0a777891-56bb-49f2-8ddd-e0b9d21318a1","Type":"ContainerStarted","Data":"ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7"}
Jul 28 20:03:50.696189 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:50.696050    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" event={"ID":"0a777891-56bb-49f2-8ddd-e0b9d21318a1","Type":"ContainerStarted","Data":"6b572402d16d0632857fbf27407e8a6baf3305b6269d9f30f7d734557734aa6e"}
Jul 28 20:03:50.696189 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:50.696142    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:50.714647 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:50.714590    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" podStartSLOduration=1.361158777 podStartE2EDuration="1.714573943s" totalImagesPullingTime="353.415166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:50.71279511 +0000 UTC m=+2049.561328578" watchObservedRunningTime="2026-07-28 20:03:50.714573943 +0000 UTC m=+2049.563107412"
Jul 28 20:03:56.708097 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:56.708059    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:03:58.785962 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:03:58.785930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:04:19.758098 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:19.758051    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"]
Jul 28 20:04:19.759059 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:19.759021    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" podUID="0a777891-56bb-49f2-8ddd-e0b9d21318a1" containerName="maas-api" containerID="cri-o://ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7" gracePeriod=30
Jul 28 20:04:20.014472 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.014414    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:04:20.172732 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.172700    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a777891-56bb-49f2-8ddd-e0b9d21318a1-openshift-service-ca\") pod \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") "
Jul 28 20:04:20.172917 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.172759    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls\") pod \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") "
Jul 28 20:04:20.172917 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.172786    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrf64\" (UniqueName: \"kubernetes.io/projected/0a777891-56bb-49f2-8ddd-e0b9d21318a1-kube-api-access-lrf64\") pod \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\" (UID: \"0a777891-56bb-49f2-8ddd-e0b9d21318a1\") "
Jul 28 20:04:20.173060 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.173033    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a777891-56bb-49f2-8ddd-e0b9d21318a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a777891-56bb-49f2-8ddd-e0b9d21318a1" (UID: "0a777891-56bb-49f2-8ddd-e0b9d21318a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:04:20.174976 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.174943    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a777891-56bb-49f2-8ddd-e0b9d21318a1" (UID: "0a777891-56bb-49f2-8ddd-e0b9d21318a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:04:20.174976 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.174956    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a777891-56bb-49f2-8ddd-e0b9d21318a1-kube-api-access-lrf64" (OuterVolumeSpecName: "kube-api-access-lrf64") pod "0a777891-56bb-49f2-8ddd-e0b9d21318a1" (UID: "0a777891-56bb-49f2-8ddd-e0b9d21318a1"). InnerVolumeSpecName "kube-api-access-lrf64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:20.274531 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.274435    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a777891-56bb-49f2-8ddd-e0b9d21318a1-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.274531 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.274470    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a777891-56bb-49f2-8ddd-e0b9d21318a1-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.274531 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.274479    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrf64\" (UniqueName: \"kubernetes.io/projected/0a777891-56bb-49f2-8ddd-e0b9d21318a1-kube-api-access-lrf64\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:04:20.864441 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.864402    2574 generic.go:356] "Generic (PLEG): container finished" podID="0a777891-56bb-49f2-8ddd-e0b9d21318a1" containerID="ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7" exitCode=0
Jul 28 20:04:20.864845 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.864447    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" event={"ID":"0a777891-56bb-49f2-8ddd-e0b9d21318a1","Type":"ContainerDied","Data":"ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7"}
Jul 28 20:04:20.864845 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.864484    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg" event={"ID":"0a777891-56bb-49f2-8ddd-e0b9d21318a1","Type":"ContainerDied","Data":"6b572402d16d0632857fbf27407e8a6baf3305b6269d9f30f7d734557734aa6e"}
Jul 28 20:04:20.864845 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.864506    2574 scope.go:117] "RemoveContainer" containerID="ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7"
Jul 28 20:04:20.864845 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.864449    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"
Jul 28 20:04:20.873763 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.873742    2574 scope.go:117] "RemoveContainer" containerID="ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7"
Jul 28 20:04:20.874055 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:04:20.874028    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7\": container with ID starting with ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7 not found: ID does not exist" containerID="ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7"
Jul 28 20:04:20.874161 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.874068    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7"} err="failed to get container status \"ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7\": rpc error: code = NotFound desc = could not find container \"ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7\": container with ID starting with ea6c7da1437aeb2390d22cc91dfc9ccc8847e88729e40bfcec6614dd0d9d77d7 not found: ID does not exist"
Jul 28 20:04:20.891524 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.891493    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"]
Jul 28 20:04:20.896015 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:20.895993    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-43e77436-69f8dfbc9-gtnhg"]
Jul 28 20:04:21.710337 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:21.710300    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a777891-56bb-49f2-8ddd-e0b9d21318a1" path="/var/lib/kubelet/pods/0a777891-56bb-49f2-8ddd-e0b9d21318a1/volumes"
Jul 28 20:04:23.686799 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:23.686762    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:04:36.018389 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:04:36.018331    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:05:47.389683 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:05:47.389592    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:05:58.586991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:05:58.586953    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:06:07.310042 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.310010    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"]
Jul 28 20:06:07.310443 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.310427    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a777891-56bb-49f2-8ddd-e0b9d21318a1" containerName="maas-api"
Jul 28 20:06:07.310443 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.310440    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a777891-56bb-49f2-8ddd-e0b9d21318a1" containerName="maas-api"
Jul 28 20:06:07.310534 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.310524    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a777891-56bb-49f2-8ddd-e0b9d21318a1" containerName="maas-api"
Jul 28 20:06:07.313756 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.313733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.316917 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.316890    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1ca5d531-serving-cert\""
Jul 28 20:06:07.317047 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.316934    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:06:07.317118 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.317081    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:06:07.318093 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.318073    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:06:07.324573 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.324538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"]
Jul 28 20:06:07.364063 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.364028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.364252 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.364084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dacc7ba-e21d-4241-a387-3d4af94f7ace-openshift-service-ca\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.364252 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.364126    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw8bb\" (UniqueName: \"kubernetes.io/projected/9dacc7ba-e21d-4241-a387-3d4af94f7ace-kube-api-access-hw8bb\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.464563 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.464526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.464742 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.464582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dacc7ba-e21d-4241-a387-3d4af94f7ace-openshift-service-ca\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.464742 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.464622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw8bb\" (UniqueName: \"kubernetes.io/projected/9dacc7ba-e21d-4241-a387-3d4af94f7ace-kube-api-access-hw8bb\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.464742 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:06:07.464672    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-serving-cert: secret "maas-api-e2e-mt-1ca5d531-serving-cert" not found
Jul 28 20:06:07.464742 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:06:07.464739    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls podName:9dacc7ba-e21d-4241-a387-3d4af94f7ace nodeName:}" failed. No retries permitted until 2026-07-28 20:06:07.964724253 +0000 UTC m=+2186.813257703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls") pod "maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" (UID: "9dacc7ba-e21d-4241-a387-3d4af94f7ace") : secret "maas-api-e2e-mt-1ca5d531-serving-cert" not found
Jul 28 20:06:07.465251 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.465232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dacc7ba-e21d-4241-a387-3d4af94f7ace-openshift-service-ca\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.475180 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.475147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw8bb\" (UniqueName: \"kubernetes.io/projected/9dacc7ba-e21d-4241-a387-3d4af94f7ace-kube-api-access-hw8bb\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.968306 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.968266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:07.971028 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:07.970998    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls\") pod \"maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:08.226914 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:08.226815    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:08.369332 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:08.369298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"]
Jul 28 20:06:08.371820 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:06:08.371790    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dacc7ba_e21d_4241_a387_3d4af94f7ace.slice/crio-aecebeb2a3794f6f13796cc162becc6525eef848ab7858647c4ccefd9de6b01d WatchSource:0}: Error finding container aecebeb2a3794f6f13796cc162becc6525eef848ab7858647c4ccefd9de6b01d: Status 404 returned error can't find the container with id aecebeb2a3794f6f13796cc162becc6525eef848ab7858647c4ccefd9de6b01d
Jul 28 20:06:08.409312 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:08.409272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" event={"ID":"9dacc7ba-e21d-4241-a387-3d4af94f7ace","Type":"ContainerStarted","Data":"aecebeb2a3794f6f13796cc162becc6525eef848ab7858647c4ccefd9de6b01d"}
Jul 28 20:06:09.787189 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:09.787149    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:06:10.426963 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:10.426928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" event={"ID":"9dacc7ba-e21d-4241-a387-3d4af94f7ace","Type":"ContainerStarted","Data":"07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d"}
Jul 28 20:06:10.427160 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:10.427103    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:10.446239 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:10.446134    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" podStartSLOduration=1.960779403 podStartE2EDuration="3.446114699s" totalImagesPullingTime="1.485335296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:06:10.445978666 +0000 UTC m=+2189.294512135" watchObservedRunningTime="2026-07-28 20:06:10.446114699 +0000 UTC m=+2189.294648167"
Jul 28 20:06:16.438153 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:16.438124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:50.231496 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.231458    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"]
Jul 28 20:06:50.232671 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.231732    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" podUID="9dacc7ba-e21d-4241-a387-3d4af94f7ace" containerName="maas-api" containerID="cri-o://07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d" gracePeriod=30
Jul 28 20:06:50.488975 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.488914    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:50.638122 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.638078    2574 generic.go:356] "Generic (PLEG): container finished" podID="9dacc7ba-e21d-4241-a387-3d4af94f7ace" containerID="07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d" exitCode=0
Jul 28 20:06:50.638299 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.638141    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"
Jul 28 20:06:50.638299 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.638160    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" event={"ID":"9dacc7ba-e21d-4241-a387-3d4af94f7ace","Type":"ContainerDied","Data":"07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d"}
Jul 28 20:06:50.638299 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.638213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl" event={"ID":"9dacc7ba-e21d-4241-a387-3d4af94f7ace","Type":"ContainerDied","Data":"aecebeb2a3794f6f13796cc162becc6525eef848ab7858647c4ccefd9de6b01d"}
Jul 28 20:06:50.638299 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.638239    2574 scope.go:117] "RemoveContainer" containerID="07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d"
Jul 28 20:06:50.642705 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.642684    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw8bb\" (UniqueName: \"kubernetes.io/projected/9dacc7ba-e21d-4241-a387-3d4af94f7ace-kube-api-access-hw8bb\") pod \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") "
Jul 28 20:06:50.642833 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.642788    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls\") pod \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") "
Jul 28 20:06:50.642891 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.642852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dacc7ba-e21d-4241-a387-3d4af94f7ace-openshift-service-ca\") pod \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\" (UID: \"9dacc7ba-e21d-4241-a387-3d4af94f7ace\") "
Jul 28 20:06:50.643348 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.643313    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dacc7ba-e21d-4241-a387-3d4af94f7ace-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9dacc7ba-e21d-4241-a387-3d4af94f7ace" (UID: "9dacc7ba-e21d-4241-a387-3d4af94f7ace"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:06:50.646515 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.646466    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9dacc7ba-e21d-4241-a387-3d4af94f7ace" (UID: "9dacc7ba-e21d-4241-a387-3d4af94f7ace"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:06:50.646649 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.646624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dacc7ba-e21d-4241-a387-3d4af94f7ace-kube-api-access-hw8bb" (OuterVolumeSpecName: "kube-api-access-hw8bb") pod "9dacc7ba-e21d-4241-a387-3d4af94f7ace" (UID: "9dacc7ba-e21d-4241-a387-3d4af94f7ace"). InnerVolumeSpecName "kube-api-access-hw8bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:06:50.650477 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.650424    2574 scope.go:117] "RemoveContainer" containerID="07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d"
Jul 28 20:06:50.650727 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:06:50.650705    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d\": container with ID starting with 07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d not found: ID does not exist" containerID="07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d"
Jul 28 20:06:50.650801 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.650734    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d"} err="failed to get container status \"07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d\": rpc error: code = NotFound desc = could not find container \"07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d\": container with ID starting with 07941a14bcfb97991ebb2856e048a59a2a4c06f19bbc23b6a233799e0402318d not found: ID does not exist"
Jul 28 20:06:50.744298 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.744208    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw8bb\" (UniqueName: \"kubernetes.io/projected/9dacc7ba-e21d-4241-a387-3d4af94f7ace-kube-api-access-hw8bb\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:06:50.744298 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.744237    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dacc7ba-e21d-4241-a387-3d4af94f7ace-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:06:50.744298 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.744250    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dacc7ba-e21d-4241-a387-3d4af94f7ace-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:06:50.960185 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.960155    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"]
Jul 28 20:06:50.963957 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:50.963928    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ca5d531-7f55d87859-48wxl"]
Jul 28 20:06:51.198587 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:51.198553    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:06:51.711008 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:06:51.710974    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dacc7ba-e21d-4241-a387-3d4af94f7ace" path="/var/lib/kubelet/pods/9dacc7ba-e21d-4241-a387-3d4af94f7ace/volumes"
Jul 28 20:07:36.664757 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.664722    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"]
Jul 28 20:07:36.665268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.665129    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dacc7ba-e21d-4241-a387-3d4af94f7ace" containerName="maas-api"
Jul 28 20:07:36.665268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.665140    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dacc7ba-e21d-4241-a387-3d4af94f7ace" containerName="maas-api"
Jul 28 20:07:36.665268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.665248    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dacc7ba-e21d-4241-a387-3d4af94f7ace" containerName="maas-api"
Jul 28 20:07:36.668640 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.668617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.671669 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.671640    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:07:36.671870 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.671846    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:07:36.672929 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.672911    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:07:36.672929 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.672920    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-89688d3f-serving-cert\""
Jul 28 20:07:36.679169 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.679144    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"]
Jul 28 20:07:36.768944 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.768896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108f2c03-a429-47e1-8900-89ef41d0dc20-openshift-service-ca\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.769160 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.768971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.769160 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.769067    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ppsk\" (UniqueName: \"kubernetes.io/projected/108f2c03-a429-47e1-8900-89ef41d0dc20-kube-api-access-2ppsk\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.870186 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.870147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ppsk\" (UniqueName: \"kubernetes.io/projected/108f2c03-a429-47e1-8900-89ef41d0dc20-kube-api-access-2ppsk\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.870437 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.870210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108f2c03-a429-47e1-8900-89ef41d0dc20-openshift-service-ca\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.870437 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.870267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.870437 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:07:36.870410    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-serving-cert: secret "maas-api-e2e-mt-89688d3f-serving-cert" not found
Jul 28 20:07:36.870620 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:07:36.870468    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls podName:108f2c03-a429-47e1-8900-89ef41d0dc20 nodeName:}" failed. No retries permitted until 2026-07-28 20:07:37.370453328 +0000 UTC m=+2276.218986772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls") pod "maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" (UID: "108f2c03-a429-47e1-8900-89ef41d0dc20") : secret "maas-api-e2e-mt-89688d3f-serving-cert" not found
Jul 28 20:07:36.870901 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.870882    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108f2c03-a429-47e1-8900-89ef41d0dc20-openshift-service-ca\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:36.887960 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:36.887932    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ppsk\" (UniqueName: \"kubernetes.io/projected/108f2c03-a429-47e1-8900-89ef41d0dc20-kube-api-access-2ppsk\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:37.375580 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:37.375546    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:37.378046 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:37.378019    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls\") pod \"maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:37.581039 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:37.580997    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:37.720043 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:37.719504    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"]
Jul 28 20:07:37.725942 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:37.725913    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:07:37.895521 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:37.895423    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" event={"ID":"108f2c03-a429-47e1-8900-89ef41d0dc20","Type":"ContainerStarted","Data":"2de8ee2a85cf443f8d3c09cf52d9d2c5ddd854ccfde5dfeb2b2d2c63132fe40d"}
Jul 28 20:07:38.901652 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:38.901618    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" event={"ID":"108f2c03-a429-47e1-8900-89ef41d0dc20","Type":"ContainerStarted","Data":"bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3"}
Jul 28 20:07:38.902050 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:38.901686    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:07:38.919605 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:38.919551    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" podStartSLOduration=2.357813457 podStartE2EDuration="2.919535345s" totalImagesPullingTime="561.721888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:07:38.917319566 +0000 UTC m=+2277.765853033" watchObservedRunningTime="2026-07-28 20:07:38.919535345 +0000 UTC m=+2277.768068812"
Jul 28 20:07:43.585950 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:43.585909    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:07:44.913474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:07:44.913446    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:08:13.292324 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:13.292285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:08:33.691615 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:33.691516    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:08:55.582535 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:55.582498    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:08:56.418623 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.418515    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"]
Jul 28 20:08:56.418828 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.418800    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" podUID="108f2c03-a429-47e1-8900-89ef41d0dc20" containerName="maas-api" containerID="cri-o://bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3" gracePeriod=30
Jul 28 20:08:56.682024 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.681955    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:08:56.793977 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.793945    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls\") pod \"108f2c03-a429-47e1-8900-89ef41d0dc20\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") "
Jul 28 20:08:56.794174 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.794047    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ppsk\" (UniqueName: \"kubernetes.io/projected/108f2c03-a429-47e1-8900-89ef41d0dc20-kube-api-access-2ppsk\") pod \"108f2c03-a429-47e1-8900-89ef41d0dc20\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") "
Jul 28 20:08:56.794174 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.794138    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108f2c03-a429-47e1-8900-89ef41d0dc20-openshift-service-ca\") pod \"108f2c03-a429-47e1-8900-89ef41d0dc20\" (UID: \"108f2c03-a429-47e1-8900-89ef41d0dc20\") "
Jul 28 20:08:56.794562 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.794528    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/108f2c03-a429-47e1-8900-89ef41d0dc20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "108f2c03-a429-47e1-8900-89ef41d0dc20" (UID: "108f2c03-a429-47e1-8900-89ef41d0dc20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:08:56.796265 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.796229    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "108f2c03-a429-47e1-8900-89ef41d0dc20" (UID: "108f2c03-a429-47e1-8900-89ef41d0dc20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:08:56.796265 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.796248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/108f2c03-a429-47e1-8900-89ef41d0dc20-kube-api-access-2ppsk" (OuterVolumeSpecName: "kube-api-access-2ppsk") pod "108f2c03-a429-47e1-8900-89ef41d0dc20" (UID: "108f2c03-a429-47e1-8900-89ef41d0dc20"). InnerVolumeSpecName "kube-api-access-2ppsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:08:56.895166 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.895129    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/108f2c03-a429-47e1-8900-89ef41d0dc20-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:08:56.895166 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.895159    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/108f2c03-a429-47e1-8900-89ef41d0dc20-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:08:56.895166 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:56.895171    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ppsk\" (UniqueName: \"kubernetes.io/projected/108f2c03-a429-47e1-8900-89ef41d0dc20-kube-api-access-2ppsk\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:08:57.315877 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.315838    2574 generic.go:356] "Generic (PLEG): container finished" podID="108f2c03-a429-47e1-8900-89ef41d0dc20" containerID="bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3" exitCode=0
Jul 28 20:08:57.316070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.315903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" event={"ID":"108f2c03-a429-47e1-8900-89ef41d0dc20","Type":"ContainerDied","Data":"bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3"}
Jul 28 20:08:57.316070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.315912    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"
Jul 28 20:08:57.316070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.315987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw" event={"ID":"108f2c03-a429-47e1-8900-89ef41d0dc20","Type":"ContainerDied","Data":"2de8ee2a85cf443f8d3c09cf52d9d2c5ddd854ccfde5dfeb2b2d2c63132fe40d"}
Jul 28 20:08:57.316070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.316017    2574 scope.go:117] "RemoveContainer" containerID="bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3"
Jul 28 20:08:57.325504 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.325483    2574 scope.go:117] "RemoveContainer" containerID="bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3"
Jul 28 20:08:57.325762 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:08:57.325741    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3\": container with ID starting with bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3 not found: ID does not exist" containerID="bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3"
Jul 28 20:08:57.325826 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.325774    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3"} err="failed to get container status \"bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3\": rpc error: code = NotFound desc = could not find container \"bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3\": container with ID starting with bc5f7225615a21f8de7d76b2c323b51eed39bd9ee53c7e9389d0e4dcae8c7ca3 not found: ID does not exist"
Jul 28 20:08:57.338248 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.338212    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"]
Jul 28 20:08:57.344013 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.343983    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89688d3f-7cffc9db8b-n4lpw"]
Jul 28 20:08:57.711082 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:08:57.711047    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="108f2c03-a429-47e1-8900-89ef41d0dc20" path="/var/lib/kubelet/pods/108f2c03-a429-47e1-8900-89ef41d0dc20/volumes"
Jul 28 20:09:04.098963 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:09:04.098924    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:10:14.390323 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:10:14.390289    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:10:26.686026 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:10:26.685983    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:11:09.644277 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.644241    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"]
Jul 28 20:11:09.646855 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.644833    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="108f2c03-a429-47e1-8900-89ef41d0dc20" containerName="maas-api"
Jul 28 20:11:09.646855 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.644849    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="108f2c03-a429-47e1-8900-89ef41d0dc20" containerName="maas-api"
Jul 28 20:11:09.646855 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.644918    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="108f2c03-a429-47e1-8900-89ef41d0dc20" containerName="maas-api"
Jul 28 20:11:09.647776 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.647757    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.656397 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.653139    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:11:09.656397 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.653490    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:11:09.656397 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.653708    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-68aa77-serving-cert\""
Jul 28 20:11:09.656397 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.653924    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:11:09.663676 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.663646    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"]
Jul 28 20:11:09.740577 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.740537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsqcl\" (UniqueName: \"kubernetes.io/projected/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-kube-api-access-dsqcl\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.740757 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.740610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-maas-api-tls\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.740757 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.740650    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.841794 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.841750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-maas-api-tls\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.841993 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.841816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.841993 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.841888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsqcl\" (UniqueName: \"kubernetes.io/projected/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-kube-api-access-dsqcl\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.842533 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.842512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.844186 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.844156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-maas-api-tls\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.850717 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.850694    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsqcl\" (UniqueName: \"kubernetes.io/projected/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-kube-api-access-dsqcl\") pod \"maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:09.972851 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:09.972754    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:10.112337 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:10.112308    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"]
Jul 28 20:11:10.113993 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:11:10.113966    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf14acd_f6d4_4100_9a24_4b59df0f5bcb.slice/crio-5c9b5cad333e7a08a388c755ba39960a32283c53a37f29f5c47a0555a59da61f WatchSource:0}: Error finding container 5c9b5cad333e7a08a388c755ba39960a32283c53a37f29f5c47a0555a59da61f: Status 404 returned error can't find the container with id 5c9b5cad333e7a08a388c755ba39960a32283c53a37f29f5c47a0555a59da61f
Jul 28 20:11:11.010428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:11.010387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8" event={"ID":"daf14acd-f6d4-4100-9a24-4b59df0f5bcb","Type":"ContainerStarted","Data":"6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba"}
Jul 28 20:11:11.010848 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:11.010463    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:11.010848 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:11.010485    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8" event={"ID":"daf14acd-f6d4-4100-9a24-4b59df0f5bcb","Type":"ContainerStarted","Data":"5c9b5cad333e7a08a388c755ba39960a32283c53a37f29f5c47a0555a59da61f"}
Jul 28 20:11:11.029233 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:11.029171    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8" podStartSLOduration=1.302751258 podStartE2EDuration="2.029149868s" totalImagesPullingTime="726.39861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:11.026882473 +0000 UTC m=+2489.875415940" watchObservedRunningTime="2026-07-28 20:11:11.029149868 +0000 UTC m=+2489.877683335"
Jul 28 20:11:13.587666 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:13.587628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:11:17.022633 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:17.022599    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:11:37.821038 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.820959    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"]
Jul 28 20:11:37.824847 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.824829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:37.827655 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.827632    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e98043-serving-cert\""
Jul 28 20:11:37.838352 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.838322    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"]
Jul 28 20:11:37.906890 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.906851    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vls7w\" (UniqueName: \"kubernetes.io/projected/68b3d619-548b-4957-a75b-0b9e2f2adfa8-kube-api-access-vls7w\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:37.907078 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.906902    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b3d619-548b-4957-a75b-0b9e2f2adfa8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:37.907078 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:37.907006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b3d619-548b-4957-a75b-0b9e2f2adfa8-maas-api-tls\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.008040 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.008004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vls7w\" (UniqueName: \"kubernetes.io/projected/68b3d619-548b-4957-a75b-0b9e2f2adfa8-kube-api-access-vls7w\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.008215 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.008056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b3d619-548b-4957-a75b-0b9e2f2adfa8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.008215 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.008108    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b3d619-548b-4957-a75b-0b9e2f2adfa8-maas-api-tls\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.008724 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.008704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b3d619-548b-4957-a75b-0b9e2f2adfa8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.010505 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.010483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b3d619-548b-4957-a75b-0b9e2f2adfa8-maas-api-tls\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.016061 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.016036    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vls7w\" (UniqueName: \"kubernetes.io/projected/68b3d619-548b-4957-a75b-0b9e2f2adfa8-kube-api-access-vls7w\") pod \"maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.140697 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.140655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:38.290971 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:38.290942    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"]
Jul 28 20:11:38.293299 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:11:38.293271    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b3d619_548b_4957_a75b_0b9e2f2adfa8.slice/crio-8b7b802a96d5956cb0d068e98fc9637a994d32ee128f02650efaca7750614f20 WatchSource:0}: Error finding container 8b7b802a96d5956cb0d068e98fc9637a994d32ee128f02650efaca7750614f20: Status 404 returned error can't find the container with id 8b7b802a96d5956cb0d068e98fc9637a994d32ee128f02650efaca7750614f20
Jul 28 20:11:39.160203 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:39.160165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr" event={"ID":"68b3d619-548b-4957-a75b-0b9e2f2adfa8","Type":"ContainerStarted","Data":"51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a"}
Jul 28 20:11:39.160632 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:39.160223    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr" event={"ID":"68b3d619-548b-4957-a75b-0b9e2f2adfa8","Type":"ContainerStarted","Data":"8b7b802a96d5956cb0d068e98fc9637a994d32ee128f02650efaca7750614f20"}
Jul 28 20:11:39.160632 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:39.160295    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:11:39.178850 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:39.178798    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr" podStartSLOduration=1.826101626 podStartE2EDuration="2.178782082s" totalImagesPullingTime="352.680456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:39.176354662 +0000 UTC m=+2518.024888134" watchObservedRunningTime="2026-07-28 20:11:39.178782082 +0000 UTC m=+2518.027315548"
Jul 28 20:11:45.084612 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:45.084575    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:11:45.174087 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:11:45.174056    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:12:21.394328 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:12:21.394278    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:12:52.094676 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:12:52.094638    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:13:09.525492 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:09.525457    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:13:33.829715 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:33.829676    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"]
Jul 28 20:13:33.833732 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:33.833705    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:33.836562 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:33.836528    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:13:33.839926 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:33.839899    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"]
Jul 28 20:13:33.963908 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:33.963863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb737ab-2356-453e-9a63-2a5bcd1b44b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97\" (UID: \"4bb737ab-2356-453e-9a63-2a5bcd1b44b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:34.064824 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:34.064787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb737ab-2356-453e-9a63-2a5bcd1b44b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97\" (UID: \"4bb737ab-2356-453e-9a63-2a5bcd1b44b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:34.065448 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:34.065429    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb737ab-2356-453e-9a63-2a5bcd1b44b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97\" (UID: \"4bb737ab-2356-453e-9a63-2a5bcd1b44b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:34.149122 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:34.149092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:34.287086 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:34.287057    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"]
Jul 28 20:13:34.289974 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:13:34.289935    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb737ab_2356_453e_9a63_2a5bcd1b44b9.slice/crio-1112cadbc93a4efe2e8cf73e57a0bbe7c3f68fd237ba7f3e4c886e9fff8c33c9 WatchSource:0}: Error finding container 1112cadbc93a4efe2e8cf73e57a0bbe7c3f68fd237ba7f3e4c886e9fff8c33c9: Status 404 returned error can't find the container with id 1112cadbc93a4efe2e8cf73e57a0bbe7c3f68fd237ba7f3e4c886e9fff8c33c9
Jul 28 20:13:34.292151 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:34.292131    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:13:34.777557 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:34.777522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97" event={"ID":"4bb737ab-2356-453e-9a63-2a5bcd1b44b9","Type":"ContainerStarted","Data":"1112cadbc93a4efe2e8cf73e57a0bbe7c3f68fd237ba7f3e4c886e9fff8c33c9"}
Jul 28 20:13:37.491978 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:37.491942    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:13:37.796605 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:37.796570    2574 generic.go:356] "Generic (PLEG): container finished" podID="4bb737ab-2356-453e-9a63-2a5bcd1b44b9" containerID="51815bfb067fbd781e78628130b5c4bcfd2c92ded80913849dcc80ef95b5f048" exitCode=0
Jul 28 20:13:37.796784 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:37.796656    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97" event={"ID":"4bb737ab-2356-453e-9a63-2a5bcd1b44b9","Type":"ContainerDied","Data":"51815bfb067fbd781e78628130b5c4bcfd2c92ded80913849dcc80ef95b5f048"}
Jul 28 20:13:38.947182 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:38.947153    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:39.011668 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:39.011637    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb737ab-2356-453e-9a63-2a5bcd1b44b9-maas-api-service-ca\") pod \"4bb737ab-2356-453e-9a63-2a5bcd1b44b9\" (UID: \"4bb737ab-2356-453e-9a63-2a5bcd1b44b9\") "
Jul 28 20:13:39.011987 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:39.011963    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb737ab-2356-453e-9a63-2a5bcd1b44b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4bb737ab-2356-453e-9a63-2a5bcd1b44b9" (UID: "4bb737ab-2356-453e-9a63-2a5bcd1b44b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:13:39.113442 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:39.113409    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bb737ab-2356-453e-9a63-2a5bcd1b44b9-maas-api-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:13:39.808570 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:39.808537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97" event={"ID":"4bb737ab-2356-453e-9a63-2a5bcd1b44b9","Type":"ContainerDied","Data":"1112cadbc93a4efe2e8cf73e57a0bbe7c3f68fd237ba7f3e4c886e9fff8c33c9"}
Jul 28 20:13:39.808570 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:39.808559    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"
Jul 28 20:13:39.808792 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:39.808585    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1112cadbc93a4efe2e8cf73e57a0bbe7c3f68fd237ba7f3e4c886e9fff8c33c9"
Jul 28 20:13:44.305630 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.305594    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"]
Jul 28 20:13:44.306186 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.305824    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8" podUID="daf14acd-f6d4-4100-9a24-4b59df0f5bcb" containerName="maas-api" containerID="cri-o://6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba" gracePeriod=30
Jul 28 20:13:44.565278 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.565184    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"]
Jul 28 20:13:44.567553 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.567530    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-68aa77-rvf97"]
Jul 28 20:13:44.569352 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.569335    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:13:44.665398 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.665327    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-openshift-service-ca\") pod \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") "
Jul 28 20:13:44.665607 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.665454    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-maas-api-tls\") pod \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") "
Jul 28 20:13:44.665607 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.665501    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsqcl\" (UniqueName: \"kubernetes.io/projected/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-kube-api-access-dsqcl\") pod \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\" (UID: \"daf14acd-f6d4-4100-9a24-4b59df0f5bcb\") "
Jul 28 20:13:44.665821 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.665785    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "daf14acd-f6d4-4100-9a24-4b59df0f5bcb" (UID: "daf14acd-f6d4-4100-9a24-4b59df0f5bcb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:13:44.667765 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.667740    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "daf14acd-f6d4-4100-9a24-4b59df0f5bcb" (UID: "daf14acd-f6d4-4100-9a24-4b59df0f5bcb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:13:44.667850 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.667798    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-kube-api-access-dsqcl" (OuterVolumeSpecName: "kube-api-access-dsqcl") pod "daf14acd-f6d4-4100-9a24-4b59df0f5bcb" (UID: "daf14acd-f6d4-4100-9a24-4b59df0f5bcb"). InnerVolumeSpecName "kube-api-access-dsqcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:44.766149 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.766108    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsqcl\" (UniqueName: \"kubernetes.io/projected/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-kube-api-access-dsqcl\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:13:44.766149 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.766142    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:13:44.766149 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.766155    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daf14acd-f6d4-4100-9a24-4b59df0f5bcb-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:13:44.837737 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.837642    2574 generic.go:356] "Generic (PLEG): container finished" podID="daf14acd-f6d4-4100-9a24-4b59df0f5bcb" containerID="6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba" exitCode=0
Jul 28 20:13:44.837737 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.837685    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"
Jul 28 20:13:44.837964 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.837730    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8" event={"ID":"daf14acd-f6d4-4100-9a24-4b59df0f5bcb","Type":"ContainerDied","Data":"6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba"}
Jul 28 20:13:44.837964 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.837781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8" event={"ID":"daf14acd-f6d4-4100-9a24-4b59df0f5bcb","Type":"ContainerDied","Data":"5c9b5cad333e7a08a388c755ba39960a32283c53a37f29f5c47a0555a59da61f"}
Jul 28 20:13:44.837964 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.837804    2574 scope.go:117] "RemoveContainer" containerID="6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba"
Jul 28 20:13:44.847823 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.847803    2574 scope.go:117] "RemoveContainer" containerID="6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba"
Jul 28 20:13:44.848094 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:13:44.848065    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba\": container with ID starting with 6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba not found: ID does not exist" containerID="6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba"
Jul 28 20:13:44.848191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.848106    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba"} err="failed to get container status \"6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba\": rpc error: code = NotFound desc = could not find container \"6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba\": container with ID starting with 6d5c688328fd05e90877068b4401fc676ec7f8fa1f3768c9ca41775d138518ba not found: ID does not exist"
Jul 28 20:13:44.860730 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.860701    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"]
Jul 28 20:13:44.867399 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:44.865554    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-68aa77-86987d9d64-7cwr8"]
Jul 28 20:13:45.709779 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:45.709742    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb737ab-2356-453e-9a63-2a5bcd1b44b9" path="/var/lib/kubelet/pods/4bb737ab-2356-453e-9a63-2a5bcd1b44b9/volumes"
Jul 28 20:13:45.710168 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:45.710126    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daf14acd-f6d4-4100-9a24-4b59df0f5bcb" path="/var/lib/kubelet/pods/daf14acd-f6d4-4100-9a24-4b59df0f5bcb/volumes"
Jul 28 20:13:53.087997 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:13:53.087961    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:14:01.831022 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:01.830985    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"]
Jul 28 20:14:01.831498 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:01.831267    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr" podUID="68b3d619-548b-4957-a75b-0b9e2f2adfa8" containerName="maas-api" containerID="cri-o://51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a" gracePeriod=30
Jul 28 20:14:02.289045 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.289017    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:14:02.328851 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.328817    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b3d619-548b-4957-a75b-0b9e2f2adfa8-openshift-service-ca\") pod \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") "
Jul 28 20:14:02.329053 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.328938    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b3d619-548b-4957-a75b-0b9e2f2adfa8-maas-api-tls\") pod \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") "
Jul 28 20:14:02.329053 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.329002    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vls7w\" (UniqueName: \"kubernetes.io/projected/68b3d619-548b-4957-a75b-0b9e2f2adfa8-kube-api-access-vls7w\") pod \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\" (UID: \"68b3d619-548b-4957-a75b-0b9e2f2adfa8\") "
Jul 28 20:14:02.329280 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.329249    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68b3d619-548b-4957-a75b-0b9e2f2adfa8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68b3d619-548b-4957-a75b-0b9e2f2adfa8" (UID: "68b3d619-548b-4957-a75b-0b9e2f2adfa8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:02.331668 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.331623    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68b3d619-548b-4957-a75b-0b9e2f2adfa8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68b3d619-548b-4957-a75b-0b9e2f2adfa8" (UID: "68b3d619-548b-4957-a75b-0b9e2f2adfa8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:14:02.331903 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.331873    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b3d619-548b-4957-a75b-0b9e2f2adfa8-kube-api-access-vls7w" (OuterVolumeSpecName: "kube-api-access-vls7w") pod "68b3d619-548b-4957-a75b-0b9e2f2adfa8" (UID: "68b3d619-548b-4957-a75b-0b9e2f2adfa8"). InnerVolumeSpecName "kube-api-access-vls7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:02.429996 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.429895    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b3d619-548b-4957-a75b-0b9e2f2adfa8-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.429996 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.429933    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b3d619-548b-4957-a75b-0b9e2f2adfa8-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.429996 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.429946    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vls7w\" (UniqueName: \"kubernetes.io/projected/68b3d619-548b-4957-a75b-0b9e2f2adfa8-kube-api-access-vls7w\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:14:02.938111 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.938079    2574 generic.go:356] "Generic (PLEG): container finished" podID="68b3d619-548b-4957-a75b-0b9e2f2adfa8" containerID="51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a" exitCode=0
Jul 28 20:14:02.938534 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.938133    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"
Jul 28 20:14:02.938534 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.938159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr" event={"ID":"68b3d619-548b-4957-a75b-0b9e2f2adfa8","Type":"ContainerDied","Data":"51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a"}
Jul 28 20:14:02.938534 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.938220    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr" event={"ID":"68b3d619-548b-4957-a75b-0b9e2f2adfa8","Type":"ContainerDied","Data":"8b7b802a96d5956cb0d068e98fc9637a994d32ee128f02650efaca7750614f20"}
Jul 28 20:14:02.938534 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.938248    2574 scope.go:117] "RemoveContainer" containerID="51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a"
Jul 28 20:14:02.948558 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.948529    2574 scope.go:117] "RemoveContainer" containerID="51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a"
Jul 28 20:14:02.948852 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:14:02.948831    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a\": container with ID starting with 51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a not found: ID does not exist" containerID="51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a"
Jul 28 20:14:02.948921 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.948863    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a"} err="failed to get container status \"51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a\": rpc error: code = NotFound desc = could not find container \"51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a\": container with ID starting with 51c4e12552764f933b7f2fcbd0d917cca105f76d19aa73494c58cf16f6d2480a not found: ID does not exist"
Jul 28 20:14:02.961248 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.961219    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"]
Jul 28 20:14:02.968310 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:02.968289    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e98043-6c464b748b-f8jmr"]
Jul 28 20:14:03.710273 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:03.710241    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68b3d619-548b-4957-a75b-0b9e2f2adfa8" path="/var/lib/kubelet/pods/68b3d619-548b-4957-a75b-0b9e2f2adfa8/volumes"
Jul 28 20:14:04.689872 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:04.689838    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:14:12.579991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.579955    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"]
Jul 28 20:14:12.580474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580387    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daf14acd-f6d4-4100-9a24-4b59df0f5bcb" containerName="maas-api"
Jul 28 20:14:12.580474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580400    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="daf14acd-f6d4-4100-9a24-4b59df0f5bcb" containerName="maas-api"
Jul 28 20:14:12.580474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580410    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb737ab-2356-453e-9a63-2a5bcd1b44b9" containerName="revoke-keys"
Jul 28 20:14:12.580474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580417    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb737ab-2356-453e-9a63-2a5bcd1b44b9" containerName="revoke-keys"
Jul 28 20:14:12.580474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580437    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b3d619-548b-4957-a75b-0b9e2f2adfa8" containerName="maas-api"
Jul 28 20:14:12.580474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580443    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b3d619-548b-4957-a75b-0b9e2f2adfa8" containerName="maas-api"
Jul 28 20:14:12.580661 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580497    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="daf14acd-f6d4-4100-9a24-4b59df0f5bcb" containerName="maas-api"
Jul 28 20:14:12.580661 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580508    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="68b3d619-548b-4957-a75b-0b9e2f2adfa8" containerName="maas-api"
Jul 28 20:14:12.580661 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.580514    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb737ab-2356-453e-9a63-2a5bcd1b44b9" containerName="revoke-keys"
Jul 28 20:14:12.588654 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.588631    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.593138 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.593096    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:14:12.593414 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.593395    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-0180d1-serving-cert\""
Jul 28 20:14:12.593578 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.593411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:14:12.593669 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.593494    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:14:12.596227 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.596195    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"]
Jul 28 20:14:12.625396 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.625347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krbrs\" (UniqueName: \"kubernetes.io/projected/043ef954-fe90-4c1c-ae02-3fe7e13163a0-kube-api-access-krbrs\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.625396 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.625403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.625672 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.625553    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/043ef954-fe90-4c1c-ae02-3fe7e13163a0-openshift-service-ca\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.726102 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.726063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/043ef954-fe90-4c1c-ae02-3fe7e13163a0-openshift-service-ca\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.726310 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.726127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krbrs\" (UniqueName: \"kubernetes.io/projected/043ef954-fe90-4c1c-ae02-3fe7e13163a0-kube-api-access-krbrs\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.726310 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.726240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.726483 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:14:12.726429    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-serving-cert: secret "maas-api-e2e-api-a-0180d1-serving-cert" not found
Jul 28 20:14:12.726546 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:14:12.726489    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls podName:043ef954-fe90-4c1c-ae02-3fe7e13163a0 nodeName:}" failed. No retries permitted until 2026-07-28 20:14:13.226473893 +0000 UTC m=+2672.075007338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls") pod "maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" (UID: "043ef954-fe90-4c1c-ae02-3fe7e13163a0") : secret "maas-api-e2e-api-a-0180d1-serving-cert" not found
Jul 28 20:14:12.726846 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.726823    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/043ef954-fe90-4c1c-ae02-3fe7e13163a0-openshift-service-ca\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:12.735227 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:12.735200    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krbrs\" (UniqueName: \"kubernetes.io/projected/043ef954-fe90-4c1c-ae02-3fe7e13163a0-kube-api-access-krbrs\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:13.232073 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:13.232038    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:13.235030 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:13.234995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls\") pod \"maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:13.501864 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:13.501763    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:13.641726 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:13.641699    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"]
Jul 28 20:14:13.644170 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:14:13.644143    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043ef954_fe90_4c1c_ae02_3fe7e13163a0.slice/crio-cb6081173a19f43532906a766967b4a069569812dc61cda2b04f7879e1444681 WatchSource:0}: Error finding container cb6081173a19f43532906a766967b4a069569812dc61cda2b04f7879e1444681: Status 404 returned error can't find the container with id cb6081173a19f43532906a766967b4a069569812dc61cda2b04f7879e1444681
Jul 28 20:14:13.996006 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:13.995962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" event={"ID":"043ef954-fe90-4c1c-ae02-3fe7e13163a0","Type":"ContainerStarted","Data":"cb6081173a19f43532906a766967b4a069569812dc61cda2b04f7879e1444681"}
Jul 28 20:14:15.003012 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:15.002974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" event={"ID":"043ef954-fe90-4c1c-ae02-3fe7e13163a0","Type":"ContainerStarted","Data":"456c06be535f040780cb2f0e52a3ad6774f8f23333d5c51707faf7f552a9f568"}
Jul 28 20:14:15.003431 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:15.003068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:15.023714 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:15.023654    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" podStartSLOduration=2.613596876 podStartE2EDuration="3.023637915s" totalImagesPullingTime="410.041039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:15.021784304 +0000 UTC m=+2673.870317772" watchObservedRunningTime="2026-07-28 20:14:15.023637915 +0000 UTC m=+2673.872171442"
Jul 28 20:14:18.087099 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:18.087062    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:14:21.014705 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:21.014673    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:14:41.853068 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:41.852994    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"]
Jul 28 20:14:41.857473 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:41.857446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:41.860033 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:41.860011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-86e5cf-serving-cert\""
Jul 28 20:14:41.868668 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:41.868221    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"]
Jul 28 20:14:42.001608 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.001569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4k4j\" (UniqueName: \"kubernetes.io/projected/73e7c293-5841-42df-8c28-2b38c44d4d2d-kube-api-access-p4k4j\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.001608 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.001612    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e7c293-5841-42df-8c28-2b38c44d4d2d-openshift-service-ca\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.001765 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.001737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e7c293-5841-42df-8c28-2b38c44d4d2d-maas-api-tls\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.102240 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.102210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e7c293-5841-42df-8c28-2b38c44d4d2d-maas-api-tls\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.102446 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.102272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4k4j\" (UniqueName: \"kubernetes.io/projected/73e7c293-5841-42df-8c28-2b38c44d4d2d-kube-api-access-p4k4j\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.102446 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.102300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e7c293-5841-42df-8c28-2b38c44d4d2d-openshift-service-ca\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.103002 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.102985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e7c293-5841-42df-8c28-2b38c44d4d2d-openshift-service-ca\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.104669 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.104617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e7c293-5841-42df-8c28-2b38c44d4d2d-maas-api-tls\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.111114 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.111094    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4k4j\" (UniqueName: \"kubernetes.io/projected/73e7c293-5841-42df-8c28-2b38c44d4d2d-kube-api-access-p4k4j\") pod \"maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.169971 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.169939    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:42.309994 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:42.309969    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"]
Jul 28 20:14:42.312124 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:14:42.312093    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e7c293_5841_42df_8c28_2b38c44d4d2d.slice/crio-54ac0741d6bd56c561d92c0bdd27934cc93585295ef23aa7ab3dc1a84ed3d50e WatchSource:0}: Error finding container 54ac0741d6bd56c561d92c0bdd27934cc93585295ef23aa7ab3dc1a84ed3d50e: Status 404 returned error can't find the container with id 54ac0741d6bd56c561d92c0bdd27934cc93585295ef23aa7ab3dc1a84ed3d50e
Jul 28 20:14:43.152138 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:43.152100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9" event={"ID":"73e7c293-5841-42df-8c28-2b38c44d4d2d","Type":"ContainerStarted","Data":"5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c"}
Jul 28 20:14:43.152610 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:43.152160    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9" event={"ID":"73e7c293-5841-42df-8c28-2b38c44d4d2d","Type":"ContainerStarted","Data":"54ac0741d6bd56c561d92c0bdd27934cc93585295ef23aa7ab3dc1a84ed3d50e"}
Jul 28 20:14:43.152610 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:43.152242    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:14:43.174154 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:43.174098    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9" podStartSLOduration=1.82164854 podStartE2EDuration="2.174080387s" totalImagesPullingTime="352.431847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:43.171899773 +0000 UTC m=+2702.020433240" watchObservedRunningTime="2026-07-28 20:14:43.174080387 +0000 UTC m=+2702.022613884"
Jul 28 20:14:48.194108 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:48.194073    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:14:49.162834 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:14:49.162805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:15:00.157688 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:00.157650    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"]
Jul 28 20:15:00.161276 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:00.161259    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"
Jul 28 20:15:00.164172 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:00.164143    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6zs4\""
Jul 28 20:15:00.169074 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:00.169043    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"]
Jul 28 20:15:00.174408 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:00.174389    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"
Jul 28 20:15:00.310274 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:00.310248    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"]
Jul 28 20:15:00.311965 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:15:00.311936    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52cf84ed_6f0e_4ffc_a0ef_cdbd39f3adb2.slice/crio-152a5e534e1b569c04a5e87f61edc4c367586e98f69aade2399a17d49b876738 WatchSource:0}: Error finding container 152a5e534e1b569c04a5e87f61edc4c367586e98f69aade2399a17d49b876738: Status 404 returned error can't find the container with id 152a5e534e1b569c04a5e87f61edc4c367586e98f69aade2399a17d49b876738
Jul 28 20:15:01.250789 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:01.250747    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6" event={"ID":"52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2","Type":"ContainerStarted","Data":"0321d806a340b9768aa788c56758ec6109f2c20986c323bdc25fb802a150d67a"}
Jul 28 20:15:01.251148 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:01.250820    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6" event={"ID":"52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2","Type":"ContainerStarted","Data":"152a5e534e1b569c04a5e87f61edc4c367586e98f69aade2399a17d49b876738"}
Jul 28 20:15:01.267820 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:01.267761    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6" podStartSLOduration=1.267744223 podStartE2EDuration="1.267744223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:15:01.266027712 +0000 UTC m=+2720.114561192" watchObservedRunningTime="2026-07-28 20:15:01.267744223 +0000 UTC m=+2720.116277692"
Jul 28 20:15:02.257420 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:02.257353    2574 generic.go:356] "Generic (PLEG): container finished" podID="52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2" containerID="0321d806a340b9768aa788c56758ec6109f2c20986c323bdc25fb802a150d67a" exitCode=0
Jul 28 20:15:02.257828 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:02.257471    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6" event={"ID":"52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2","Type":"ContainerDied","Data":"0321d806a340b9768aa788c56758ec6109f2c20986c323bdc25fb802a150d67a"}
Jul 28 20:15:03.403655 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:03.403631    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"
Jul 28 20:15:04.269163 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:04.269131    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"
Jul 28 20:15:04.269342 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:04.269129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6" event={"ID":"52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2","Type":"ContainerDied","Data":"152a5e534e1b569c04a5e87f61edc4c367586e98f69aade2399a17d49b876738"}
Jul 28 20:15:04.269342 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:04.269260    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="152a5e534e1b569c04a5e87f61edc4c367586e98f69aade2399a17d49b876738"
Jul 28 20:15:25.118777 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.118742    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"]
Jul 28 20:15:25.119299 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.119030    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" podUID="043ef954-fe90-4c1c-ae02-3fe7e13163a0" containerName="maas-api" containerID="cri-o://456c06be535f040780cb2f0e52a3ad6774f8f23333d5c51707faf7f552a9f568" gracePeriod=30
Jul 28 20:15:25.380975 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.380938    2574 generic.go:356] "Generic (PLEG): container finished" podID="043ef954-fe90-4c1c-ae02-3fe7e13163a0" containerID="456c06be535f040780cb2f0e52a3ad6774f8f23333d5c51707faf7f552a9f568" exitCode=0
Jul 28 20:15:25.381111 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.381009    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" event={"ID":"043ef954-fe90-4c1c-ae02-3fe7e13163a0","Type":"ContainerDied","Data":"456c06be535f040780cb2f0e52a3ad6774f8f23333d5c51707faf7f552a9f568"}
Jul 28 20:15:25.398067 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.398043    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:15:25.499475 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.499444    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/043ef954-fe90-4c1c-ae02-3fe7e13163a0-openshift-service-ca\") pod \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") "
Jul 28 20:15:25.499648 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.499517    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls\") pod \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") "
Jul 28 20:15:25.499648 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.499574    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krbrs\" (UniqueName: \"kubernetes.io/projected/043ef954-fe90-4c1c-ae02-3fe7e13163a0-kube-api-access-krbrs\") pod \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\" (UID: \"043ef954-fe90-4c1c-ae02-3fe7e13163a0\") "
Jul 28 20:15:25.499789 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.499766    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/043ef954-fe90-4c1c-ae02-3fe7e13163a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "043ef954-fe90-4c1c-ae02-3fe7e13163a0" (UID: "043ef954-fe90-4c1c-ae02-3fe7e13163a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:25.501546 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.501523    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043ef954-fe90-4c1c-ae02-3fe7e13163a0-kube-api-access-krbrs" (OuterVolumeSpecName: "kube-api-access-krbrs") pod "043ef954-fe90-4c1c-ae02-3fe7e13163a0" (UID: "043ef954-fe90-4c1c-ae02-3fe7e13163a0"). InnerVolumeSpecName "kube-api-access-krbrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:25.501663 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.501561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "043ef954-fe90-4c1c-ae02-3fe7e13163a0" (UID: "043ef954-fe90-4c1c-ae02-3fe7e13163a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:15:25.600304 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.600271    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/043ef954-fe90-4c1c-ae02-3fe7e13163a0-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:15:25.600304 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.600297    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/043ef954-fe90-4c1c-ae02-3fe7e13163a0-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:15:25.600304 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:25.600309    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krbrs\" (UniqueName: \"kubernetes.io/projected/043ef954-fe90-4c1c-ae02-3fe7e13163a0-kube-api-access-krbrs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:15:26.387261 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:26.387223    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"
Jul 28 20:15:26.387781 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:26.387263    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp" event={"ID":"043ef954-fe90-4c1c-ae02-3fe7e13163a0","Type":"ContainerDied","Data":"cb6081173a19f43532906a766967b4a069569812dc61cda2b04f7879e1444681"}
Jul 28 20:15:26.387781 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:26.387340    2574 scope.go:117] "RemoveContainer" containerID="456c06be535f040780cb2f0e52a3ad6774f8f23333d5c51707faf7f552a9f568"
Jul 28 20:15:26.404907 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:26.404875    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"]
Jul 28 20:15:26.410898 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:26.410863    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0180d1-7bb8b6599-gzwsp"]
Jul 28 20:15:27.488750 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:27.488707    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:15:27.709678 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:27.709644    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="043ef954-fe90-4c1c-ae02-3fe7e13163a0" path="/var/lib/kubelet/pods/043ef954-fe90-4c1c-ae02-3fe7e13163a0/volumes"
Jul 28 20:15:47.613447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:47.613415    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"]
Jul 28 20:15:47.613884 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:47.613638    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9" podUID="73e7c293-5841-42df-8c28-2b38c44d4d2d" containerName="maas-api" containerID="cri-o://5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c" gracePeriod=30
Jul 28 20:15:47.635003 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:47.634975    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"]
Jul 28 20:15:47.639468 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:47.639444    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-86e5cf-29754495-ln5z6"]
Jul 28 20:15:47.710594 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:47.710560    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2" path="/var/lib/kubelet/pods/52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2/volumes"
Jul 28 20:15:47.879665 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:47.879642    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:15:48.006417 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.006390    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e7c293-5841-42df-8c28-2b38c44d4d2d-maas-api-tls\") pod \"73e7c293-5841-42df-8c28-2b38c44d4d2d\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") "
Jul 28 20:15:48.006592 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.006434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e7c293-5841-42df-8c28-2b38c44d4d2d-openshift-service-ca\") pod \"73e7c293-5841-42df-8c28-2b38c44d4d2d\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") "
Jul 28 20:15:48.006592 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.006489    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4k4j\" (UniqueName: \"kubernetes.io/projected/73e7c293-5841-42df-8c28-2b38c44d4d2d-kube-api-access-p4k4j\") pod \"73e7c293-5841-42df-8c28-2b38c44d4d2d\" (UID: \"73e7c293-5841-42df-8c28-2b38c44d4d2d\") "
Jul 28 20:15:48.006925 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.006892    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e7c293-5841-42df-8c28-2b38c44d4d2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73e7c293-5841-42df-8c28-2b38c44d4d2d" (UID: "73e7c293-5841-42df-8c28-2b38c44d4d2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:48.008607 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.008575    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e7c293-5841-42df-8c28-2b38c44d4d2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73e7c293-5841-42df-8c28-2b38c44d4d2d" (UID: "73e7c293-5841-42df-8c28-2b38c44d4d2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:15:48.008715 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.008597    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e7c293-5841-42df-8c28-2b38c44d4d2d-kube-api-access-p4k4j" (OuterVolumeSpecName: "kube-api-access-p4k4j") pod "73e7c293-5841-42df-8c28-2b38c44d4d2d" (UID: "73e7c293-5841-42df-8c28-2b38c44d4d2d"). InnerVolumeSpecName "kube-api-access-p4k4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:48.107434 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.107399    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4k4j\" (UniqueName: \"kubernetes.io/projected/73e7c293-5841-42df-8c28-2b38c44d4d2d-kube-api-access-p4k4j\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.107434 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.107428    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e7c293-5841-42df-8c28-2b38c44d4d2d-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.107434 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.107438    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e7c293-5841-42df-8c28-2b38c44d4d2d-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:15:48.511525 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.511486    2574 generic.go:356] "Generic (PLEG): container finished" podID="73e7c293-5841-42df-8c28-2b38c44d4d2d" containerID="5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c" exitCode=0
Jul 28 20:15:48.511702 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.511543    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"
Jul 28 20:15:48.511702 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.511570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9" event={"ID":"73e7c293-5841-42df-8c28-2b38c44d4d2d","Type":"ContainerDied","Data":"5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c"}
Jul 28 20:15:48.511702 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.511624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9" event={"ID":"73e7c293-5841-42df-8c28-2b38c44d4d2d","Type":"ContainerDied","Data":"54ac0741d6bd56c561d92c0bdd27934cc93585295ef23aa7ab3dc1a84ed3d50e"}
Jul 28 20:15:48.511702 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.511646    2574 scope.go:117] "RemoveContainer" containerID="5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c"
Jul 28 20:15:48.520932 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.520918    2574 scope.go:117] "RemoveContainer" containerID="5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c"
Jul 28 20:15:48.521155 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:15:48.521138    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c\": container with ID starting with 5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c not found: ID does not exist" containerID="5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c"
Jul 28 20:15:48.521206 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.521163    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c"} err="failed to get container status \"5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c\": rpc error: code = NotFound desc = could not find container \"5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c\": container with ID starting with 5a0339558dc097e9640e4348708314b987bbe4ed31a2a672c16b91fb6114030c not found: ID does not exist"
Jul 28 20:15:48.534034 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.534003    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"]
Jul 28 20:15:48.538704 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:48.538683    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86e5cf-bb9c446df-2dbk9"]
Jul 28 20:15:49.710156 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:49.710123    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73e7c293-5841-42df-8c28-2b38c44d4d2d" path="/var/lib/kubelet/pods/73e7c293-5841-42df-8c28-2b38c44d4d2d/volumes"
Jul 28 20:15:52.394605 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:52.394565    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:15:58.075955 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.075920    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"]
Jul 28 20:15:58.076447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076384    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e7c293-5841-42df-8c28-2b38c44d4d2d" containerName="maas-api"
Jul 28 20:15:58.076447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076400    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e7c293-5841-42df-8c28-2b38c44d4d2d" containerName="maas-api"
Jul 28 20:15:58.076447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076419    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2" containerName="cleanup"
Jul 28 20:15:58.076447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076425    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2" containerName="cleanup"
Jul 28 20:15:58.076447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076438    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043ef954-fe90-4c1c-ae02-3fe7e13163a0" containerName="maas-api"
Jul 28 20:15:58.076447 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076445    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="043ef954-fe90-4c1c-ae02-3fe7e13163a0" containerName="maas-api"
Jul 28 20:15:58.076654 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076519    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="043ef954-fe90-4c1c-ae02-3fe7e13163a0" containerName="maas-api"
Jul 28 20:15:58.076654 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076526    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e7c293-5841-42df-8c28-2b38c44d4d2d" containerName="maas-api"
Jul 28 20:15:58.076654 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.076532    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="52cf84ed-6f0e-4ffc-a0ef-cdbd39f3adb2" containerName="cleanup"
Jul 28 20:15:58.080622 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.080607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.083987 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.083958    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c38c57-serving-cert\""
Jul 28 20:15:58.084118 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.084015    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 20:15:58.085140 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.085122    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g5qmq\""
Jul 28 20:15:58.085261 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.085156    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:15:58.090755 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.090733    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"]
Jul 28 20:15:58.201568 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.201534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b2c0c-8332-49b2-a714-8dd177820341-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.201756 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.201597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdz55\" (UniqueName: \"kubernetes.io/projected/df6b2c0c-8332-49b2-a714-8dd177820341-kube-api-access-fdz55\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.201756 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.201703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.302743 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.302705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b2c0c-8332-49b2-a714-8dd177820341-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.302945 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.302755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdz55\" (UniqueName: \"kubernetes.io/projected/df6b2c0c-8332-49b2-a714-8dd177820341-kube-api-access-fdz55\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.302945 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.302811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.302945 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:15:58.302929    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-serving-cert: secret "maas-api-e2e-shared-a-c38c57-serving-cert" not found
Jul 28 20:15:58.303110 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:15:58.302986    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls podName:df6b2c0c-8332-49b2-a714-8dd177820341 nodeName:}" failed. No retries permitted until 2026-07-28 20:15:58.802969977 +0000 UTC m=+2777.651503423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls") pod "maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" (UID: "df6b2c0c-8332-49b2-a714-8dd177820341") : secret "maas-api-e2e-shared-a-c38c57-serving-cert" not found
Jul 28 20:15:58.303392 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.303349    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b2c0c-8332-49b2-a714-8dd177820341-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.314262 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.314235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdz55\" (UniqueName: \"kubernetes.io/projected/df6b2c0c-8332-49b2-a714-8dd177820341-kube-api-access-fdz55\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.806285 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.806249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.808741 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.808716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls\") pod \"maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:58.993340 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:58.993295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:59.141680 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:59.141653    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"]
Jul 28 20:15:59.143578 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:15:59.143551    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6b2c0c_8332_49b2_a714_8dd177820341.slice/crio-46f7141786e636e192a9bc389e364540707a942a902900a9043e515783dad349 WatchSource:0}: Error finding container 46f7141786e636e192a9bc389e364540707a942a902900a9043e515783dad349: Status 404 returned error can't find the container with id 46f7141786e636e192a9bc389e364540707a942a902900a9043e515783dad349
Jul 28 20:15:59.574524 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:59.574482    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" event={"ID":"df6b2c0c-8332-49b2-a714-8dd177820341","Type":"ContainerStarted","Data":"04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5"}
Jul 28 20:15:59.574659 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:59.574544    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" event={"ID":"df6b2c0c-8332-49b2-a714-8dd177820341","Type":"ContainerStarted","Data":"46f7141786e636e192a9bc389e364540707a942a902900a9043e515783dad349"}
Jul 28 20:15:59.574707 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:59.574680    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:15:59.591418 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:15:59.591349    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" podStartSLOduration=1.238085148 podStartE2EDuration="1.591332971s" totalImagesPullingTime="353.247823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:15:59.59080987 +0000 UTC m=+2778.439343350" watchObservedRunningTime="2026-07-28 20:15:59.591332971 +0000 UTC m=+2778.439866437"
Jul 28 20:16:03.494198 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:03.494118    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:16:05.586265 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:05.586234    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:16:26.360553 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.360513    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"]
Jul 28 20:16:26.364721 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.364701    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.367810 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.367790    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d170bd-serving-cert\""
Jul 28 20:16:26.373628 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.373602    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"]
Jul 28 20:16:26.454184 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.454147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4700004-4adb-44a9-80a9-64d8e4e6db27-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.454184 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.454181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6dr5\" (UniqueName: \"kubernetes.io/projected/b4700004-4adb-44a9-80a9-64d8e4e6db27-kube-api-access-s6dr5\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.454438 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.454212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4700004-4adb-44a9-80a9-64d8e4e6db27-maas-api-tls\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.554744 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.554710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4700004-4adb-44a9-80a9-64d8e4e6db27-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.554744 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.554744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6dr5\" (UniqueName: \"kubernetes.io/projected/b4700004-4adb-44a9-80a9-64d8e4e6db27-kube-api-access-s6dr5\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.555020 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.554772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4700004-4adb-44a9-80a9-64d8e4e6db27-maas-api-tls\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.555431 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.555405    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4700004-4adb-44a9-80a9-64d8e4e6db27-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.557123 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.557103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4700004-4adb-44a9-80a9-64d8e4e6db27-maas-api-tls\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.563249 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.563223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6dr5\" (UniqueName: \"kubernetes.io/projected/b4700004-4adb-44a9-80a9-64d8e4e6db27-kube-api-access-s6dr5\") pod \"maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.676475 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.676380    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:26.816524 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:26.816493    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"]
Jul 28 20:16:26.817543 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:16:26.817512    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4700004_4adb_44a9_80a9_64d8e4e6db27.slice/crio-7e24ecd01d85a16eeee41ee0eeb1b06d6b70a092bd5659b6302df3b566353821 WatchSource:0}: Error finding container 7e24ecd01d85a16eeee41ee0eeb1b06d6b70a092bd5659b6302df3b566353821: Status 404 returned error can't find the container with id 7e24ecd01d85a16eeee41ee0eeb1b06d6b70a092bd5659b6302df3b566353821
Jul 28 20:16:27.720713 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:27.720679    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj" event={"ID":"b4700004-4adb-44a9-80a9-64d8e4e6db27","Type":"ContainerStarted","Data":"2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3"}
Jul 28 20:16:27.721100 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:27.720732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj" event={"ID":"b4700004-4adb-44a9-80a9-64d8e4e6db27","Type":"ContainerStarted","Data":"7e24ecd01d85a16eeee41ee0eeb1b06d6b70a092bd5659b6302df3b566353821"}
Jul 28 20:16:27.721100 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:27.720772    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:27.740193 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:27.740134    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj" podStartSLOduration=1.349315628 podStartE2EDuration="1.740116693s" totalImagesPullingTime="390.801065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:27.737078035 +0000 UTC m=+2806.585611502" watchObservedRunningTime="2026-07-28 20:16:27.740116693 +0000 UTC m=+2806.588650159"
Jul 28 20:16:33.592320 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:33.592280    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:16:33.732973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:33.732943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:16:57.090648 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:16:57.090611    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:17:41.589237 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.589133    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"]
Jul 28 20:17:41.593259 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.593237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.596201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.596174    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d170bd\"/\"openshift-service-ca.crt\""
Jul 28 20:17:41.596354 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.596249    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d170bd\"/\"auth-test-model-d170bd-kserve-self-signed-certs\""
Jul 28 20:17:41.597585 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.597569    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d170bd\"/\"kube-root-ca.crt\""
Jul 28 20:17:41.597684 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.597642    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d170bd\"/\"default-dockercfg-zp99p\""
Jul 28 20:17:41.602726 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.602697    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"]
Jul 28 20:17:41.753215 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.753168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4ssw\" (UniqueName: \"kubernetes.io/projected/8b72889d-c426-4b55-8b2a-5df3277a9c76-kube-api-access-b4ssw\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.753438 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.753279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-tmp-dir\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.753438 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.753350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-home\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.753438 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.753403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-model-cache\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.753438 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.753421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-dshm\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.753598 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.753450    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b72889d-c426-4b55-8b2a-5df3277a9c76-tls-certs\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855020 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.854987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4ssw\" (UniqueName: \"kubernetes.io/projected/8b72889d-c426-4b55-8b2a-5df3277a9c76-kube-api-access-b4ssw\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-tmp-dir\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-home\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-model-cache\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-dshm\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b72889d-c426-4b55-8b2a-5df3277a9c76-tls-certs\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855524 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-home\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855588 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855566    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-model-cache\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.855626 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.855589    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-tmp-dir\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.857742 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.857719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-dshm\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.858064 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.858048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b72889d-c426-4b55-8b2a-5df3277a9c76-tls-certs\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.863771 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.863746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4ssw\" (UniqueName: \"kubernetes.io/projected/8b72889d-c426-4b55-8b2a-5df3277a9c76-kube-api-access-b4ssw\") pod \"auth-test-model-d170bd-kserve-68b4584cbc-rb6qt\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") " pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:41.905252 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:41.905213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:42.044395 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:42.044342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"]
Jul 28 20:17:42.046444 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:17:42.046417    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b72889d_c426_4b55_8b2a_5df3277a9c76.slice/crio-c624eb0e093132419f1a2a2191e0d627a80395020e9a88d0018995c93b528e79 WatchSource:0}: Error finding container c624eb0e093132419f1a2a2191e0d627a80395020e9a88d0018995c93b528e79: Status 404 returned error can't find the container with id c624eb0e093132419f1a2a2191e0d627a80395020e9a88d0018995c93b528e79
Jul 28 20:17:42.138976 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:42.138879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt" event={"ID":"8b72889d-c426-4b55-8b2a-5df3277a9c76","Type":"ContainerStarted","Data":"66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc"}
Jul 28 20:17:42.138976 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:42.138932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt" event={"ID":"8b72889d-c426-4b55-8b2a-5df3277a9c76","Type":"ContainerStarted","Data":"c624eb0e093132419f1a2a2191e0d627a80395020e9a88d0018995c93b528e79"}
Jul 28 20:17:42.157323 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:42.157214    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt" podStartSLOduration=1.157196052 podStartE2EDuration="1.157196052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:17:42.156037884 +0000 UTC m=+2881.004571352" watchObservedRunningTime="2026-07-28 20:17:42.157196052 +0000 UTC m=+2881.005729516"
Jul 28 20:17:45.195006 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:45.194968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:17:51.905678 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:51.905623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:51.905678 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:51.905692    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:51.918566 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:51.918536    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:17:52.202586 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:17:52.202510    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:18:23.093443 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:18:23.093406    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:18:49.088675 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:18:49.088633    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:19:07.787328 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:19:07.787233    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:19:34.292103 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:19:34.292068    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:19:42.016163 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:19:42.016127    2574 scope.go:117] "RemoveContainer" containerID="51815bfb067fbd781e78628130b5c4bcfd2c92ded80913849dcc80ef95b5f048"
Jul 28 20:19:53.083222 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:19:53.083184    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:20:15.986599 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:20:15.986559    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:20:33.096765 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:20:33.096676    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:21:00.181439 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:21:00.181402    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:21:18.291950 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:21:18.291908    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:21:40.791969 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:21:40.791935    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:21:42.047559 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:21:42.047529    2574 scope.go:117] "RemoveContainer" containerID="0321d806a340b9768aa788c56758ec6109f2c20986c323bdc25fb802a150d67a"
Jul 28 20:21:58.890400 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:21:58.890342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:22:25.192882 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:25.192842    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:22:31.173400 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:31.173343    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"]
Jul 28 20:22:41.489567 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:41.489528    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:22:46.194147 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.194098    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt" podUID="8b72889d-c426-4b55-8b2a-5df3277a9c76" containerName="main" containerID="cri-o://66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc" gracePeriod=45
Jul 28 20:22:46.465573 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.465547    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:22:46.561588 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561550    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4ssw\" (UniqueName: \"kubernetes.io/projected/8b72889d-c426-4b55-8b2a-5df3277a9c76-kube-api-access-b4ssw\") pod \"8b72889d-c426-4b55-8b2a-5df3277a9c76\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") "
Jul 28 20:22:46.561588 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561591    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b72889d-c426-4b55-8b2a-5df3277a9c76-tls-certs\") pod \"8b72889d-c426-4b55-8b2a-5df3277a9c76\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") "
Jul 28 20:22:46.561839 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561638    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-dshm\") pod \"8b72889d-c426-4b55-8b2a-5df3277a9c76\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") "
Jul 28 20:22:46.561839 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561709    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-home\") pod \"8b72889d-c426-4b55-8b2a-5df3277a9c76\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") "
Jul 28 20:22:46.561839 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-model-cache\") pod \"8b72889d-c426-4b55-8b2a-5df3277a9c76\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") "
Jul 28 20:22:46.561839 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561790    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-tmp-dir\") pod \"8b72889d-c426-4b55-8b2a-5df3277a9c76\" (UID: \"8b72889d-c426-4b55-8b2a-5df3277a9c76\") "
Jul 28 20:22:46.562055 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.561998    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-home" (OuterVolumeSpecName: "home") pod "8b72889d-c426-4b55-8b2a-5df3277a9c76" (UID: "8b72889d-c426-4b55-8b2a-5df3277a9c76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:46.562055 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.562037    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b72889d-c426-4b55-8b2a-5df3277a9c76" (UID: "8b72889d-c426-4b55-8b2a-5df3277a9c76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:46.562156 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.562131    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b72889d-c426-4b55-8b2a-5df3277a9c76" (UID: "8b72889d-c426-4b55-8b2a-5df3277a9c76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:46.562215 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.562204    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-home\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:22:46.562276 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.562221    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-model-cache\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:22:46.563934 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.563909    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-dshm" (OuterVolumeSpecName: "dshm") pod "8b72889d-c426-4b55-8b2a-5df3277a9c76" (UID: "8b72889d-c426-4b55-8b2a-5df3277a9c76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:46.564065 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.563977    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b72889d-c426-4b55-8b2a-5df3277a9c76-kube-api-access-b4ssw" (OuterVolumeSpecName: "kube-api-access-b4ssw") pod "8b72889d-c426-4b55-8b2a-5df3277a9c76" (UID: "8b72889d-c426-4b55-8b2a-5df3277a9c76"). InnerVolumeSpecName "kube-api-access-b4ssw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:22:46.564065 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.564019    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b72889d-c426-4b55-8b2a-5df3277a9c76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b72889d-c426-4b55-8b2a-5df3277a9c76" (UID: "8b72889d-c426-4b55-8b2a-5df3277a9c76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:22:46.663716 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.663674    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-tmp-dir\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:22:46.663716 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.663713    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4ssw\" (UniqueName: \"kubernetes.io/projected/8b72889d-c426-4b55-8b2a-5df3277a9c76-kube-api-access-b4ssw\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:22:46.663716 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.663722    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b72889d-c426-4b55-8b2a-5df3277a9c76-tls-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:22:46.663967 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.663731    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b72889d-c426-4b55-8b2a-5df3277a9c76-dshm\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:22:46.779400 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.779286    2574 generic.go:356] "Generic (PLEG): container finished" podID="8b72889d-c426-4b55-8b2a-5df3277a9c76" containerID="66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc" exitCode=0
Jul 28 20:22:46.779400 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.779334    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"
Jul 28 20:22:46.779400 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.779348    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt" event={"ID":"8b72889d-c426-4b55-8b2a-5df3277a9c76","Type":"ContainerDied","Data":"66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc"}
Jul 28 20:22:46.779757 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.779434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt" event={"ID":"8b72889d-c426-4b55-8b2a-5df3277a9c76","Type":"ContainerDied","Data":"c624eb0e093132419f1a2a2191e0d627a80395020e9a88d0018995c93b528e79"}
Jul 28 20:22:46.779757 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.779470    2574 scope.go:117] "RemoveContainer" containerID="66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc"
Jul 28 20:22:46.791188 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.791168    2574 scope.go:117] "RemoveContainer" containerID="66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc"
Jul 28 20:22:46.791529 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:22:46.791509    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc\": container with ID starting with 66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc not found: ID does not exist" containerID="66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc"
Jul 28 20:22:46.791617 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.791535    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc"} err="failed to get container status \"66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc\": rpc error: code = NotFound desc = could not find container \"66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc\": container with ID starting with 66a1122f2e6ac82bb2c084f419717996d2acc3d6712bbbe3bfde1c21524431dc not found: ID does not exist"
Jul 28 20:22:46.803054 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.803023    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"]
Jul 28 20:22:46.807886 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:46.807803    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d170bd/auth-test-model-d170bd-kserve-68b4584cbc-rb6qt"]
Jul 28 20:22:47.710428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:47.710385    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b72889d-c426-4b55-8b2a-5df3277a9c76" path="/var/lib/kubelet/pods/8b72889d-c426-4b55-8b2a-5df3277a9c76/volumes"
Jul 28 20:22:51.588456 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:51.588419    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:22:59.888470 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:22:59.888430    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:23:35.107064 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:23:35.106968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:23:54.896250 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:23:54.896187    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:24:13.914463 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:13.914423    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:24:32.106333 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.106297    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"]
Jul 28 20:24:32.106811 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.106734    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b72889d-c426-4b55-8b2a-5df3277a9c76" containerName="main"
Jul 28 20:24:32.106811 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.106746    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b72889d-c426-4b55-8b2a-5df3277a9c76" containerName="main"
Jul 28 20:24:32.106896 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.106824    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b72889d-c426-4b55-8b2a-5df3277a9c76" containerName="main"
Jul 28 20:24:32.109745 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.109728    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.113246 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.113222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c38c57\"/\"rate-test-model-c38c57-kserve-self-signed-certs\""
Jul 28 20:24:32.113345 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.113243    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c38c57\"/\"openshift-service-ca.crt\""
Jul 28 20:24:32.114574 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.114549    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c38c57\"/\"kube-root-ca.crt\""
Jul 28 20:24:32.115065 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.115051    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c38c57\"/\"default-dockercfg-hdtxl\""
Jul 28 20:24:32.122922 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.122904    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"]
Jul 28 20:24:32.196619 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.196585    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zd7r4"]
Jul 28 20:24:32.200294 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.200276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:32.210592 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.210563    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zd7r4"]
Jul 28 20:24:32.249836 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.249803    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-tmp-dir\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.249836 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.249837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-home\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.250046 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.249865    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw4t2\" (UniqueName: \"kubernetes.io/projected/18e67ad8-5650-4ff5-a5a2-4045e708480e-kube-api-access-vw4t2\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.250046 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.249930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-dshm\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.250046 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.249976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e67ad8-5650-4ff5-a5a2-4045e708480e-tls-certs\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.250046 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.250032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-model-cache\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.350690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350655    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-model-cache\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.350889 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq92k\" (UniqueName: \"kubernetes.io/projected/17254653-e277-447c-a268-8edd8e73654d-kube-api-access-qq92k\") pod \"kuadrant-operator-catalog-zd7r4\" (UID: \"17254653-e277-447c-a268-8edd8e73654d\") " pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:32.350889 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-tmp-dir\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.350889 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-home\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.350889 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw4t2\" (UniqueName: \"kubernetes.io/projected/18e67ad8-5650-4ff5-a5a2-4045e708480e-kube-api-access-vw4t2\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.351107 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-dshm\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.351107 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.350932    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e67ad8-5650-4ff5-a5a2-4045e708480e-tls-certs\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.351201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.351099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-model-cache\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.351201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.351112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-tmp-dir\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.351201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.351194    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-home\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.353240 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.353216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-dshm\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.353682 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.353659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e67ad8-5650-4ff5-a5a2-4045e708480e-tls-certs\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.360514 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.360465    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw4t2\" (UniqueName: \"kubernetes.io/projected/18e67ad8-5650-4ff5-a5a2-4045e708480e-kube-api-access-vw4t2\") pod \"rate-test-model-c38c57-kserve-67f958c5f-g9bhb\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") " pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.420049 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.420016    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:32.452474 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.452442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq92k\" (UniqueName: \"kubernetes.io/projected/17254653-e277-447c-a268-8edd8e73654d-kube-api-access-qq92k\") pod \"kuadrant-operator-catalog-zd7r4\" (UID: \"17254653-e277-447c-a268-8edd8e73654d\") " pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:32.462331 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.462306    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq92k\" (UniqueName: \"kubernetes.io/projected/17254653-e277-447c-a268-8edd8e73654d-kube-api-access-qq92k\") pod \"kuadrant-operator-catalog-zd7r4\" (UID: \"17254653-e277-447c-a268-8edd8e73654d\") " pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:32.511777 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.511742    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:32.573562 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.573519    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"]
Jul 28 20:24:32.575036 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:24:32.575009    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18e67ad8_5650_4ff5_a5a2_4045e708480e.slice/crio-463089feb46f5bd8d28c14505ec8a74006ca2b04839203e98dfa2fa47d0cf109 WatchSource:0}: Error finding container 463089feb46f5bd8d28c14505ec8a74006ca2b04839203e98dfa2fa47d0cf109: Status 404 returned error can't find the container with id 463089feb46f5bd8d28c14505ec8a74006ca2b04839203e98dfa2fa47d0cf109
Jul 28 20:24:32.681910 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.681867    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zd7r4"]
Jul 28 20:24:32.685406 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:24:32.684977    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17254653_e277_447c_a268_8edd8e73654d.slice/crio-c05d7f5cc3c14bdbee972acea9da0ad32f75d1139cfb66548e8f049a556995ff WatchSource:0}: Error finding container c05d7f5cc3c14bdbee972acea9da0ad32f75d1139cfb66548e8f049a556995ff: Status 404 returned error can't find the container with id c05d7f5cc3c14bdbee972acea9da0ad32f75d1139cfb66548e8f049a556995ff
Jul 28 20:24:32.687445 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:32.687428    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:24:33.364353 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.364308    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4" event={"ID":"17254653-e277-447c-a268-8edd8e73654d","Type":"ContainerStarted","Data":"92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82"}
Jul 28 20:24:33.364803 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.364394    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4" event={"ID":"17254653-e277-447c-a268-8edd8e73654d","Type":"ContainerStarted","Data":"c05d7f5cc3c14bdbee972acea9da0ad32f75d1139cfb66548e8f049a556995ff"}
Jul 28 20:24:33.366290 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.366262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb" event={"ID":"18e67ad8-5650-4ff5-a5a2-4045e708480e","Type":"ContainerStarted","Data":"5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7"}
Jul 28 20:24:33.366420 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.366301    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb" event={"ID":"18e67ad8-5650-4ff5-a5a2-4045e708480e","Type":"ContainerStarted","Data":"463089feb46f5bd8d28c14505ec8a74006ca2b04839203e98dfa2fa47d0cf109"}
Jul 28 20:24:33.386053 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.386010    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4" podStartSLOduration=0.913135356 podStartE2EDuration="1.385993422s" totalImagesPullingTime="472.858066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:24:33.384228919 +0000 UTC m=+3292.232762388" watchObservedRunningTime="2026-07-28 20:24:33.385993422 +0000 UTC m=+3292.234526890"
Jul 28 20:24:33.412307 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.412224    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb" podStartSLOduration=1.412209157 podStartE2EDuration="1.412209157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:24:33.412124629 +0000 UTC m=+3292.260658096" watchObservedRunningTime="2026-07-28 20:24:33.412209157 +0000 UTC m=+3292.260742601"
Jul 28 20:24:33.517436 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:33.517402    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:24:42.110426 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.110388    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:24:42.420580 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.420482    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:42.420580 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.420534    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:42.433839 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.433805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:42.512519 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.512483    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:42.512721 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.512549    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:42.536634 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:42.536608    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:43.429311 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:43.429279    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:24:43.447956 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:43.447916    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:43.483084 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:43.483041    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zd7r4"]
Jul 28 20:24:45.428687 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:45.428618    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4" podUID="17254653-e277-447c-a268-8edd8e73654d" containerName="registry-server" containerID="cri-o://92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82" gracePeriod=2
Jul 28 20:24:45.695510 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:45.695437    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:45.776327 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:45.776290    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq92k\" (UniqueName: \"kubernetes.io/projected/17254653-e277-447c-a268-8edd8e73654d-kube-api-access-qq92k\") pod \"17254653-e277-447c-a268-8edd8e73654d\" (UID: \"17254653-e277-447c-a268-8edd8e73654d\") "
Jul 28 20:24:45.778481 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:45.778455    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17254653-e277-447c-a268-8edd8e73654d-kube-api-access-qq92k" (OuterVolumeSpecName: "kube-api-access-qq92k") pod "17254653-e277-447c-a268-8edd8e73654d" (UID: "17254653-e277-447c-a268-8edd8e73654d"). InnerVolumeSpecName "kube-api-access-qq92k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:24:45.877069 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:45.877024    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq92k\" (UniqueName: \"kubernetes.io/projected/17254653-e277-447c-a268-8edd8e73654d-kube-api-access-qq92k\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:24:46.440034 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.439991    2574 generic.go:356] "Generic (PLEG): container finished" podID="17254653-e277-447c-a268-8edd8e73654d" containerID="92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82" exitCode=0
Jul 28 20:24:46.440034 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.440035    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4"
Jul 28 20:24:46.440605 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.440064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4" event={"ID":"17254653-e277-447c-a268-8edd8e73654d","Type":"ContainerDied","Data":"92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82"}
Jul 28 20:24:46.440605 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.440119    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zd7r4" event={"ID":"17254653-e277-447c-a268-8edd8e73654d","Type":"ContainerDied","Data":"c05d7f5cc3c14bdbee972acea9da0ad32f75d1139cfb66548e8f049a556995ff"}
Jul 28 20:24:46.440605 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.440141    2574 scope.go:117] "RemoveContainer" containerID="92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82"
Jul 28 20:24:46.450442 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.450422    2574 scope.go:117] "RemoveContainer" containerID="92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82"
Jul 28 20:24:46.450719 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:24:46.450701    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82\": container with ID starting with 92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82 not found: ID does not exist" containerID="92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82"
Jul 28 20:24:46.450763 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.450730    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82"} err="failed to get container status \"92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82\": rpc error: code = NotFound desc = could not find container \"92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82\": container with ID starting with 92cb7bcc8e250bbbaf48eb36f6a3febc536beb18322ad380f58d68380fdd6e82 not found: ID does not exist"
Jul 28 20:24:46.463111 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.463078    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zd7r4"]
Jul 28 20:24:46.469252 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:46.469229    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zd7r4"]
Jul 28 20:24:47.709888 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:47.709850    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17254653-e277-447c-a268-8edd8e73654d" path="/var/lib/kubelet/pods/17254653-e277-447c-a268-8edd8e73654d/volumes"
Jul 28 20:24:54.553790 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:24:54.553756    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:25:35.596185 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:25:35.596145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:25:53.794041 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:25:53.794007    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:26:14.086547 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:14.086506    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:26:20.013268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:20.013224    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"]
Jul 28 20:26:27.889091 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:27.889054    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:26:35.033629 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.033540    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb" podUID="18e67ad8-5650-4ff5-a5a2-4045e708480e" containerName="main" containerID="cri-o://5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7" gracePeriod=45
Jul 28 20:26:35.291881 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.291817    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:26:35.339633 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339602    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-home\") pod \"18e67ad8-5650-4ff5-a5a2-4045e708480e\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") "
Jul 28 20:26:35.339793 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339658    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw4t2\" (UniqueName: \"kubernetes.io/projected/18e67ad8-5650-4ff5-a5a2-4045e708480e-kube-api-access-vw4t2\") pod \"18e67ad8-5650-4ff5-a5a2-4045e708480e\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") "
Jul 28 20:26:35.339793 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339710    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-tmp-dir\") pod \"18e67ad8-5650-4ff5-a5a2-4045e708480e\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") "
Jul 28 20:26:35.339793 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339733    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-dshm\") pod \"18e67ad8-5650-4ff5-a5a2-4045e708480e\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") "
Jul 28 20:26:35.339793 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339756    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-model-cache\") pod \"18e67ad8-5650-4ff5-a5a2-4045e708480e\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") "
Jul 28 20:26:35.339991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339836    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e67ad8-5650-4ff5-a5a2-4045e708480e-tls-certs\") pod \"18e67ad8-5650-4ff5-a5a2-4045e708480e\" (UID: \"18e67ad8-5650-4ff5-a5a2-4045e708480e\") "
Jul 28 20:26:35.339991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.339872    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-home" (OuterVolumeSpecName: "home") pod "18e67ad8-5650-4ff5-a5a2-4045e708480e" (UID: "18e67ad8-5650-4ff5-a5a2-4045e708480e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:35.340109 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.340011    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18e67ad8-5650-4ff5-a5a2-4045e708480e" (UID: "18e67ad8-5650-4ff5-a5a2-4045e708480e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:35.340109 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.340023    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-model-cache" (OuterVolumeSpecName: "model-cache") pod "18e67ad8-5650-4ff5-a5a2-4045e708480e" (UID: "18e67ad8-5650-4ff5-a5a2-4045e708480e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:35.340219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.340134    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-tmp-dir\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:26:35.340219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.340149    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-model-cache\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:26:35.340219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.340158    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-home\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:26:35.342002 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.341981    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-dshm" (OuterVolumeSpecName: "dshm") pod "18e67ad8-5650-4ff5-a5a2-4045e708480e" (UID: "18e67ad8-5650-4ff5-a5a2-4045e708480e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:35.342002 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.341988    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e67ad8-5650-4ff5-a5a2-4045e708480e-kube-api-access-vw4t2" (OuterVolumeSpecName: "kube-api-access-vw4t2") pod "18e67ad8-5650-4ff5-a5a2-4045e708480e" (UID: "18e67ad8-5650-4ff5-a5a2-4045e708480e"). InnerVolumeSpecName "kube-api-access-vw4t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:35.342002 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.341989    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18e67ad8-5650-4ff5-a5a2-4045e708480e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18e67ad8-5650-4ff5-a5a2-4045e708480e" (UID: "18e67ad8-5650-4ff5-a5a2-4045e708480e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:26:35.440882 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.440847    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18e67ad8-5650-4ff5-a5a2-4045e708480e-dshm\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:26:35.440882 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.440876    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18e67ad8-5650-4ff5-a5a2-4045e708480e-tls-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:26:35.440882 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:35.440887    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw4t2\" (UniqueName: \"kubernetes.io/projected/18e67ad8-5650-4ff5-a5a2-4045e708480e-kube-api-access-vw4t2\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:26:36.022290 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.022189    2574 generic.go:356] "Generic (PLEG): container finished" podID="18e67ad8-5650-4ff5-a5a2-4045e708480e" containerID="5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7" exitCode=0
Jul 28 20:26:36.022290 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.022243    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb" event={"ID":"18e67ad8-5650-4ff5-a5a2-4045e708480e","Type":"ContainerDied","Data":"5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7"}
Jul 28 20:26:36.022290 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.022246    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"
Jul 28 20:26:36.022290 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.022274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb" event={"ID":"18e67ad8-5650-4ff5-a5a2-4045e708480e","Type":"ContainerDied","Data":"463089feb46f5bd8d28c14505ec8a74006ca2b04839203e98dfa2fa47d0cf109"}
Jul 28 20:26:36.022290 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.022291    2574 scope.go:117] "RemoveContainer" containerID="5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7"
Jul 28 20:26:36.032855 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.032833    2574 scope.go:117] "RemoveContainer" containerID="5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7"
Jul 28 20:26:36.033132 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:26:36.033103    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7\": container with ID starting with 5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7 not found: ID does not exist" containerID="5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7"
Jul 28 20:26:36.033214 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.033131    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7"} err="failed to get container status \"5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7\": rpc error: code = NotFound desc = could not find container \"5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7\": container with ID starting with 5356dd2e9cf37e839d814242009b4cf13152317177121397402bf369f4aac2c7 not found: ID does not exist"
Jul 28 20:26:36.040136 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.040110    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"]
Jul 28 20:26:36.043811 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:36.043788    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c38c57/rate-test-model-c38c57-kserve-67f958c5f-g9bhb"]
Jul 28 20:26:37.709811 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:37.709770    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e67ad8-5650-4ff5-a5a2-4045e708480e" path="/var/lib/kubelet/pods/18e67ad8-5650-4ff5-a5a2-4045e708480e/volumes"
Jul 28 20:26:40.559570 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.559469    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"]
Jul 28 20:26:40.560115 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.560097    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17254653-e277-447c-a268-8edd8e73654d" containerName="registry-server"
Jul 28 20:26:40.560178 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.560116    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17254653-e277-447c-a268-8edd8e73654d" containerName="registry-server"
Jul 28 20:26:40.560178 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.560136    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e67ad8-5650-4ff5-a5a2-4045e708480e" containerName="main"
Jul 28 20:26:40.560178 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.560141    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e67ad8-5650-4ff5-a5a2-4045e708480e" containerName="main"
Jul 28 20:26:40.560344 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.560203    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e67ad8-5650-4ff5-a5a2-4045e708480e" containerName="main"
Jul 28 20:26:40.560344 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.560217    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="17254653-e277-447c-a268-8edd8e73654d" containerName="registry-server"
Jul 28 20:26:40.564944 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.564921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.568728 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.568704    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 20:26:40.568860 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.568765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-06df9a-openshift-default-dockercfg-hfr7x\""
Jul 28 20:26:40.578651 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.578621    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"]
Jul 28 20:26:40.690508 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-podinfo\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690508 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-certs\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690751 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690531    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30d78efb-f592-4921-a3f1-c5aed2a0f168-istiod-ca-cert\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690751 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690652    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-socket\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690751 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-data\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690751 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2bj8\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-kube-api-access-j2bj8\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690904 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690770    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-credential-socket\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690904 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-token\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.690904 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.690835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-envoy\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791308 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-socket\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791308 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-data\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791565 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2bj8\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-kube-api-access-j2bj8\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791565 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-credential-socket\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791565 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-token\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-envoy\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-podinfo\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-certs\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-socket\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30d78efb-f592-4921-a3f1-c5aed2a0f168-istiod-ca-cert\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791749    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-data\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.791795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.791770    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-credential-socket\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.792175 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.792049    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-certs\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.792557 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.792534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30d78efb-f592-4921-a3f1-c5aed2a0f168-istiod-ca-cert\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.794021 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.793997    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-envoy\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.794254 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.794234    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-podinfo\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.805891 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.805864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2bj8\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-kube-api-access-j2bj8\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.820502 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.820428    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-token\") pod \"e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") " pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:40.876684 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:40.876650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:41.019771 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:41.019745    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"]
Jul 28 20:26:41.021250 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:26:41.021224    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d78efb_f592_4921_a3f1_c5aed2a0f168.slice/crio-3f7e28d3cab7d163ac0e2921e532250f1f23a138e8e06e9ae03f23376ab8711f WatchSource:0}: Error finding container 3f7e28d3cab7d163ac0e2921e532250f1f23a138e8e06e9ae03f23376ab8711f: Status 404 returned error can't find the container with id 3f7e28d3cab7d163ac0e2921e532250f1f23a138e8e06e9ae03f23376ab8711f
Jul 28 20:26:41.050947 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:41.050910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" event={"ID":"30d78efb-f592-4921-a3f1-c5aed2a0f168","Type":"ContainerStarted","Data":"3f7e28d3cab7d163ac0e2921e532250f1f23a138e8e06e9ae03f23376ab8711f"}
Jul 28 20:26:44.381193 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:44.381155    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:44.381497 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:44.381232    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:44.381497 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:44.381261    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:45.077615 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:45.077577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" event={"ID":"30d78efb-f592-4921-a3f1-c5aed2a0f168","Type":"ContainerStarted","Data":"c2f5a7a437c6bfc5f0fc168d9a42fa7624fb7e2790941426b3f62d4ac9c4775a"}
Jul 28 20:26:45.104601 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:45.104545    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podStartSLOduration=1.747215884 podStartE2EDuration="5.104524909s" totalImagesPullingTime="3.357309025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:45.102887105 +0000 UTC m=+3423.951420571" watchObservedRunningTime="2026-07-28 20:26:45.104524909 +0000 UTC m=+3423.953058376"
Jul 28 20:26:45.877102 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:45.877066    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:45.882541 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:45.882515    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:46.082464 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:46.082426    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:46.083556 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:46.083535    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:26:47.241325 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.241289    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"]
Jul 28 20:26:47.245411 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.245388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.248706 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.248679    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-06df9a-serving-cert\""
Jul 28 20:26:47.256495 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.256468    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"]
Jul 28 20:26:47.356816 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.356781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e99e031-471e-40d2-a482-b6c1ba884e15-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.357033 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.356890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2tb5\" (UniqueName: \"kubernetes.io/projected/9e99e031-471e-40d2-a482-b6c1ba884e15-kube-api-access-p2tb5\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.357033 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.356937    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e99e031-471e-40d2-a482-b6c1ba884e15-maas-api-tls\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.458129 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.458085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2tb5\" (UniqueName: \"kubernetes.io/projected/9e99e031-471e-40d2-a482-b6c1ba884e15-kube-api-access-p2tb5\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.458354 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.458147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e99e031-471e-40d2-a482-b6c1ba884e15-maas-api-tls\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.458354 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.458224    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e99e031-471e-40d2-a482-b6c1ba884e15-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.458942 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.458916    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e99e031-471e-40d2-a482-b6c1ba884e15-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.460559 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.460538    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e99e031-471e-40d2-a482-b6c1ba884e15-maas-api-tls\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.467619 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.467587    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2tb5\" (UniqueName: \"kubernetes.io/projected/9e99e031-471e-40d2-a482-b6c1ba884e15-kube-api-access-p2tb5\") pod \"maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.557737 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.557638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:47.701049 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:47.701019    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"]
Jul 28 20:26:47.702742 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:26:47.702684    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e99e031_471e_40d2_a482_b6c1ba884e15.slice/crio-c20a3e543a762c5697e5e5b29207efc390936a28cf2228e1e217b290ab629359 WatchSource:0}: Error finding container c20a3e543a762c5697e5e5b29207efc390936a28cf2228e1e217b290ab629359: Status 404 returned error can't find the container with id c20a3e543a762c5697e5e5b29207efc390936a28cf2228e1e217b290ab629359
Jul 28 20:26:48.094151 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:48.094110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2" event={"ID":"9e99e031-471e-40d2-a482-b6c1ba884e15","Type":"ContainerStarted","Data":"c20a3e543a762c5697e5e5b29207efc390936a28cf2228e1e217b290ab629359"}
Jul 28 20:26:49.101608 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:49.101570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2" event={"ID":"9e99e031-471e-40d2-a482-b6c1ba884e15","Type":"ContainerStarted","Data":"4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044"}
Jul 28 20:26:49.102008 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:49.101699    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:26:49.120845 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:49.120796    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2" podStartSLOduration=1.264270898 podStartE2EDuration="2.120781341s" totalImagesPullingTime="856.510443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:49.118601193 +0000 UTC m=+3427.967134660" watchObservedRunningTime="2026-07-28 20:26:49.120781341 +0000 UTC m=+3427.969314825"
Jul 28 20:26:51.698880 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:51.698840    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:26:55.112817 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:26:55.112787    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:27:00.173232 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:00.173191    2574 generic.go:356] "Generic (PLEG): container finished" podID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerID="c2f5a7a437c6bfc5f0fc168d9a42fa7624fb7e2790941426b3f62d4ac9c4775a" exitCode=0
Jul 28 20:27:00.173780 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:00.173265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" event={"ID":"30d78efb-f592-4921-a3f1-c5aed2a0f168","Type":"ContainerDied","Data":"c2f5a7a437c6bfc5f0fc168d9a42fa7624fb7e2790941426b3f62d4ac9c4775a"}
Jul 28 20:27:00.173780 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:00.173692    2574 scope.go:117] "RemoveContainer" containerID="c2f5a7a437c6bfc5f0fc168d9a42fa7624fb7e2790941426b3f62d4ac9c4775a"
Jul 28 20:27:00.174751 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:00.174721    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:00.174827 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:00.174811    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:00.174874 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:00.174843    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:01.083135 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:01.083098    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:27:01.180934 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:01.180897    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" event={"ID":"30d78efb-f592-4921-a3f1-c5aed2a0f168","Type":"ContainerStarted","Data":"ff49063621d0b323ff6c99f4fa25647491f5ab0b7316b012b48690efc108f65e"}
Jul 28 20:27:01.877817 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:01.877780    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:27:01.878869 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:01.878842    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 20:27:01.878978 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:01.878895    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 20:27:02.877906 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:02.877867    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 20:27:02.878331 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:02.877928    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 20:27:03.877991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:03.877954    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 20:27:03.878425 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:03.878040    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 20:27:04.877453 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:04.877414    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 20:27:04.877634 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:04.877479    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 20:27:05.880911 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:05.880880    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:27:05.881303 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:05.881170    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:27:05.881989 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:05.881971    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:27:12.979297 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:12.979255    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"]
Jul 28 20:27:12.987423 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:12.987396    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:12.996002 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:12.995972    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-426065-openshift-default-dockercfg-c2j7h\""
Jul 28 20:27:13.013053 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-certs\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznvn\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-kube-api-access-nznvn\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-podinfo\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013185    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istiod-ca-cert\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013331 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013221    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-envoy\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013331 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-credential-socket\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013331 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-token\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013499 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-data\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.013499 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.013437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-socket\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.025883 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.025853    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"]
Jul 28 20:27:13.114472 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-certs\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nznvn\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-kube-api-access-nznvn\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-podinfo\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istiod-ca-cert\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-envoy\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-credential-socket\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-token\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.114690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114655    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-data\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.115059 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-socket\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.115059 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.114909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-certs\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.115059 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.115007    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-socket\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.115227 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.115152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-data\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.115309 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.115274    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-credential-socket\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.115580 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.115559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istiod-ca-cert\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.117537 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.117508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-envoy\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.117705 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.117689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-podinfo\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.126475 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.126445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-token\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.126475 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.126457    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznvn\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-kube-api-access-nznvn\") pod \"e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") " pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.297845 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.297740    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:13.444031 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.444001    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"]
Jul 28 20:27:13.446039 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:27:13.446010    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf5b5fe_63e4_4aa5_9da9_d48f0d7e114c.slice/crio-65efc434e4659818592d16630b742302af30fae15390b5220d31dab89e027419 WatchSource:0}: Error finding container 65efc434e4659818592d16630b742302af30fae15390b5220d31dab89e027419: Status 404 returned error can't find the container with id 65efc434e4659818592d16630b742302af30fae15390b5220d31dab89e027419
Jul 28 20:27:13.448532 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.448489    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:13.448618 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.448579    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:13.448660 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:13.448617    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:14.251300 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:14.251262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" event={"ID":"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c","Type":"ContainerStarted","Data":"36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"}
Jul 28 20:27:14.251747 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:14.251323    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" event={"ID":"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c","Type":"ContainerStarted","Data":"65efc434e4659818592d16630b742302af30fae15390b5220d31dab89e027419"}
Jul 28 20:27:14.273026 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:14.272971    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" podStartSLOduration=2.272953157 podStartE2EDuration="2.272953157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:27:14.271533219 +0000 UTC m=+3453.120066688" watchObservedRunningTime="2026-07-28 20:27:14.272953157 +0000 UTC m=+3453.121486623"
Jul 28 20:27:14.298489 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:14.298451    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:14.303974 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:14.303947    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:15.257372 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:15.257333    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:15.258566 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:15.258547    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:25.890449 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:25.890412    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:27:34.366414 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:34.366382    2574 generic.go:356] "Generic (PLEG): container finished" podID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerID="36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188" exitCode=0
Jul 28 20:27:34.366864 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:34.366454    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" event={"ID":"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c","Type":"ContainerDied","Data":"36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"}
Jul 28 20:27:34.366931 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:34.366915    2574 scope.go:117] "RemoveContainer" containerID="36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"
Jul 28 20:27:34.368095 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:34.368060    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:34.368209 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:34.368153    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:34.368209 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:34.368202    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:35.374279 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:35.374240    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" event={"ID":"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c","Type":"ContainerStarted","Data":"9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177"}
Jul 28 20:27:36.298238 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:36.298203    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:36.298459 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:36.298438    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:27:36.298535 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:36.298490    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 28 20:27:37.298890 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:37.298858    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:27:37.299396 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:37.299340    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 28 20:27:38.299108 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:38.299072    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:27:38.299570 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:38.299142    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 28 20:27:39.299036 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:39.299000    2574 patch_prober.go:28] interesting pod/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:27:39.299217 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:39.299054    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 28 20:27:40.301747 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:40.301718    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:40.302197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:40.302116    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:27:40.302886 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:27:40.302863    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:28:04.285692 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:04.285596    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:28:32.792296 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:32.792261    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:28:43.764144 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.764107    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"]
Jul 28 20:28:43.768728 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.768706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.771613 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.771591    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-0fc004-openshift-default-dockercfg-mf9j9\""
Jul 28 20:28:43.780006 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.779977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"]
Jul 28 20:28:43.930453 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdzmc\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-kube-api-access-fdzmc\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930453 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930457    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istiod-ca-cert\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-certs\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-podinfo\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-credential-socket\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-envoy\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-socket\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930985 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-token\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:43.930985 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:43.930819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-data\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032181 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032077    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-envoy\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032399 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032228    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-socket\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032399 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-token\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032399 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-data\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032399 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdzmc\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-kube-api-access-fdzmc\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032650 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032416    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istiod-ca-cert\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032650 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-certs\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032650 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-podinfo\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032650 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-credential-socket\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032863 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-socket\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032863 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-data\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032880    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-credential-socket\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.032973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.032937    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-certs\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.033418 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.033343    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istiod-ca-cert\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.034880 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.034857    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-envoy\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.035649 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.035630    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-podinfo\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.042240 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.042211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-token\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.042809 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.042790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdzmc\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-kube-api-access-fdzmc\") pod \"e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") " pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.080523 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.080498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:44.229119 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.229081    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"]
Jul 28 20:28:44.230426 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:28:44.230399    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2582c3f3_132d_4806_ac6c_0b10d14a0a41.slice/crio-27c84d8f6f45d2cc65ff5036955c6b36af21014a1bd175763da1d35460ccfbbd WatchSource:0}: Error finding container 27c84d8f6f45d2cc65ff5036955c6b36af21014a1bd175763da1d35460ccfbbd: Status 404 returned error can't find the container with id 27c84d8f6f45d2cc65ff5036955c6b36af21014a1bd175763da1d35460ccfbbd
Jul 28 20:28:44.233191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.233154    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:28:44.233309 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.233221    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:28:44.233309 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.233257    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:28:44.757968 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.757928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" event={"ID":"2582c3f3-132d-4806-ac6c-0b10d14a0a41","Type":"ContainerStarted","Data":"8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"}
Jul 28 20:28:44.758147 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.758013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" event={"ID":"2582c3f3-132d-4806-ac6c-0b10d14a0a41","Type":"ContainerStarted","Data":"27c84d8f6f45d2cc65ff5036955c6b36af21014a1bd175763da1d35460ccfbbd"}
Jul 28 20:28:44.780198 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:44.780144    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podStartSLOduration=1.780128331 podStartE2EDuration="1.780128331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:28:44.778843764 +0000 UTC m=+3543.627377228" watchObservedRunningTime="2026-07-28 20:28:44.780128331 +0000 UTC m=+3543.628661798"
Jul 28 20:28:45.080941 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:45.080839    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:45.086220 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:45.086192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:45.763630 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:45.763597    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:45.764771 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:45.764747    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:28:52.391330 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:28:52.391288    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:29:00.765118 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.765084    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 20:29:00.765525 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.765155    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 20:29:00.848231 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.848191    2574 generic.go:356] "Generic (PLEG): container finished" podID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerID="8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0" exitCode=0
Jul 28 20:29:00.848454 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.848267    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" event={"ID":"2582c3f3-132d-4806-ac6c-0b10d14a0a41","Type":"ContainerDied","Data":"8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"}
Jul 28 20:29:00.848795 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.848778    2574 scope.go:117] "RemoveContainer" containerID="8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"
Jul 28 20:29:00.850058 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.850031    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:29:00.850115 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.850100    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:29:00.850152 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:00.850142    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:29:01.859285 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:01.859251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" event={"ID":"2582c3f3-132d-4806-ac6c-0b10d14a0a41","Type":"ContainerStarted","Data":"82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d"}
Jul 28 20:29:02.080656 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:02.080626    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:29:02.080855 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:02.080836    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 20:29:02.080937 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:02.080909    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 20:29:03.081598 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:03.081558    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 20:29:03.082013 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:03.081631    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 20:29:04.081782 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:04.081745    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 20:29:04.082197 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:04.081835    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 20:29:05.081672 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:05.081631    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 20:29:05.081873 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:05.081702    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 20:29:06.085095 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:06.085066    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:29:06.085518 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:06.085398    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:29:06.086195 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:06.086179    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:29:21.896594 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:21.896558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:29:24.441266 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:24.441225    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"]
Jul 28 20:29:24.441892 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:24.441537    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy" containerID="cri-o://82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d" gracePeriod=30
Jul 28 20:29:29.708729 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.708658    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:29:29.804692 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804648    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-certs\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804692 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804690    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-socket\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804961 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804749    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-credential-socket\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804961 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804778    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-podinfo\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804961 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804798    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-data\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804961 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804843    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istiod-ca-cert\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804961 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804902    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdzmc\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-kube-api-access-fdzmc\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.804961 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804934    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-envoy\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.805295 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.804993    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-token\") pod \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\" (UID: \"2582c3f3-132d-4806-ac6c-0b10d14a0a41\") "
Jul 28 20:29:29.805295 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.805010    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:29:29.805295 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.805143    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:29:29.805295 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.805158    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:29:29.805566 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.805432    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:29.805987 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.805958    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-data" (OuterVolumeSpecName: "istio-data") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:29:29.806196 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.806177    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.806268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.806198    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-workload-socket\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.806268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.806208    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-credential-socket\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.806268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.806217    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-data\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.806268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.806226    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istiod-ca-cert\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.807574 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.807546    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-token" (OuterVolumeSpecName: "istio-token") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:29.807721 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.807703    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-kube-api-access-fdzmc" (OuterVolumeSpecName: "kube-api-access-fdzmc") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "kube-api-access-fdzmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:29.807831 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.807811    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:29:29.807888 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.807838    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2582c3f3-132d-4806-ac6c-0b10d14a0a41" (UID: "2582c3f3-132d-4806-ac6c-0b10d14a0a41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:29:29.906866 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.906830    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-podinfo\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.906866 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.906861    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdzmc\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-kube-api-access-fdzmc\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.906866 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.906871    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-envoy\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:29.907110 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:29.906879    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2582c3f3-132d-4806-ac6c-0b10d14a0a41-istio-token\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:30.025763 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.025666    2574 generic.go:356] "Generic (PLEG): container finished" podID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerID="82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d" exitCode=0
Jul 28 20:29:30.025763 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.025722    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"
Jul 28 20:29:30.025942 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.025759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" event={"ID":"2582c3f3-132d-4806-ac6c-0b10d14a0a41","Type":"ContainerDied","Data":"82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d"}
Jul 28 20:29:30.025942 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.025818    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx" event={"ID":"2582c3f3-132d-4806-ac6c-0b10d14a0a41","Type":"ContainerDied","Data":"27c84d8f6f45d2cc65ff5036955c6b36af21014a1bd175763da1d35460ccfbbd"}
Jul 28 20:29:30.025942 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.025842    2574 scope.go:117] "RemoveContainer" containerID="82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d"
Jul 28 20:29:30.035898 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.035879    2574 scope.go:117] "RemoveContainer" containerID="8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"
Jul 28 20:29:30.044488 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.044470    2574 scope.go:117] "RemoveContainer" containerID="82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d"
Jul 28 20:29:30.044771 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:29:30.044751    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d\": container with ID starting with 82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d not found: ID does not exist" containerID="82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d"
Jul 28 20:29:30.044822 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.044780    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d"} err="failed to get container status \"82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d\": rpc error: code = NotFound desc = could not find container \"82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d\": container with ID starting with 82a8881a384eeb026703f30e7ee4e6798950c9fae9301daa8515f9dc86425b7d not found: ID does not exist"
Jul 28 20:29:30.044822 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.044798    2574 scope.go:117] "RemoveContainer" containerID="8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"
Jul 28 20:29:30.045046 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:29:30.045019    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0\": container with ID starting with 8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0 not found: ID does not exist" containerID="8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"
Jul 28 20:29:30.045144 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.045048    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0"} err="failed to get container status \"8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0\": rpc error: code = NotFound desc = could not find container \"8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0\": container with ID starting with 8b1b58ebbd2462108aa855fe3e0e83f8b468d922e601436c140e3632793f4cd0 not found: ID does not exist"
Jul 28 20:29:30.050101 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.050075    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"]
Jul 28 20:29:30.054176 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:30.054155    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0fc004-openshift-default-fc4c957d-tmzlx"]
Jul 28 20:29:31.710464 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:31.710434    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" path="/var/lib/kubelet/pods/2582c3f3-132d-4806-ac6c-0b10d14a0a41/volumes"
Jul 28 20:29:43.650949 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:43.650918    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"]
Jul 28 20:29:43.651458 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:43.651111    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2" podUID="9e99e031-471e-40d2-a482-b6c1ba884e15" containerName="maas-api" containerID="cri-o://4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044" gracePeriod=30
Jul 28 20:29:43.924061 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:43.924031    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:29:44.045631 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.045596    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e99e031-471e-40d2-a482-b6c1ba884e15-maas-api-tls\") pod \"9e99e031-471e-40d2-a482-b6c1ba884e15\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") "
Jul 28 20:29:44.045809 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.045638    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e99e031-471e-40d2-a482-b6c1ba884e15-openshift-service-ca\") pod \"9e99e031-471e-40d2-a482-b6c1ba884e15\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") "
Jul 28 20:29:44.045809 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.045700    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2tb5\" (UniqueName: \"kubernetes.io/projected/9e99e031-471e-40d2-a482-b6c1ba884e15-kube-api-access-p2tb5\") pod \"9e99e031-471e-40d2-a482-b6c1ba884e15\" (UID: \"9e99e031-471e-40d2-a482-b6c1ba884e15\") "
Jul 28 20:29:44.046089 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.046059    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e99e031-471e-40d2-a482-b6c1ba884e15-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e99e031-471e-40d2-a482-b6c1ba884e15" (UID: "9e99e031-471e-40d2-a482-b6c1ba884e15"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:29:44.047641 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.047612    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e99e031-471e-40d2-a482-b6c1ba884e15-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e99e031-471e-40d2-a482-b6c1ba884e15" (UID: "9e99e031-471e-40d2-a482-b6c1ba884e15"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:29:44.047865 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.047835    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e99e031-471e-40d2-a482-b6c1ba884e15-kube-api-access-p2tb5" (OuterVolumeSpecName: "kube-api-access-p2tb5") pod "9e99e031-471e-40d2-a482-b6c1ba884e15" (UID: "9e99e031-471e-40d2-a482-b6c1ba884e15"). InnerVolumeSpecName "kube-api-access-p2tb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:29:44.114085 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.114048    2574 generic.go:356] "Generic (PLEG): container finished" podID="9e99e031-471e-40d2-a482-b6c1ba884e15" containerID="4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044" exitCode=0
Jul 28 20:29:44.114291 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.114093    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"
Jul 28 20:29:44.114291 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.114134    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2" event={"ID":"9e99e031-471e-40d2-a482-b6c1ba884e15","Type":"ContainerDied","Data":"4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044"}
Jul 28 20:29:44.114291 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.114192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2" event={"ID":"9e99e031-471e-40d2-a482-b6c1ba884e15","Type":"ContainerDied","Data":"c20a3e543a762c5697e5e5b29207efc390936a28cf2228e1e217b290ab629359"}
Jul 28 20:29:44.114291 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.114219    2574 scope.go:117] "RemoveContainer" containerID="4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044"
Jul 28 20:29:44.123889 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.123871    2574 scope.go:117] "RemoveContainer" containerID="4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044"
Jul 28 20:29:44.124133 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:29:44.124115    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044\": container with ID starting with 4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044 not found: ID does not exist" containerID="4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044"
Jul 28 20:29:44.124185 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.124142    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044"} err="failed to get container status \"4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044\": rpc error: code = NotFound desc = could not find container \"4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044\": container with ID starting with 4df592ce6adff36eff28348f5927d0f87b11cfd35b4bc6f35b68933d386a4044 not found: ID does not exist"
Jul 28 20:29:44.139111 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.139081    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"]
Jul 28 20:29:44.142833 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.142809    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-06df9a-78656d9bb4-85dz2"]
Jul 28 20:29:44.147125 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.147104    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e99e031-471e-40d2-a482-b6c1ba884e15-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:44.147219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.147128    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e99e031-471e-40d2-a482-b6c1ba884e15-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:44.147219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:44.147142    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2tb5\" (UniqueName: \"kubernetes.io/projected/9e99e031-471e-40d2-a482-b6c1ba884e15-kube-api-access-p2tb5\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:29:45.492170 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:45.492129    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:29:45.710833 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:45.710799    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e99e031-471e-40d2-a482-b6c1ba884e15" path="/var/lib/kubelet/pods/9e99e031-471e-40d2-a482-b6c1ba884e15/volumes"
Jul 28 20:29:55.793808 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:29:55.793767    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:30:32.279096 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:32.279049    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"]
Jul 28 20:30:32.280072 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:32.280033    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy" containerID="cri-o://ff49063621d0b323ff6c99f4fa25647491f5ab0b7316b012b48690efc108f65e" gracePeriod=30
Jul 28 20:30:35.883408 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:35.883371    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:30:35.883804 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:35.883431    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:30:37.407065 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.407023    2574 generic.go:356] "Generic (PLEG): container finished" podID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerID="ff49063621d0b323ff6c99f4fa25647491f5ab0b7316b012b48690efc108f65e" exitCode=0
Jul 28 20:30:37.407538 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.407098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" event={"ID":"30d78efb-f592-4921-a3f1-c5aed2a0f168","Type":"ContainerDied","Data":"ff49063621d0b323ff6c99f4fa25647491f5ab0b7316b012b48690efc108f65e"}
Jul 28 20:30:37.407538 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.407162    2574 scope.go:117] "RemoveContainer" containerID="c2f5a7a437c6bfc5f0fc168d9a42fa7624fb7e2790941426b3f62d4ac9c4775a"
Jul 28 20:30:37.547794 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.547731    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:30:37.673599 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673564    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-podinfo\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.673786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673605    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-socket\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.673786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673662    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-credential-socket\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.673786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673685    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-data\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.673786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673724    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-token\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.673786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673756    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30d78efb-f592-4921-a3f1-c5aed2a0f168-istiod-ca-cert\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.673786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673783    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-certs\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.674108 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673811    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-envoy\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.674108 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673841    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2bj8\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-kube-api-access-j2bj8\") pod \"30d78efb-f592-4921-a3f1-c5aed2a0f168\" (UID: \"30d78efb-f592-4921-a3f1-c5aed2a0f168\") "
Jul 28 20:30:37.674108 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.673976    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:37.674108 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.674000    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:37.674302 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.674174    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30d78efb-f592-4921-a3f1-c5aed2a0f168-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:30:37.674302 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.674250    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:37.674302 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.674268    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-socket\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.674491 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.674306    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-credential-socket\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.674637 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.674609    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-data" (OuterVolumeSpecName: "istio-data") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:37.676064 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.676040    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-kube-api-access-j2bj8" (OuterVolumeSpecName: "kube-api-access-j2bj8") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "kube-api-access-j2bj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:30:37.676162 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.676086    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:37.676304 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.676284    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-token" (OuterVolumeSpecName: "istio-token") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:30:37.676391 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.676286    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30d78efb-f592-4921-a3f1-c5aed2a0f168" (UID: "30d78efb-f592-4921-a3f1-c5aed2a0f168"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:30:37.774803 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774770    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30d78efb-f592-4921-a3f1-c5aed2a0f168-istiod-ca-cert\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.774803 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774798    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-workload-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.774803 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774807    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-envoy\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.775057 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774816    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2bj8\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-kube-api-access-j2bj8\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.775057 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774825    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-podinfo\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.775057 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774833    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-data\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:37.775057 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:37.774842    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30d78efb-f592-4921-a3f1-c5aed2a0f168-istio-token\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:38.414995 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:38.414952    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst" event={"ID":"30d78efb-f592-4921-a3f1-c5aed2a0f168","Type":"ContainerDied","Data":"3f7e28d3cab7d163ac0e2921e532250f1f23a138e8e06e9ae03f23376ab8711f"}
Jul 28 20:30:38.415485 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:38.415018    2574 scope.go:117] "RemoveContainer" containerID="ff49063621d0b323ff6c99f4fa25647491f5ab0b7316b012b48690efc108f65e"
Jul 28 20:30:38.415485 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:38.414970    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"
Jul 28 20:30:38.437855 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:38.437823    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"]
Jul 28 20:30:38.443119 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:38.443094    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-06df9a-openshift-default-999fcb6c4-gwxst"]
Jul 28 20:30:39.711010 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:39.710977    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" path="/var/lib/kubelet/pods/30d78efb-f592-4921-a3f1-c5aed2a0f168/volumes"
Jul 28 20:30:46.595801 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:46.595760    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:30:49.954123 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:49.954082    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"]
Jul 28 20:30:49.954582 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:49.954334    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy" containerID="cri-o://9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177" gracePeriod=30
Jul 28 20:30:55.222449 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.222383    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:30:55.349186 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349157    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-socket\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349385 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349191    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-podinfo\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349385 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349226    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nznvn\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-kube-api-access-nznvn\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349385 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349268    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-certs\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349385 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349285    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-token\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349597 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349466    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:55.349597 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349470    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istiod-ca-cert\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349597 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349549    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-data\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349597 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349594    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-credential-socket\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349798 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349630    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-envoy\") pod \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\" (UID: \"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c\") "
Jul 28 20:30:55.349798 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349644    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:55.349914 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349795    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:55.349972 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.349921    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:30:55.350131 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.350112    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-certs\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.350201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.350137    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istiod-ca-cert\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.350201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.350150    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-credential-socket\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.350201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.350163    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-workload-socket\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.350567 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.350532    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-data" (OuterVolumeSpecName: "istio-data") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:55.351685 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.351666    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:30:55.351822 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.351806    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-token" (OuterVolumeSpecName: "istio-token") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:30:55.351973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.351953    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:55.352034 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.351954    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-kube-api-access-nznvn" (OuterVolumeSpecName: "kube-api-access-nznvn") pod "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" (UID: "faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c"). InnerVolumeSpecName "kube-api-access-nznvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:30:55.451070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.451036    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-data\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.451070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.451064    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-envoy\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.451070 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.451075    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-podinfo\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.451320 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.451084    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nznvn\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-kube-api-access-nznvn\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.451320 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.451094    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c-istio-token\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:30:55.510531 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.510426    2574 generic.go:356] "Generic (PLEG): container finished" podID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerID="9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177" exitCode=0
Jul 28 20:30:55.510531 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.510478    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"
Jul 28 20:30:55.510531 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.510506    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" event={"ID":"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c","Type":"ContainerDied","Data":"9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177"}
Jul 28 20:30:55.510802 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.510561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw" event={"ID":"faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c","Type":"ContainerDied","Data":"65efc434e4659818592d16630b742302af30fae15390b5220d31dab89e027419"}
Jul 28 20:30:55.510802 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.510589    2574 scope.go:117] "RemoveContainer" containerID="9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177"
Jul 28 20:30:55.520582 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.520558    2574 scope.go:117] "RemoveContainer" containerID="36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"
Jul 28 20:30:55.536222 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.536190    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"]
Jul 28 20:30:55.538163 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.538132    2574 scope.go:117] "RemoveContainer" containerID="9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177"
Jul 28 20:30:55.538589 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:30:55.538566    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177\": container with ID starting with 9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177 not found: ID does not exist" containerID="9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177"
Jul 28 20:30:55.538690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.538597    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177"} err="failed to get container status \"9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177\": rpc error: code = NotFound desc = could not find container \"9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177\": container with ID starting with 9327153c8cdea1d01b46cd3997a64d3b945dc6c563330b4d6a85c81ce9bbe177 not found: ID does not exist"
Jul 28 20:30:55.538690 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.538617    2574 scope.go:117] "RemoveContainer" containerID="36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"
Jul 28 20:30:55.538930 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:30:55.538913    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188\": container with ID starting with 36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188 not found: ID does not exist" containerID="36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"
Jul 28 20:30:55.538989 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.538939    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188"} err="failed to get container status \"36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188\": rpc error: code = NotFound desc = could not find container \"36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188\": container with ID starting with 36b5d9fcbd8ad0bd80db52acb0f4ab345f89c1e2c4e73eb435dbaaf53d271188 not found: ID does not exist"
Jul 28 20:30:55.540202 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.540180    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-426065-openshift-default-6d5bf55694-4rghw"]
Jul 28 20:30:55.710032 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:30:55.709985    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" path="/var/lib/kubelet/pods/faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c/volumes"
Jul 28 20:31:00.807818 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:00.807784    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"]
Jul 28 20:31:00.808272 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:00.808009    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" podUID="df6b2c0c-8332-49b2-a714-8dd177820341" containerName="maas-api" containerID="cri-o://04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5" gracePeriod=30
Jul 28 20:31:01.078669 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.078644    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:31:01.208594 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.208551    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdz55\" (UniqueName: \"kubernetes.io/projected/df6b2c0c-8332-49b2-a714-8dd177820341-kube-api-access-fdz55\") pod \"df6b2c0c-8332-49b2-a714-8dd177820341\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") "
Jul 28 20:31:01.208815 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.208654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls\") pod \"df6b2c0c-8332-49b2-a714-8dd177820341\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") "
Jul 28 20:31:01.208893 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.208812    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b2c0c-8332-49b2-a714-8dd177820341-openshift-service-ca\") pod \"df6b2c0c-8332-49b2-a714-8dd177820341\" (UID: \"df6b2c0c-8332-49b2-a714-8dd177820341\") "
Jul 28 20:31:01.209233 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.209201    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6b2c0c-8332-49b2-a714-8dd177820341-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df6b2c0c-8332-49b2-a714-8dd177820341" (UID: "df6b2c0c-8332-49b2-a714-8dd177820341"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:01.210745 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.210718    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df6b2c0c-8332-49b2-a714-8dd177820341-kube-api-access-fdz55" (OuterVolumeSpecName: "kube-api-access-fdz55") pod "df6b2c0c-8332-49b2-a714-8dd177820341" (UID: "df6b2c0c-8332-49b2-a714-8dd177820341"). InnerVolumeSpecName "kube-api-access-fdz55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:01.210745 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.210738    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df6b2c0c-8332-49b2-a714-8dd177820341" (UID: "df6b2c0c-8332-49b2-a714-8dd177820341"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:31:01.309607 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.309569    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df6b2c0c-8332-49b2-a714-8dd177820341-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.309607 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.309600    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b2c0c-8332-49b2-a714-8dd177820341-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.309607 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.309612    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdz55\" (UniqueName: \"kubernetes.io/projected/df6b2c0c-8332-49b2-a714-8dd177820341-kube-api-access-fdz55\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:31:01.544938 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.544892    2574 generic.go:356] "Generic (PLEG): container finished" podID="df6b2c0c-8332-49b2-a714-8dd177820341" containerID="04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5" exitCode=0
Jul 28 20:31:01.545133 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.544952    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"
Jul 28 20:31:01.545133 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.544965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" event={"ID":"df6b2c0c-8332-49b2-a714-8dd177820341","Type":"ContainerDied","Data":"04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5"}
Jul 28 20:31:01.545133 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.545038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg" event={"ID":"df6b2c0c-8332-49b2-a714-8dd177820341","Type":"ContainerDied","Data":"46f7141786e636e192a9bc389e364540707a942a902900a9043e515783dad349"}
Jul 28 20:31:01.545133 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.545063    2574 scope.go:117] "RemoveContainer" containerID="04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5"
Jul 28 20:31:01.554652 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.554629    2574 scope.go:117] "RemoveContainer" containerID="04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5"
Jul 28 20:31:01.554940 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:31:01.554915    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5\": container with ID starting with 04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5 not found: ID does not exist" containerID="04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5"
Jul 28 20:31:01.555008 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.554954    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5"} err="failed to get container status \"04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5\": rpc error: code = NotFound desc = could not find container \"04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5\": container with ID starting with 04d0519416416412b9d6faa15540a0f2f1dc1a755a0dcc128e1d32d5aad793c5 not found: ID does not exist"
Jul 28 20:31:01.567634 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.567604    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"]
Jul 28 20:31:01.574382 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.574340    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c38c57-847fb74999-g5pbg"]
Jul 28 20:31:01.710562 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:01.710526    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df6b2c0c-8332-49b2-a714-8dd177820341" path="/var/lib/kubelet/pods/df6b2c0c-8332-49b2-a714-8dd177820341/volumes"
Jul 28 20:31:03.900981 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:03.900883    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:31:18.762861 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:18.762825    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"]
Jul 28 20:31:18.763334 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:18.763137    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj" podUID="b4700004-4adb-44a9-80a9-64d8e4e6db27" containerName="maas-api" containerID="cri-o://2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3" gracePeriod=30
Jul 28 20:31:19.021609 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.021551    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:31:19.181517 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.181487    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4700004-4adb-44a9-80a9-64d8e4e6db27-maas-api-tls\") pod \"b4700004-4adb-44a9-80a9-64d8e4e6db27\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") "
Jul 28 20:31:19.181692 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.181538    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6dr5\" (UniqueName: \"kubernetes.io/projected/b4700004-4adb-44a9-80a9-64d8e4e6db27-kube-api-access-s6dr5\") pod \"b4700004-4adb-44a9-80a9-64d8e4e6db27\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") "
Jul 28 20:31:19.181692 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.181668    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4700004-4adb-44a9-80a9-64d8e4e6db27-openshift-service-ca\") pod \"b4700004-4adb-44a9-80a9-64d8e4e6db27\" (UID: \"b4700004-4adb-44a9-80a9-64d8e4e6db27\") "
Jul 28 20:31:19.182056 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.182020    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4700004-4adb-44a9-80a9-64d8e4e6db27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4700004-4adb-44a9-80a9-64d8e4e6db27" (UID: "b4700004-4adb-44a9-80a9-64d8e4e6db27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:19.183710 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.183677    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4700004-4adb-44a9-80a9-64d8e4e6db27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4700004-4adb-44a9-80a9-64d8e4e6db27" (UID: "b4700004-4adb-44a9-80a9-64d8e4e6db27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:31:19.183862 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.183728    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4700004-4adb-44a9-80a9-64d8e4e6db27-kube-api-access-s6dr5" (OuterVolumeSpecName: "kube-api-access-s6dr5") pod "b4700004-4adb-44a9-80a9-64d8e4e6db27" (UID: "b4700004-4adb-44a9-80a9-64d8e4e6db27"). InnerVolumeSpecName "kube-api-access-s6dr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:19.283078 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.282989    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4700004-4adb-44a9-80a9-64d8e4e6db27-maas-api-tls\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.283078 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.283021    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6dr5\" (UniqueName: \"kubernetes.io/projected/b4700004-4adb-44a9-80a9-64d8e4e6db27-kube-api-access-s6dr5\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.283078 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.283036    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4700004-4adb-44a9-80a9-64d8e4e6db27-openshift-service-ca\") on node \"ip-10-0-137-245.ec2.internal\" DevicePath \"\""
Jul 28 20:31:19.640356 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.640317    2574 generic.go:356] "Generic (PLEG): container finished" podID="b4700004-4adb-44a9-80a9-64d8e4e6db27" containerID="2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3" exitCode=0
Jul 28 20:31:19.640356 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.640378    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj" event={"ID":"b4700004-4adb-44a9-80a9-64d8e4e6db27","Type":"ContainerDied","Data":"2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3"}
Jul 28 20:31:19.640642 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.640384    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"
Jul 28 20:31:19.640642 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.640421    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj" event={"ID":"b4700004-4adb-44a9-80a9-64d8e4e6db27","Type":"ContainerDied","Data":"7e24ecd01d85a16eeee41ee0eeb1b06d6b70a092bd5659b6302df3b566353821"}
Jul 28 20:31:19.640642 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.640446    2574 scope.go:117] "RemoveContainer" containerID="2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3"
Jul 28 20:31:19.650268 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.650250    2574 scope.go:117] "RemoveContainer" containerID="2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3"
Jul 28 20:31:19.650581 ip-10-0-137-245 kubenswrapper[2574]: E0728 20:31:19.650556    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3\": container with ID starting with 2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3 not found: ID does not exist" containerID="2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3"
Jul 28 20:31:19.650660 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.650589    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3"} err="failed to get container status \"2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3\": rpc error: code = NotFound desc = could not find container \"2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3\": container with ID starting with 2349ad6485782ffffd7a1bb56d68a38191614d964ff73a8843f1be324bbe3bf3 not found: ID does not exist"
Jul 28 20:31:19.667991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.667960    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"]
Jul 28 20:31:19.671357 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.671332    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d170bd-d8674849c-r5xdj"]
Jul 28 20:31:19.710005 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:19.709973    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4700004-4adb-44a9-80a9-64d8e4e6db27" path="/var/lib/kubelet/pods/b4700004-4adb-44a9-80a9-64d8e4e6db27/volumes"
Jul 28 20:31:21.696589 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:21.696551    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t9vzd"]
Jul 28 20:31:26.343210 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:26.343173    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85789b8d98-qgw5v_18b8199e-6071-449e-9c09-1bfb0a92a801/authorino/0.log"
Jul 28 20:31:31.574279 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:31.574244    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f2vqq_c3a3c566-00d0-4dcc-b8ed-f80571b2909c/manager/0.log"
Jul 28 20:31:31.689568 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:31.689534    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zcbj9_bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9/manager/0.log"
Jul 28 20:31:32.269199 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:32.269166    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-jw2rh_6c776762-2e8c-45f3-bc3c-d726ae5e9947/copy-manifests/0.log"
Jul 28 20:31:32.282597 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:32.282565    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-jw2rh_6c776762-2e8c-45f3-bc3c-d726ae5e9947/manager/0.log"
Jul 28 20:31:34.499074 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:34.499033    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85789b8d98-qgw5v_18b8199e-6071-449e-9c09-1bfb0a92a801/authorino/0.log"
Jul 28 20:31:34.613597 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:34.613565    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-crrcw_9f007322-678f-4df1-9c07-a77f3a93855d/manager/0.log"
Jul 28 20:31:34.729896 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:34.729868    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2rr7_bea7a808-47cd-4c9d-b44c-4631330daa84/manager/0.log"
Jul 28 20:31:34.833282 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:34.833207    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hbfgp_dcbc000d-8c6a-411b-896a-fe3f8fcadb82/kuadrant-console-plugin/0.log"
Jul 28 20:31:34.943382 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:34.943338    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dbbhx_0749b487-141b-439d-804d-f25f1ec2105e/registry-server/0.log"
Jul 28 20:31:35.056377 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:35.056329    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qtcgg_c72824e3-f84d-4f30-a8ce-1e9bc075dcd2/manager/0.log"
Jul 28 20:31:35.168577 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:35.168548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t9vzd_aa634361-e37f-4c87-9d74-dbbf508ce132/limitador/0.log"
Jul 28 20:31:35.278991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:35.278953    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4j9ft_9ab4933e-bb33-47e5-83a2-9135bd8ffced/manager/0.log"
Jul 28 20:31:35.978246 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:35.978216    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccfbc6b9-l9784_f145f7cf-b614-4bff-9f57-627dd7d9f5cd/kube-auth-proxy/0.log"
Jul 28 20:31:36.429842 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:36.429811    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6d8b4d89-5zl6n_c72abebf-4474-49c9-930b-cafd40be40ca/router/0.log"
Jul 28 20:31:36.751813 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:36.751737    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gsnvw_aa541f41-856c-41d7-8e9a-b01f90f64e1b/main/0.log"
Jul 28 20:31:36.975969 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:36.975937    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dcbjc_de3c7fd9-eb22-42fa-a92a-91e2c79c5d91/main/0.log"
Jul 28 20:31:45.858069 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:45.858038    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hv5wt_7242a83b-7c5d-42b4-a16e-76dbb67db5b5/global-pull-secret-syncer/0.log"
Jul 28 20:31:46.003382 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:46.003337    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kjkvl_662f3693-4294-4f5e-b8d9-6fe5f7f0f4e1/konnectivity-agent/0.log"
Jul 28 20:31:46.097140 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:46.097112    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-245.ec2.internal_f82d0ea6d17a563c4b7940ec7927ea2a/haproxy/0.log"
Jul 28 20:31:51.570786 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.570753    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85789b8d98-qgw5v_18b8199e-6071-449e-9c09-1bfb0a92a801/authorino/0.log"
Jul 28 20:31:51.604407 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.604354    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-crrcw_9f007322-678f-4df1-9c07-a77f3a93855d/manager/0.log"
Jul 28 20:31:51.637022 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.636992    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2rr7_bea7a808-47cd-4c9d-b44c-4631330daa84/manager/0.log"
Jul 28 20:31:51.668931 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.668906    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hbfgp_dcbc000d-8c6a-411b-896a-fe3f8fcadb82/kuadrant-console-plugin/0.log"
Jul 28 20:31:51.723926 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.723896    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dbbhx_0749b487-141b-439d-804d-f25f1ec2105e/registry-server/0.log"
Jul 28 20:31:51.907581 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.907538    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qtcgg_c72824e3-f84d-4f30-a8ce-1e9bc075dcd2/manager/0.log"
Jul 28 20:31:51.968497 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:51.968459    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t9vzd_aa634361-e37f-4c87-9d74-dbbf508ce132/limitador/0.log"
Jul 28 20:31:52.040623 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:52.040591    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4j9ft_9ab4933e-bb33-47e5-83a2-9135bd8ffced/manager/0.log"
Jul 28 20:31:53.813211 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.813183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/alertmanager/0.log"
Jul 28 20:31:53.837494 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.837468    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/config-reloader/0.log"
Jul 28 20:31:53.861652 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.861624    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/kube-rbac-proxy-web/0.log"
Jul 28 20:31:53.892893 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.892872    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/kube-rbac-proxy/0.log"
Jul 28 20:31:53.921219 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.921194    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/kube-rbac-proxy-metric/0.log"
Jul 28 20:31:53.945686 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.945660    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/prom-label-proxy/0.log"
Jul 28 20:31:53.970054 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:53.970026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_553ffaa1-c1f1-4d7c-b3c9-a7d3daf4fc2f/init-config-reloader/0.log"
Jul 28 20:31:54.123885 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.123858    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b99dfd848-h72n9_ae617915-ecfd-4302-8f6f-8440913c8296/metrics-server/0.log"
Jul 28 20:31:54.197622 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.197590    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9r9ck_817306a9-3479-43e2-8d48-7f01b7b75046/node-exporter/0.log"
Jul 28 20:31:54.221642 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.221611    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9r9ck_817306a9-3479-43e2-8d48-7f01b7b75046/kube-rbac-proxy/0.log"
Jul 28 20:31:54.249320 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.249291    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9r9ck_817306a9-3479-43e2-8d48-7f01b7b75046/init-textfile/0.log"
Jul 28 20:31:54.450489 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.450410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lvjtk_b4c07fd1-8b0d-4bec-973a-f8c90979ee8b/kube-rbac-proxy-main/0.log"
Jul 28 20:31:54.477486 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.477461    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lvjtk_b4c07fd1-8b0d-4bec-973a-f8c90979ee8b/kube-rbac-proxy-self/0.log"
Jul 28 20:31:54.502741 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.502714    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-lvjtk_b4c07fd1-8b0d-4bec-973a-f8c90979ee8b/openshift-state-metrics/0.log"
Jul 28 20:31:54.735404 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.735297    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hqllz_7d748d3a-cc2f-4277-a9bc-f8551ec8f25b/prometheus-operator/0.log"
Jul 28 20:31:54.759153 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.759109    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hqllz_7d748d3a-cc2f-4277-a9bc-f8551ec8f25b/kube-rbac-proxy/0.log"
Jul 28 20:31:54.791345 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.791310    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-khcrn_34970343-959f-4540-8137-07c29f6c5b66/prometheus-operator-admission-webhook/0.log"
Jul 28 20:31:54.925266 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.925235    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9c7fff77-5c9hm_8f555990-8d07-4beb-bc72-a2a109597baa/thanos-query/0.log"
Jul 28 20:31:54.950272 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.950242    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9c7fff77-5c9hm_8f555990-8d07-4beb-bc72-a2a109597baa/kube-rbac-proxy-web/0.log"
Jul 28 20:31:54.977542 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:54.977511    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9c7fff77-5c9hm_8f555990-8d07-4beb-bc72-a2a109597baa/kube-rbac-proxy/0.log"
Jul 28 20:31:55.002522 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.002456    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9c7fff77-5c9hm_8f555990-8d07-4beb-bc72-a2a109597baa/prom-label-proxy/0.log"
Jul 28 20:31:55.029974 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.029949    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9c7fff77-5c9hm_8f555990-8d07-4beb-bc72-a2a109597baa/kube-rbac-proxy-rules/0.log"
Jul 28 20:31:55.059105 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.059080    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9c7fff77-5c9hm_8f555990-8d07-4beb-bc72-a2a109597baa/kube-rbac-proxy-metrics/0.log"
Jul 28 20:31:55.499770 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.499735    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"]
Jul 28 20:31:55.500191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500177    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4700004-4adb-44a9-80a9-64d8e4e6db27" containerName="maas-api"
Jul 28 20:31:55.500236 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500193    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4700004-4adb-44a9-80a9-64d8e4e6db27" containerName="maas-api"
Jul 28 20:31:55.500236 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500205    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e99e031-471e-40d2-a482-b6c1ba884e15" containerName="maas-api"
Jul 28 20:31:55.500236 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500214    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e99e031-471e-40d2-a482-b6c1ba884e15" containerName="maas-api"
Jul 28 20:31:55.500236 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500226    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy"
Jul 28 20:31:55.500236 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500231    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500243    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500248    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500256    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500261    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500266    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500272    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500290    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500298    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500310    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df6b2c0c-8332-49b2-a714-8dd177820341" containerName="maas-api"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500315    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="df6b2c0c-8332-49b2-a714-8dd177820341" containerName="maas-api"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500394    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="30d78efb-f592-4921-a3f1-c5aed2a0f168" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500402    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e99e031-471e-40d2-a482-b6c1ba884e15" containerName="maas-api"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500408    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2582c3f3-132d-4806-ac6c-0b10d14a0a41" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500416    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf5b5fe-63e4-4aa5-9da9-d48f0d7e114c" containerName="istio-proxy"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500423    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4700004-4adb-44a9-80a9-64d8e4e6db27" containerName="maas-api"
Jul 28 20:31:55.500428 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.500430    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="df6b2c0c-8332-49b2-a714-8dd177820341" containerName="maas-api"
Jul 28 20:31:55.505172 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.505152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.508155 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.508130    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2456d\"/\"default-dockercfg-wvrm8\""
Jul 28 20:31:55.509587 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.509562    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2456d\"/\"openshift-service-ca.crt\""
Jul 28 20:31:55.509727 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.509633    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2456d\"/\"kube-root-ca.crt\""
Jul 28 20:31:55.512875 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.512675    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"]
Jul 28 20:31:55.627003 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.626971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-podres\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.627201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.627063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-proc\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.627201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.627157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-lib-modules\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.627201 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.627187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-sys\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.627352 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.627269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttq68\" (UniqueName: \"kubernetes.io/projected/97543410-6bec-48ed-9314-59954dafc23d-kube-api-access-ttq68\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.728805 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.728769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttq68\" (UniqueName: \"kubernetes.io/projected/97543410-6bec-48ed-9314-59954dafc23d-kube-api-access-ttq68\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.728973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.728853    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-podres\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.728973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.728880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-proc\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.728973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.728912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-lib-modules\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.728973 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.728934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-sys\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.729191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.729008    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-proc\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.729191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.729015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-sys\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.729191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.729034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-podres\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.729191 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.729074    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97543410-6bec-48ed-9314-59954dafc23d-lib-modules\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.738425 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.738398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttq68\" (UniqueName: \"kubernetes.io/projected/97543410-6bec-48ed-9314-59954dafc23d-kube-api-access-ttq68\") pod \"perf-node-gather-daemonset-zvwhf\" (UID: \"97543410-6bec-48ed-9314-59954dafc23d\") " pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.817169 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.817052    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:55.962699 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:55.962667    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"]
Jul 28 20:31:55.964551 ip-10-0-137-245 kubenswrapper[2574]: W0728 20:31:55.964521    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97543410_6bec_48ed_9314_59954dafc23d.slice/crio-541e4343c8ae6e5e684e6a6bb635f9592b9519aa7d1ad91f28880914630574b5 WatchSource:0}: Error finding container 541e4343c8ae6e5e684e6a6bb635f9592b9519aa7d1ad91f28880914630574b5: Status 404 returned error can't find the container with id 541e4343c8ae6e5e684e6a6bb635f9592b9519aa7d1ad91f28880914630574b5
Jul 28 20:31:56.842877 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:56.842839    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf" event={"ID":"97543410-6bec-48ed-9314-59954dafc23d","Type":"ContainerStarted","Data":"074c08108757274ebae1fe440e8883e3fcdbf6e316ec7b5c4261596980a356ac"}
Jul 28 20:31:56.843055 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:56.842897    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf" event={"ID":"97543410-6bec-48ed-9314-59954dafc23d","Type":"ContainerStarted","Data":"541e4343c8ae6e5e684e6a6bb635f9592b9519aa7d1ad91f28880914630574b5"}
Jul 28 20:31:56.843055 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:56.842920    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:31:56.876554 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:56.876491    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf" podStartSLOduration=1.8764740629999999 podStartE2EDuration="1.876474063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:31:56.874163575 +0000 UTC m=+3735.722697054" watchObservedRunningTime="2026-07-28 20:31:56.876474063 +0000 UTC m=+3735.725007521"
Jul 28 20:31:57.411657 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:57.411628    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-9p5vr_9051c059-405f-4d7a-8fe8-ffda13c52653/download-server/0.log"
Jul 28 20:31:58.091352 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:58.091323    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-589sh_6b53eb30-7fb4-4c25-90d6-3936183fcea7/volume-data-source-validator/0.log"
Jul 28 20:31:59.241229 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:59.241194    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7vk_88f015c2-1349-4491-803c-310e227415d1/dns/0.log"
Jul 28 20:31:59.265306 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:59.265275    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj7vk_88f015c2-1349-4491-803c-310e227415d1/kube-rbac-proxy/0.log"
Jul 28 20:31:59.291630 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:59.291595    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44t57_592865ab-8346-4df2-bb41-fd71b6ddb268/dns-node-resolver/0.log"
Jul 28 20:31:59.944687 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:31:59.944654    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9jcd_456fe185-63e2-497a-b3e0-61c0e23294a5/node-ca/0.log"
Jul 28 20:32:01.139545 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:01.139515    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccfbc6b9-l9784_f145f7cf-b614-4bff-9f57-627dd7d9f5cd/kube-auth-proxy/0.log"
Jul 28 20:32:01.306103 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:01.306072    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6d8b4d89-5zl6n_c72abebf-4474-49c9-930b-cafd40be40ca/router/0.log"
Jul 28 20:32:02.134431 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:02.134403    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f97hk_f2bf292e-4ef1-4d23-88bb-235f1e5c5672/serve-healthcheck-canary/0.log"
Jul 28 20:32:02.689532 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:02.689497    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5qcxl_388fb7cc-2204-448d-8b14-c61b7209c65d/kube-rbac-proxy/0.log"
Jul 28 20:32:02.715991 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:02.715961    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5qcxl_388fb7cc-2204-448d-8b14-c61b7209c65d/exporter/0.log"
Jul 28 20:32:02.741824 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:02.741798    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5qcxl_388fb7cc-2204-448d-8b14-c61b7209c65d/extractor/0.log"
Jul 28 20:32:02.858152 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:02.858125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2456d/perf-node-gather-daemonset-zvwhf"
Jul 28 20:32:05.330596 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:05.330517    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f2vqq_c3a3c566-00d0-4dcc-b8ed-f80571b2909c/manager/0.log"
Jul 28 20:32:05.549621 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:05.549583    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zcbj9_bb8d19a5-d4dc-43cc-a9a3-f2ebdef0abf9/manager/0.log"
Jul 28 20:32:05.826582 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:05.826546    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccfbc6b9-l9784_f145f7cf-b614-4bff-9f57-627dd7d9f5cd/kube-auth-proxy/0.log"
Jul 28 20:32:05.970162 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:05.970070    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6d8b4d89-5zl6n_c72abebf-4474-49c9-930b-cafd40be40ca/router/0.log"
Jul 28 20:32:06.092052 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:06.092019    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-jw2rh_6c776762-2e8c-45f3-bc3c-d726ae5e9947/manager/0.log"
Jul 28 20:32:06.137872 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:06.137845    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9ddd48bbd-jw2rh_6c776762-2e8c-45f3-bc3c-d726ae5e9947/copy-manifests/0.log"
Jul 28 20:32:07.646911 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:07.646833    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccfbc6b9-l9784_f145f7cf-b614-4bff-9f57-627dd7d9f5cd/kube-auth-proxy/0.log"
Jul 28 20:32:07.767783 ip-10-0-137-245 kubenswrapper[2574]: I0728 20:32:07.767754    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c6d8b4d89-5zl6n_c72abebf-4474-49c9-930b-cafd40be40ca/router/0.log"